Jun 09 15:02:21.819890 ip-10-0-131-236 systemd[1]: Starting Kubernetes Kubelet... Jun 09 15:02:22.224147 ip-10-0-131-236 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:02:22.224147 ip-10-0-131-236 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 15:02:22.224147 ip-10-0-131-236 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:02:22.224147 ip-10-0-131-236 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 15:02:22.224147 ip-10-0-131-236 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:02:22.226616 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.226515 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 15:02:22.230355 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230339 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:02:22.230355 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230355 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230358 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230362 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230365 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230369 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230372 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230375 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230378 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230383 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230387 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230390 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230394 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230397 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230399 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230402 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230405 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230408 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230410 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230412 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230415 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:02:22.230416 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230418 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230429 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230432 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230435 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230438 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230441 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230444 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230446 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230449 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230452 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230454 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230457 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230459 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230462 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230465 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230467 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230472 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230475 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230478 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:02:22.230908 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230481 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230483 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230486 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230489 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230492 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230494 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230497 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230499 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230502 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230504 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230507 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230509 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230512 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230514 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230517 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230521 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230524 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230527 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230529 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230532 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:02:22.231373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230535 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230538 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230540 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230543 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230546 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230549 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230551 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230554 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230559 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230562 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230565 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230568 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230571 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230574 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230577 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230580 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230583 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230586 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230589 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:02:22.231912 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230591 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230594 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230597 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230599 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230615 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230619 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230621 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230624 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230628 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230630 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230633 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230636 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230639 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230641 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230644 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230646 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230649 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230652 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230654 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.230657 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:02:22.232365 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.231980 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.231987 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.231991 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.231994 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.231997 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232000 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232003 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232005 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232008 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232011 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232014 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232017 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232019 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232022 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232025 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232028 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232031 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232034 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232037 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232039 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:02:22.232863 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232043 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232046 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232048 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232051 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232054 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232057 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232059 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232062 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232064 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232067 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232070 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232072 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232075 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232078 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232080 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232083 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232086 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232089 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232091 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232094 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:02:22.233357 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232096 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232099 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232102 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232105 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232108 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232110 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232114 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232117 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232119 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232122 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232125 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232130 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232135 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232138 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232141 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232144 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232146 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232149 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232152 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:02:22.233864 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232156 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232159 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232162 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232165 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232168 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232171 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232173 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232176 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232179 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232181 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232184 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232187 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232189 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232192 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232197 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232200 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232203 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232205 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232208 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232210 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:02:22.234392 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232213 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232216 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232218 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232221 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232224 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232226 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232229 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232232 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232234 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232237 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232240 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232245 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232249 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232252 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232255 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232257 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232260 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232262 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232265 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:02:22.234896 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232267 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232656 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232663 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232665 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232668 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232672 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232675 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232688 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232691 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232694 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232697 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232700 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232703 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232705 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232707 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232710 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232713 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232716 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232719 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:02:22.235354 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232721 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232724 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232727 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232730 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232733 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232735 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232738 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232741 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232743 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232746 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232748 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232751 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232753 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232756 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232759 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232761 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232764 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232766 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232769 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232772 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:02:22.235826 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232776 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232779 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232781 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232785 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232787 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232790 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232793 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232796 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232798 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232801 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232804 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232806 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232809 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232811 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232814 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232817 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232819 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232823 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232827 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232830 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:02:22.236312 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232833 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232835 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232838 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232840 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232843 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232846 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232850 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232853 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232855 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232858 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232861 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232863 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232867 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232870 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232873 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232875 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232880 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232884 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232887 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232890 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:02:22.236868 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232893 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232896 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232898 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232901 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232904 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232907 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232910 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232913 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232915 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232918 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232921 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232923 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232926 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232928 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232931 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232934 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232936 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232939 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232942 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:02:22.237370 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232945 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.232947 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233019 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233026 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233031 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233037 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233041 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233044 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233048 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233067 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233073 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233076 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233080 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233084 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233087 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233090 2577 flags.go:64] FLAG: --cgroup-root="" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233093 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233097 2577 flags.go:64] FLAG: --client-ca-file="" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233100 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233103 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233107 2577 flags.go:64] FLAG: --cluster-domain="" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233110 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233113 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233116 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 15:02:22.237865 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233120 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233123 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233126 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233130 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233133 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233136 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233139 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233142 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233145 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233148 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233152 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233155 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233158 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233163 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233166 2577 flags.go:64] FLAG: --enable-server="true" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233169 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233172 2577 flags.go:64] FLAG: --event-burst="100" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233176 2577 flags.go:64] FLAG: --event-qps="50" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233179 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233182 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233185 2577 flags.go:64] FLAG: --eviction-hard="" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233189 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233192 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233195 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233198 2577 flags.go:64] FLAG: --eviction-soft="" Jun 09 15:02:22.238451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233201 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233204 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233207 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233210 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233213 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233216 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233219 2577 flags.go:64] FLAG: --feature-gates="" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233223 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233226 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233229 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233232 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233235 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233238 2577 flags.go:64] FLAG: --help="false" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233241 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233244 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233247 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233250 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233253 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233256 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233259 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233263 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233266 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233270 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 15:02:22.239074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233273 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233276 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233278 2577 flags.go:64] FLAG: --kube-reserved="" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233281 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233285 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233288 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233291 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233294 2577 flags.go:64] FLAG: --lock-file="" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233297 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233300 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233303 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233309 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233312 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233314 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233317 2577 flags.go:64] FLAG: --logging-format="text" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233320 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233324 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233326 2577 flags.go:64] FLAG: --manifest-url="" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233329 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233333 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233336 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233340 2577 flags.go:64] FLAG: --max-pods="110" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233343 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233346 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233349 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 15:02:22.239699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233352 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233355 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233358 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233361 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233370 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233373 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233376 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233379 2577 flags.go:64] FLAG: --pod-cidr="" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233382 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233387 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233390 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233393 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233396 2577 flags.go:64] FLAG: --port="10250" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233400 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233403 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e10c13c6660da18c" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233406 2577 flags.go:64] FLAG: --qos-reserved="" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233409 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233412 2577 flags.go:64] FLAG: --register-node="true" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233415 2577 flags.go:64] FLAG: --register-with-taints="" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233418 2577 flags.go:64] FLAG: --registry-burst="10" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233421 2577 flags.go:64] FLAG: --registry-qps="5" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233424 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233427 2577 flags.go:64] FLAG: --reserved-memory="" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233435 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233438 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 15:02:22.240321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233441 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233444 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233446 2577 flags.go:64] FLAG: --runonce="false" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233449 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233452 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233460 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233463 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233466 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233469 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233472 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233475 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233478 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233482 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233485 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233487 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233491 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233493 2577 flags.go:64] FLAG: --system-cgroups="" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233496 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233502 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233505 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233509 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233513 2577 flags.go:64] FLAG: --tls-min-version="" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233516 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233519 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233522 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 15:02:22.240951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233525 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233528 2577 flags.go:64] FLAG: --v="2" Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233532 2577 flags.go:64] FLAG: --version="false" Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233536 2577 flags.go:64] FLAG: --vmodule="" Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233540 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233543 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233667 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233671 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233674 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233677 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233679 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233682 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233686 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233689 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233691 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233694 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233697 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233699 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233702 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233706 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233708 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:02:22.241560 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233711 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233713 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233716 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233719 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233721 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233725 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233728 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233731 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233734 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233736 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233739 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233742 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233744 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233747 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233749 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233752 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233755 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233758 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233760 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233763 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:02:22.242176 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233765 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233768 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233771 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233774 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233777 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233780 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233782 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233785 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233788 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233790 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233794 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233797 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233799 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233802 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233805 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233808 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233810 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233813 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233815 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233818 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:02:22.242706 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233821 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233824 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233827 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233829 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233832 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233835 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233837 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233840 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233842 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233845 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233847 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233850 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233853 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233855 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233858 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233862 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233865 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233868 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233871 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233873 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:02:22.243197 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233876 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233880 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233884 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233888 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233891 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233895 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233898 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233901 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233904 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233907 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233910 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233913 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233915 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233918 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233921 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233923 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233926 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233929 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233931 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:02:22.243857 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233934 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233936 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233939 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233942 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.233944 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.233950 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.240358 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.240373 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.241144 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.241157 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241213 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241218 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241222 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241225 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:02:22.244620 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241228 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241231 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241234 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241237 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241240 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241243 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241246 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241251 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241255 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241258 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241261 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241264 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241267 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241270 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241273 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241275 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241278 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241281 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241283 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:02:22.245024 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241286 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241288 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241291 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241294 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241296 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241299 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241306 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241309 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241312 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241315 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241317 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241320 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241323 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241325 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241328 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241331 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241333 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241336 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241339 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241341 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:02:22.245495 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241344 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241347 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241349 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241352 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241355 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241357 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241360 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241362 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241365 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241367 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241370 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241373 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241375 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241378 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241381 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241384 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241386 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241391 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241395 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241398 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:02:22.246000 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241401 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241404 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241407 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241410 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241412 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241415 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241417 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241420 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241423 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241426 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241428 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241431 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241434 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241436 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241439 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241442 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241444 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241447 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241450 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241453 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:02:22.246483 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241455 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241458 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241461 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241463 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241466 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241470 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241473 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241476 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241479 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241482 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241485 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241488 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241491 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241493 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241496 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:02:22.247078 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241498 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.241503 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241628 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241635 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241640 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241643 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241646 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241649 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241652 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241655 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241658 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241661 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241663 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241666 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241669 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:02:22.247444 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241672 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241674 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241677 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241679 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241682 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241684 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241687 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241689 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241692 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241694 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241697 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241701 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241704 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241708 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241711 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241714 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241718 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241720 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241723 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:02:22.247827 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241726 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241728 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241731 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241733 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241737 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241740 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241744 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241748 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241752 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241756 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241760 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241762 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241765 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241767 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241770 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241773 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241775 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241778 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241781 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241784 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:02:22.248286 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241786 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241789 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241792 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241795 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241797 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241801 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241803 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241806 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241809 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241813 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241816 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241819 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241823 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241827 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241831 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241835 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241838 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241840 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241843 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241846 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:02:22.248789 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241848 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241851 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241854 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241856 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241859 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241862 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241864 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241867 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241870 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241872 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241875 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241878 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241880 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241883 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241886 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241888 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241891 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241894 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241896 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241900 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:02:22.249266 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241904 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:02:22.249793 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241908 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:02:22.249793 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241913 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:02:22.249793 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241916 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:02:22.249793 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241918 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:02:22.249793 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241921 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:02:22.249793 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:22.241924 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:02:22.249793 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.241929 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:02:22.249793 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.242036 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 15:02:22.249793 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.244977 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 15:02:22.249793 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.246316 2577 server.go:1019] "Starting client certificate rotation" Jun 09 15:02:22.249793 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.246410 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:02:22.249793 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.246439 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:02:22.250087 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.249960 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:02:22.254786 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.254767 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:02:22.264439 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.264423 2577 log.go:25] "Validated CRI v1 runtime API" Jun 09 15:02:22.266756 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.266741 2577 log.go:25] "Validated CRI v1 image API" Jun 09 15:02:22.267878 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.267861 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 15:02:22.270431 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.270412 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 968fc031-3e8b-4622-a691-3ac2255b2387:/dev/nvme0n1p3 a096d1fe-3b8e-4ff1-8577-139cc78e4fcf:/dev/nvme0n1p4] Jun 09 15:02:22.270491 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.270429 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 15:02:22.276280 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.276263 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:02:22.277258 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.277153 2577 manager.go:216] Machine: {Timestamp:2026-06-09 15:02:22.274527086 +0000 UTC m=+0.339101528 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097153 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec212fec155b27dbc63dd7ce3c7dafaf SystemUUID:ec212fec-155b-27db-c63d-d7ce3c7dafaf BootID:87d65ad7-b3a3-47e0-a8e0-1f9187d30c1b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2b:c1:8e:2f:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2b:c1:8e:2f:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:56:a2:b6:c4:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 15:02:22.277258 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.277257 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 15:02:22.277360 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.277335 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 15:02:22.280290 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.280269 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 15:02:22.280448 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.280293 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-236.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 15:02:22.281098 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.281088 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 15:02:22.281136 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.281101 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 15:02:22.281136 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.281108 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:02:22.281550 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.281541 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:02:22.282435 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.282425 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 15:02:22.285789 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.285778 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:02:22.285895 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.285886 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 15:02:22.285924 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.285915 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 09 15:02:22.286513 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.286501 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 15:02:22.286562 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.286516 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 15:02:22.286562 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.286526 2577 kubelet.go:398] "Adding apiserver pod source" Jun 09 15:02:22.286562 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.286536 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 15:02:22.286870 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.286859 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:02:22.286909 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.286877 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:02:22.288731 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.288717 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 15:02:22.291225 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.291195 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 15:02:22.291304 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.291245 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 15:02:22.292752 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292736 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 15:02:22.292793 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292761 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 15:02:22.292793 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292772 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 15:02:22.292793 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292780 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 15:02:22.292793 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292793 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 15:02:22.292897 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292801 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 15:02:22.292897 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292814 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 15:02:22.292897 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292822 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 15:02:22.292897 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292831 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 15:02:22.292897 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292840 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 15:02:22.292897 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292862 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 15:02:22.292897 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292870 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 15:02:22.293088 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292900 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 15:02:22.293088 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.292908 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 15:02:22.295904 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.295874 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 15:02:22.295904 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.295888 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-236.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 15:02:22.296006 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.295958 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 15:02:22.296708 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.296695 2577 server.go:1268] "Started kubelet" Jun 09 15:02:22.296785 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.296764 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 15:02:22.297327 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.297274 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 15:02:22.297441 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.297352 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 15:02:22.297952 ip-10-0-131-236 systemd[1]: Started Kubernetes Kubelet. Jun 09 15:02:22.298395 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.298126 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 09 15:02:22.298954 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.298873 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5bt2t" Jun 09 15:02:22.301424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.301407 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 15:02:22.303861 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.303827 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 15:02:22.304958 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.304011 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-236.ec2.internal.18b771d62a6717da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-236.ec2.internal,UID:ip-10-0-131-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-236.ec2.internal,},FirstTimestamp:2026-06-09 15:02:22.29665993 +0000 UTC m=+0.361234374,LastTimestamp:2026-06-09 15:02:22.29665993 +0000 UTC m=+0.361234374,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-236.ec2.internal,}" Jun 09 15:02:22.306974 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.306959 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 15:02:22.307044 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.307005 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 15:02:22.307099 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.307062 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5bt2t" Jun 09 15:02:22.307214 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.307093 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:22.307601 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.307583 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 15:02:22.307601 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.307593 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 15:02:22.307755 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.307625 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 15:02:22.307812 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.307766 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 09 15:02:22.307812 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.307775 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 09 15:02:22.307902 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.307889 2577 factory.go:55] Registering systemd factory Jun 09 15:02:22.307950 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.307903 2577 factory.go:223] Registration of the systemd container factory successfully Jun 09 15:02:22.308138 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.308118 2577 factory.go:153] Registering CRI-O factory Jun 09 15:02:22.308228 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.308141 2577 factory.go:223] Registration of the crio container factory successfully Jun 09 15:02:22.308228 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.308194 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 15:02:22.308228 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.308220 2577 factory.go:103] Registering Raw factory Jun 09 15:02:22.308357 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.308236 2577 manager.go:1196] Started watching for new ooms in manager Jun 09 15:02:22.308930 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.308915 2577 manager.go:349] Starting recovery of all containers Jun 09 15:02:22.308996 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.308957 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 15:02:22.309088 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.309065 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 15:02:22.319254 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.319106 2577 manager.go:354] Recovery completed Jun 09 15:02:22.323287 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.323275 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:02:22.325106 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.325091 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:02:22.325166 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.325117 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:02:22.325166 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.325127 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:02:22.325615 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.325587 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 15:02:22.325615 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.325598 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:02:22.325721 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.325599 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 15:02:22.325721 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.325656 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:02:22.326245 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.326233 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:02:22.326292 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.326255 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:02:22.326292 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.326264 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:02:22.326961 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.326951 2577 policy_none.go:49] "None policy: Start" Jun 09 15:02:22.327000 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.326965 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 15:02:22.327000 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.326975 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 15:02:22.328043 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.328028 2577 policy_none.go:47] "Start" Jun 09 15:02:22.363225 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.363209 2577 manager.go:337] "Starting Device Plugin manager" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.363243 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.363256 2577 server.go:87] "Starting device plugin registration server" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.363514 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.363526 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.363629 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.363715 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.363725 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.364275 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.364341 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.370744 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.371859 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.371888 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.371907 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.371935 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 15:02:22.377418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.373937 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:02:22.464670 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.464644 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:02:22.465577 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.465560 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:02:22.465688 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.465589 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:02:22.465688 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.465599 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:02:22.465688 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.465640 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.472831 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.472816 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-236.ec2.internal"] Jun 09 15:02:22.472879 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.472870 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:02:22.473577 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.473553 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.473577 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.473565 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:02:22.473678 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.473577 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-236.ec2.internal\": node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:22.473678 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.473596 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:02:22.473678 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.473626 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:02:22.475001 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.474965 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:02:22.475078 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.475066 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.475112 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.475094 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:02:22.475638 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.475625 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:02:22.475710 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.475651 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:02:22.475710 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.475661 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:02:22.477374 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.477357 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:02:22.477461 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.477390 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:02:22.477461 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.477404 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:02:22.478780 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.478766 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.478841 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.478795 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:02:22.479394 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.479380 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:02:22.479449 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.479408 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:02:22.479449 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.479422 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:02:22.486967 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.486954 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:22.505291 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.505272 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-236.ec2.internal\" not found" node="ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.509479 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.509460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e58228f14a34ee3d1c345836d695c0b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal\" (UID: \"e58228f14a34ee3d1c345836d695c0b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.509558 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.509483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e58228f14a34ee3d1c345836d695c0b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal\" (UID: \"e58228f14a34ee3d1c345836d695c0b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.509558 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.509499 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/654ff8c271d406a1aee9355158204960-config\") pod \"kube-apiserver-proxy-ip-10-0-131-236.ec2.internal\" (UID: \"654ff8c271d406a1aee9355158204960\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.509558 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.509519 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-236.ec2.internal\" not found" node="ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.587983 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.587959 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:22.610352 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.610330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e58228f14a34ee3d1c345836d695c0b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal\" (UID: \"e58228f14a34ee3d1c345836d695c0b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.610434 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.610363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e58228f14a34ee3d1c345836d695c0b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal\" (UID: \"e58228f14a34ee3d1c345836d695c0b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.610434 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.610379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/654ff8c271d406a1aee9355158204960-config\") pod \"kube-apiserver-proxy-ip-10-0-131-236.ec2.internal\" (UID: \"654ff8c271d406a1aee9355158204960\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.610434 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.610405 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/654ff8c271d406a1aee9355158204960-config\") pod \"kube-apiserver-proxy-ip-10-0-131-236.ec2.internal\" (UID: \"654ff8c271d406a1aee9355158204960\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.610524 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.610425 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e58228f14a34ee3d1c345836d695c0b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal\" (UID: \"e58228f14a34ee3d1c345836d695c0b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.610524 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.610426 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e58228f14a34ee3d1c345836d695c0b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal\" (UID: \"e58228f14a34ee3d1c345836d695c0b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.688269 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.688237 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:22.789073 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.789003 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:22.810328 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.810302 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.814404 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:22.814387 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-236.ec2.internal" Jun 09 15:02:22.889460 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.889428 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:22.990008 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:22.989984 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:23.090505 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:23.090438 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:23.191115 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:23.191089 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:23.245618 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.245578 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 15:02:23.246155 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.245762 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:02:23.292108 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:23.292086 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:23.300787 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:23.300761 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode58228f14a34ee3d1c345836d695c0b7.slice/crio-4bd64b3422842c245c5ea2e0c8af8cd1c4477d5cbee1e6d80abef61cea8ab18a WatchSource:0}: Error finding container 4bd64b3422842c245c5ea2e0c8af8cd1c4477d5cbee1e6d80abef61cea8ab18a: Status 404 returned error can't find the container with id 4bd64b3422842c245c5ea2e0c8af8cd1c4477d5cbee1e6d80abef61cea8ab18a Jun 09 15:02:23.301199 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:23.301180 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654ff8c271d406a1aee9355158204960.slice/crio-6211bba51b2e2b5926a5ffdbcb0db00508f11b5c0136cf9f227bad83dfe506d4 WatchSource:0}: Error finding container 6211bba51b2e2b5926a5ffdbcb0db00508f11b5c0136cf9f227bad83dfe506d4: Status 404 returned error can't find the container with id 6211bba51b2e2b5926a5ffdbcb0db00508f11b5c0136cf9f227bad83dfe506d4 Jun 09 15:02:23.306494 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.306481 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:02:23.313923 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.313896 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 14:57:22 +0000 UTC" deadline="2027-12-29 15:54:38.970145075 +0000 UTC" Jun 09 15:02:23.313923 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.313922 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13632h52m15.656226428s" Jun 09 15:02:23.376105 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.376023 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-236.ec2.internal" event={"ID":"654ff8c271d406a1aee9355158204960","Type":"ContainerStarted","Data":"6211bba51b2e2b5926a5ffdbcb0db00508f11b5c0136cf9f227bad83dfe506d4"} Jun 09 15:02:23.379040 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.379016 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal" event={"ID":"e58228f14a34ee3d1c345836d695c0b7","Type":"ContainerStarted","Data":"4bd64b3422842c245c5ea2e0c8af8cd1c4477d5cbee1e6d80abef61cea8ab18a"} Jun 09 15:02:23.393164 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:23.393145 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:23.435598 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.435576 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:02:23.494273 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:23.494251 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:23.594776 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:23.594751 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:23.695238 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:23.695210 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-236.ec2.internal\" not found" Jun 09 15:02:23.786176 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.786146 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:02:23.808112 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.808078 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal" Jun 09 15:02:23.818674 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.818647 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:02:23.819741 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.819717 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-236.ec2.internal" Jun 09 15:02:23.828017 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.827996 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:02:23.891511 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:23.891331 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:02:24.075150 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.075126 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:02:24.287111 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.287042 2577 apiserver.go:52] "Watching apiserver" Jun 09 15:02:24.293448 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.293426 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 15:02:24.293811 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.293788 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-fk26t","openshift-network-operator/iptables-alerter-954rd","openshift-ovn-kubernetes/ovnkube-node-ljbzl","kube-system/global-pull-secret-syncer-wzf42","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7","openshift-cluster-node-tuning-operator/tuned-gx72b","openshift-dns/node-resolver-7279q","openshift-image-registry/node-ca-6tsz7","openshift-multus/multus-additional-cni-plugins-gttwt","openshift-multus/multus-wb4sw","openshift-multus/network-metrics-daemon-ngkbp","kube-system/konnectivity-agent-r9vbh","kube-system/kube-apiserver-proxy-ip-10-0-131-236.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal"] Jun 09 15:02:24.295321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.295098 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:24.295321 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:24.295162 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:24.296159 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.296141 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-954rd" Jun 09 15:02:24.297516 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.297495 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.298358 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.298339 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 15:02:24.298454 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.298431 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 15:02:24.298515 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.298341 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:02:24.298696 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.298670 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qfl6k\"" Jun 09 15:02:24.298938 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.298832 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:24.298938 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:24.298902 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:24.299946 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.299797 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jbl88\"" Jun 09 15:02:24.299946 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.299839 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 15:02:24.299946 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.299855 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 15:02:24.300149 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.300095 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 15:02:24.300149 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.300105 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 15:02:24.300149 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.300124 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 15:02:24.300361 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.300345 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.300488 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.300348 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 15:02:24.301694 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.301676 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.302465 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.302443 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xffjm\"" Jun 09 15:02:24.302775 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.302732 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 15:02:24.302858 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.302826 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 15:02:24.302935 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.302919 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 15:02:24.304246 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.303589 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:02:24.304246 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.303864 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qx6r4\"" Jun 09 15:02:24.304246 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.303898 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7279q" Jun 09 15:02:24.304535 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.304514 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 15:02:24.305787 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.305712 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6tsz7" Jun 09 15:02:24.306357 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.306287 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 15:02:24.306739 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.306707 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-59bjj\"" Jun 09 15:02:24.306739 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.306707 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 15:02:24.307211 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.307195 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 15:02:24.307700 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.307675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.308075 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.307914 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 15:02:24.308436 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.308239 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 15:02:24.308436 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.308283 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 15:02:24.308436 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.308242 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bc5bb\"" Jun 09 15:02:24.309218 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.309202 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.309486 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.309449 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 15:02:24.309691 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.309674 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 15:02:24.309826 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.309799 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 15:02:24.309826 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.309803 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 15:02:24.309938 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.309925 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 15:02:24.310723 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.310684 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:24.310814 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:24.310753 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:24.311354 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.311102 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 15:02:24.311354 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.311149 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6mmhk\"" Jun 09 15:02:24.311354 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.311181 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hr7dm\"" Jun 09 15:02:24.312366 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.312346 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r9vbh" Jun 09 15:02:24.314144 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.314126 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 15:02:24.314278 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.314266 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 15:02:24.314352 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.314317 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tlbwg\"" Jun 09 15:02:24.315596 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.315579 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:02:24.319032 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81384d9b-95db-4f91-8330-4a7c5539f852-tmp\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.319113 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319047 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-node-log\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.319113 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7fe3e493-a090-4fc2-aef0-f02d3b791af8-multus-daemon-config\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.319113 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-etc-kubernetes\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.319247 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319123 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d0ecc9aa-f7a5-45b9-a149-46935344e89d-dbus\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:24.319247 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-registration-dir\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.319247 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fe3e493-a090-4fc2-aef0-f02d3b791af8-cni-binary-copy\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.319247 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-var-lib-kubelet\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.319438 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319248 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4rxb\" (UniqueName: \"kubernetes.io/projected/81384d9b-95db-4f91-8330-4a7c5539f852-kube-api-access-m4rxb\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.319438 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-run-openvswitch\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.319438 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319305 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-cni-netd\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.319438 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319329 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:24.319438 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319359 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-sysctl-d\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.319438 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-env-overrides\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.319438 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-device-dir\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.319438 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-run-systemd\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.319803 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-ovn-node-metrics-cert\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.319803 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d2fb819-c531-4e5c-90ba-69875d3e02fc-serviceca\") pod \"node-ca-6tsz7\" (UID: \"6d2fb819-c531-4e5c-90ba-69875d3e02fc\") " pod="openshift-image-registry/node-ca-6tsz7" Jun 09 15:02:24.319803 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-os-release\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.319803 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-run-netns\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.319803 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d0ecc9aa-f7a5-45b9-a149-46935344e89d-kubelet-config\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:24.319803 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdph6\" (UniqueName: \"kubernetes.io/projected/a0df8355-5708-4a2c-9ea3-1ca21d883758-kube-api-access-sdph6\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.319803 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-kubelet\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.320123 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-systemd-units\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.320123 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-cnibin\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.320123 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319912 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmbkk\" (UniqueName: \"kubernetes.io/projected/3e2b3935-080c-42d7-9c11-02c58bd8d6ec-kube-api-access-kmbkk\") pod \"node-resolver-7279q\" (UID: \"3e2b3935-080c-42d7-9c11-02c58bd8d6ec\") " pod="openshift-dns/node-resolver-7279q" Jun 09 15:02:24.320123 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.319940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-system-cni-dir\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.320123 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6112faf-ad05-4058-9ce5-bfc4565ade50-host-slash\") pod \"iptables-alerter-954rd\" (UID: \"c6112faf-ad05-4058-9ce5-bfc4565ade50\") " pod="openshift-network-operator/iptables-alerter-954rd" Jun 09 15:02:24.320123 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320035 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-etc-selinux\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.320123 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-sysctl-conf\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.320123 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320106 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-run-multus-certs\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.320572 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.320572 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/133e775b-f85e-4940-a6d1-5d3989eebe0a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.320572 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-log-socket\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.320572 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d2fb819-c531-4e5c-90ba-69875d3e02fc-host\") pod \"node-ca-6tsz7\" (UID: \"6d2fb819-c531-4e5c-90ba-69875d3e02fc\") " pod="openshift-image-registry/node-ca-6tsz7" Jun 09 15:02:24.320572 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-685vw\" (UniqueName: \"kubernetes.io/projected/6d2fb819-c531-4e5c-90ba-69875d3e02fc-kube-api-access-685vw\") pod \"node-ca-6tsz7\" (UID: \"6d2fb819-c531-4e5c-90ba-69875d3e02fc\") " pod="openshift-image-registry/node-ca-6tsz7" Jun 09 15:02:24.320572 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320270 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-sys\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.320572 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-etc-openvswitch\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.320572 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-var-lib-cni-multus\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.320572 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320337 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-ovnkube-config\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.320572 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320359 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/133e775b-f85e-4940-a6d1-5d3989eebe0a-cni-binary-copy\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.320572 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh5fd\" (UniqueName: \"kubernetes.io/projected/133e775b-f85e-4940-a6d1-5d3989eebe0a-kube-api-access-qh5fd\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320578 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-sysconfig\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/133e775b-f85e-4940-a6d1-5d3989eebe0a-cnibin\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-multus-socket-dir-parent\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlpbp\" (UniqueName: \"kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp\") pod \"network-check-target-fk26t\" (UID: \"c520ba04-dcbe-447d-84d8-bc812c5e6569\") " pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-sys-fs\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-systemd\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e2b3935-080c-42d7-9c11-02c58bd8d6ec-hosts-file\") pod \"node-resolver-7279q\" (UID: \"3e2b3935-080c-42d7-9c11-02c58bd8d6ec\") " pod="openshift-dns/node-resolver-7279q" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/133e775b-f85e-4940-a6d1-5d3989eebe0a-os-release\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/133e775b-f85e-4940-a6d1-5d3989eebe0a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320843 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-var-lib-openvswitch\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-var-lib-cni-bin\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-var-lib-kubelet\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-lib-modules\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.320991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81384d9b-95db-4f91-8330-4a7c5539f852-etc-tuned\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.321062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321016 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/133e775b-f85e-4940-a6d1-5d3989eebe0a-system-cni-dir\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-run-ovn\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e2b3935-080c-42d7-9c11-02c58bd8d6ec-tmp-dir\") pod \"node-resolver-7279q\" (UID: \"3e2b3935-080c-42d7-9c11-02c58bd8d6ec\") " pod="openshift-dns/node-resolver-7279q" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-slash\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-ovnkube-script-lib\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321181 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c6112faf-ad05-4058-9ce5-bfc4565ade50-iptables-alerter-script\") pod \"iptables-alerter-954rd\" (UID: \"c6112faf-ad05-4058-9ce5-bfc4565ade50\") " pod="openshift-network-operator/iptables-alerter-954rd" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321206 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-run\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321227 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-host\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321261 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-run-netns\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321283 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-cni-bin\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-kubernetes\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9v7j\" (UniqueName: \"kubernetes.io/projected/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-kube-api-access-d9v7j\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-hostroot\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-multus-conf-dir\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321555 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqmm8\" (UniqueName: \"kubernetes.io/projected/c6112faf-ad05-4058-9ce5-bfc4565ade50-kube-api-access-jqmm8\") pod \"iptables-alerter-954rd\" (UID: \"c6112faf-ad05-4058-9ce5-bfc4565ade50\") " pod="openshift-network-operator/iptables-alerter-954rd" Jun 09 15:02:24.321734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321590 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-modprobe-d\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.322353 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321636 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/133e775b-f85e-4940-a6d1-5d3989eebe0a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.322353 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-multus-cni-dir\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.322353 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-run-k8s-cni-cncf-io\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.322353 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm2qb\" (UniqueName: \"kubernetes.io/projected/7fe3e493-a090-4fc2-aef0-f02d3b791af8-kube-api-access-zm2qb\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.322353 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.321755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-socket-dir\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.335644 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.335617 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dzzgq" Jun 09 15:02:24.342976 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.342959 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dzzgq" Jun 09 15:02:24.408384 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.408354 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 15:02:24.421997 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.421963 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-env-overrides\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.421997 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-device-dir\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.422229 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422016 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-run-systemd\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.422229 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-ovn-node-metrics-cert\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.422229 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d2fb819-c531-4e5c-90ba-69875d3e02fc-serviceca\") pod \"node-ca-6tsz7\" (UID: \"6d2fb819-c531-4e5c-90ba-69875d3e02fc\") " pod="openshift-image-registry/node-ca-6tsz7" Jun 09 15:02:24.422229 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-os-release\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.422229 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-run-netns\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.422229 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422147 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-run-netns\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.422229 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422151 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-run-systemd\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.422229 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-os-release\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.422229 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422229 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-device-dir\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d0ecc9aa-f7a5-45b9-a149-46935344e89d-kubelet-config\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdph6\" (UniqueName: \"kubernetes.io/projected/a0df8355-5708-4a2c-9ea3-1ca21d883758-kube-api-access-sdph6\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-kubelet\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-systemd-units\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-cnibin\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422371 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d0ecc9aa-f7a5-45b9-a149-46935344e89d-kubelet-config\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422385 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmbkk\" (UniqueName: \"kubernetes.io/projected/3e2b3935-080c-42d7-9c11-02c58bd8d6ec-kube-api-access-kmbkk\") pod \"node-resolver-7279q\" (UID: \"3e2b3935-080c-42d7-9c11-02c58bd8d6ec\") " pod="openshift-dns/node-resolver-7279q" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422415 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-kubelet\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-system-cni-dir\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6112faf-ad05-4058-9ce5-bfc4565ade50-host-slash\") pod \"iptables-alerter-954rd\" (UID: \"c6112faf-ad05-4058-9ce5-bfc4565ade50\") " pod="openshift-network-operator/iptables-alerter-954rd" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-system-cni-dir\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-etc-selinux\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422510 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-systemd-units\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422516 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/010af952-07a7-423e-b0dc-b2318dac9bdb-konnectivity-ca\") pod \"konnectivity-agent-r9vbh\" (UID: \"010af952-07a7-423e-b0dc-b2318dac9bdb\") " pod="kube-system/konnectivity-agent-r9vbh" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422562 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6d2fb819-c531-4e5c-90ba-69875d3e02fc-serviceca\") pod \"node-ca-6tsz7\" (UID: \"6d2fb819-c531-4e5c-90ba-69875d3e02fc\") " pod="openshift-image-registry/node-ca-6tsz7" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-env-overrides\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.422668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422663 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-sysctl-conf\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422684 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-cnibin\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422697 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-run-multus-certs\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422739 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-run-multus-certs\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422742 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/133e775b-f85e-4940-a6d1-5d3989eebe0a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-log-socket\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422813 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-etc-selinux\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422824 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d2fb819-c531-4e5c-90ba-69875d3e02fc-host\") pod \"node-ca-6tsz7\" (UID: \"6d2fb819-c531-4e5c-90ba-69875d3e02fc\") " pod="openshift-image-registry/node-ca-6tsz7" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422855 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d2fb819-c531-4e5c-90ba-69875d3e02fc-host\") pod \"node-ca-6tsz7\" (UID: \"6d2fb819-c531-4e5c-90ba-69875d3e02fc\") " pod="openshift-image-registry/node-ca-6tsz7" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422855 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-sysctl-conf\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422866 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6112faf-ad05-4058-9ce5-bfc4565ade50-host-slash\") pod \"iptables-alerter-954rd\" (UID: \"c6112faf-ad05-4058-9ce5-bfc4565ade50\") " pod="openshift-network-operator/iptables-alerter-954rd" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-685vw\" (UniqueName: \"kubernetes.io/projected/6d2fb819-c531-4e5c-90ba-69875d3e02fc-kube-api-access-685vw\") pod \"node-ca-6tsz7\" (UID: \"6d2fb819-c531-4e5c-90ba-69875d3e02fc\") " pod="openshift-image-registry/node-ca-6tsz7" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-sys\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422965 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-sys\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-log-socket\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.422999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-etc-openvswitch\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.423599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-var-lib-cni-multus\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423063 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-etc-openvswitch\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-ovnkube-config\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/133e775b-f85e-4940-a6d1-5d3989eebe0a-cni-binary-copy\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5fd\" (UniqueName: \"kubernetes.io/projected/133e775b-f85e-4940-a6d1-5d3989eebe0a-kube-api-access-qh5fd\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-var-lib-cni-multus\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-sysconfig\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423201 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-sysconfig\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/133e775b-f85e-4940-a6d1-5d3989eebe0a-cnibin\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-multus-socket-dir-parent\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlpbp\" (UniqueName: \"kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp\") pod \"network-check-target-fk26t\" (UID: \"c520ba04-dcbe-447d-84d8-bc812c5e6569\") " pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-sys-fs\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-systemd\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423403 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/133e775b-f85e-4940-a6d1-5d3989eebe0a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e2b3935-080c-42d7-9c11-02c58bd8d6ec-hosts-file\") pod \"node-resolver-7279q\" (UID: \"3e2b3935-080c-42d7-9c11-02c58bd8d6ec\") " pod="openshift-dns/node-resolver-7279q" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/133e775b-f85e-4940-a6d1-5d3989eebe0a-os-release\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423463 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-systemd\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.424620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423465 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/133e775b-f85e-4940-a6d1-5d3989eebe0a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423497 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e2b3935-080c-42d7-9c11-02c58bd8d6ec-hosts-file\") pod \"node-resolver-7279q\" (UID: \"3e2b3935-080c-42d7-9c11-02c58bd8d6ec\") " pod="openshift-dns/node-resolver-7279q" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-var-lib-openvswitch\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423523 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/133e775b-f85e-4940-a6d1-5d3989eebe0a-os-release\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423439 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/133e775b-f85e-4940-a6d1-5d3989eebe0a-cnibin\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423546 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-var-lib-openvswitch\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423560 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-multus-socket-dir-parent\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423590 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-ovnkube-config\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-var-lib-cni-bin\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423623 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-sys-fs\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423651 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-var-lib-kubelet\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423661 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/133e775b-f85e-4940-a6d1-5d3989eebe0a-cni-binary-copy\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423663 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-var-lib-cni-bin\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423665 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-lib-modules\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-var-lib-kubelet\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.425534 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81384d9b-95db-4f91-8330-4a7c5539f852-etc-tuned\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/133e775b-f85e-4940-a6d1-5d3989eebe0a-system-cni-dir\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-run-ovn\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423791 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-lib-modules\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e2b3935-080c-42d7-9c11-02c58bd8d6ec-tmp-dir\") pod \"node-resolver-7279q\" (UID: \"3e2b3935-080c-42d7-9c11-02c58bd8d6ec\") " pod="openshift-dns/node-resolver-7279q" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423809 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/133e775b-f85e-4940-a6d1-5d3989eebe0a-system-cni-dir\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-slash\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423840 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-run-ovn\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-ovnkube-script-lib\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423879 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c6112faf-ad05-4058-9ce5-bfc4565ade50-iptables-alerter-script\") pod \"iptables-alerter-954rd\" (UID: \"c6112faf-ad05-4058-9ce5-bfc4565ade50\") " pod="openshift-network-operator/iptables-alerter-954rd" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-slash\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-run\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-host\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-run-netns\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423972 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423995 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-cni-bin\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.423995 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/133e775b-f85e-4940-a6d1-5d3989eebe0a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.426188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424018 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-kubernetes\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9v7j\" (UniqueName: \"kubernetes.io/projected/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-kube-api-access-d9v7j\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424053 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-run-netns\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424066 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-hostroot\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424091 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-multus-conf-dir\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424094 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-run\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqmm8\" (UniqueName: \"kubernetes.io/projected/c6112faf-ad05-4058-9ce5-bfc4565ade50-kube-api-access-jqmm8\") pod \"iptables-alerter-954rd\" (UID: \"c6112faf-ad05-4058-9ce5-bfc4565ade50\") " pod="openshift-network-operator/iptables-alerter-954rd" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424136 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-host\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-modprobe-d\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424165 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/133e775b-f85e-4940-a6d1-5d3989eebe0a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424175 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-hostroot\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424187 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-multus-cni-dir\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424206 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-multus-conf-dir\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-run-k8s-cni-cncf-io\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424237 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-cni-bin\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm2qb\" (UniqueName: \"kubernetes.io/projected/7fe3e493-a090-4fc2-aef0-f02d3b791af8-kube-api-access-zm2qb\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-socket-dir\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424290 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:24.426806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81384d9b-95db-4f91-8330-4a7c5539f852-tmp\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424339 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-kubernetes\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424355 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-ovnkube-script-lib\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424120 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e2b3935-080c-42d7-9c11-02c58bd8d6ec-tmp-dir\") pod \"node-resolver-7279q\" (UID: \"3e2b3935-080c-42d7-9c11-02c58bd8d6ec\") " pod="openshift-dns/node-resolver-7279q" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c6112faf-ad05-4058-9ce5-bfc4565ade50-iptables-alerter-script\") pod \"iptables-alerter-954rd\" (UID: \"c6112faf-ad05-4058-9ce5-bfc4565ade50\") " pod="openshift-network-operator/iptables-alerter-954rd" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424385 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-node-log\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-socket-dir\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424505 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-node-log\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424542 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/133e775b-f85e-4940-a6d1-5d3989eebe0a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424547 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-multus-cni-dir\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7fe3e493-a090-4fc2-aef0-f02d3b791af8-multus-daemon-config\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424561 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-modprobe-d\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424586 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-host-run-k8s-cni-cncf-io\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-etc-kubernetes\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424714 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d0ecc9aa-f7a5-45b9-a149-46935344e89d-dbus\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424725 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fe3e493-a090-4fc2-aef0-f02d3b791af8-etc-kubernetes\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424740 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-registration-dir\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.427424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fe3e493-a090-4fc2-aef0-f02d3b791af8-cni-binary-copy\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424769 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d0ecc9aa-f7a5-45b9-a149-46935344e89d-dbus\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424780 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a0df8355-5708-4a2c-9ea3-1ca21d883758-registration-dir\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-var-lib-kubelet\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4rxb\" (UniqueName: \"kubernetes.io/projected/81384d9b-95db-4f91-8330-4a7c5539f852-kube-api-access-m4rxb\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-run-openvswitch\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-cni-netd\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lkm2\" (UniqueName: \"kubernetes.io/projected/554ab5a3-a06d-4031-849a-d0afc7d6de4a-kube-api-access-5lkm2\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.424994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/010af952-07a7-423e-b0dc-b2318dac9bdb-agent-certs\") pod \"konnectivity-agent-r9vbh\" (UID: \"010af952-07a7-423e-b0dc-b2318dac9bdb\") " pod="kube-system/konnectivity-agent-r9vbh" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.425037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-sysctl-d\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.425062 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-host-cni-netd\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.425098 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7fe3e493-a090-4fc2-aef0-f02d3b791af8-multus-daemon-config\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.425111 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-run-openvswitch\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.425185 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-etc-sysctl-d\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.425192 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81384d9b-95db-4f91-8330-4a7c5539f852-var-lib-kubelet\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:24.425204 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:24.428309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.425242 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fe3e493-a090-4fc2-aef0-f02d3b791af8-cni-binary-copy\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.429751 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:24.425307 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret podName:d0ecc9aa-f7a5-45b9-a149-46935344e89d nodeName:}" failed. No retries permitted until 2026-06-09 15:02:24.925279005 +0000 UTC m=+2.989853452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret") pod "global-pull-secret-syncer-wzf42" (UID: "d0ecc9aa-f7a5-45b9-a149-46935344e89d") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:24.429751 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.427041 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81384d9b-95db-4f91-8330-4a7c5539f852-tmp\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.429751 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.427113 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81384d9b-95db-4f91-8330-4a7c5539f852-etc-tuned\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.429751 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.427233 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-ovn-node-metrics-cert\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.429751 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:24.428832 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:02:24.429751 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:24.428857 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:02:24.429751 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:24.428872 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlpbp for pod openshift-network-diagnostics/network-check-target-fk26t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:24.429751 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:24.428937 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp podName:c520ba04-dcbe-447d-84d8-bc812c5e6569 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:24.928918863 +0000 UTC m=+2.993493297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vlpbp" (UniqueName: "kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp") pod "network-check-target-fk26t" (UID: "c520ba04-dcbe-447d-84d8-bc812c5e6569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:24.430675 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.430585 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-685vw\" (UniqueName: \"kubernetes.io/projected/6d2fb819-c531-4e5c-90ba-69875d3e02fc-kube-api-access-685vw\") pod \"node-ca-6tsz7\" (UID: \"6d2fb819-c531-4e5c-90ba-69875d3e02fc\") " pod="openshift-image-registry/node-ca-6tsz7" Jun 09 15:02:24.430766 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.430698 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmbkk\" (UniqueName: \"kubernetes.io/projected/3e2b3935-080c-42d7-9c11-02c58bd8d6ec-kube-api-access-kmbkk\") pod \"node-resolver-7279q\" (UID: \"3e2b3935-080c-42d7-9c11-02c58bd8d6ec\") " pod="openshift-dns/node-resolver-7279q" Jun 09 15:02:24.431531 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.431493 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdph6\" (UniqueName: \"kubernetes.io/projected/a0df8355-5708-4a2c-9ea3-1ca21d883758-kube-api-access-sdph6\") pod \"aws-ebs-csi-driver-node-v2gx7\" (UID: \"a0df8355-5708-4a2c-9ea3-1ca21d883758\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.431688 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.431670 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh5fd\" (UniqueName: \"kubernetes.io/projected/133e775b-f85e-4940-a6d1-5d3989eebe0a-kube-api-access-qh5fd\") pod \"multus-additional-cni-plugins-gttwt\" (UID: \"133e775b-f85e-4940-a6d1-5d3989eebe0a\") " pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.432347 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.432297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9v7j\" (UniqueName: \"kubernetes.io/projected/3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd-kube-api-access-d9v7j\") pod \"ovnkube-node-ljbzl\" (UID: \"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.432889 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.432872 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm2qb\" (UniqueName: \"kubernetes.io/projected/7fe3e493-a090-4fc2-aef0-f02d3b791af8-kube-api-access-zm2qb\") pod \"multus-wb4sw\" (UID: \"7fe3e493-a090-4fc2-aef0-f02d3b791af8\") " pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.432889 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.432875 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqmm8\" (UniqueName: \"kubernetes.io/projected/c6112faf-ad05-4058-9ce5-bfc4565ade50-kube-api-access-jqmm8\") pod \"iptables-alerter-954rd\" (UID: \"c6112faf-ad05-4058-9ce5-bfc4565ade50\") " pod="openshift-network-operator/iptables-alerter-954rd" Jun 09 15:02:24.436150 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.436129 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4rxb\" (UniqueName: \"kubernetes.io/projected/81384d9b-95db-4f91-8330-4a7c5539f852-kube-api-access-m4rxb\") pod \"tuned-gx72b\" (UID: \"81384d9b-95db-4f91-8330-4a7c5539f852\") " pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.525355 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.525315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:24.525528 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.525371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lkm2\" (UniqueName: \"kubernetes.io/projected/554ab5a3-a06d-4031-849a-d0afc7d6de4a-kube-api-access-5lkm2\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:24.525528 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:24.525468 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:24.525528 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.525493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/010af952-07a7-423e-b0dc-b2318dac9bdb-agent-certs\") pod \"konnectivity-agent-r9vbh\" (UID: \"010af952-07a7-423e-b0dc-b2318dac9bdb\") " pod="kube-system/konnectivity-agent-r9vbh" Jun 09 15:02:24.525724 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:24.525535 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs podName:554ab5a3-a06d-4031-849a-d0afc7d6de4a nodeName:}" failed. No retries permitted until 2026-06-09 15:02:25.025516394 +0000 UTC m=+3.090090827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs") pod "network-metrics-daemon-ngkbp" (UID: "554ab5a3-a06d-4031-849a-d0afc7d6de4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:24.525724 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.525572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/010af952-07a7-423e-b0dc-b2318dac9bdb-konnectivity-ca\") pod \"konnectivity-agent-r9vbh\" (UID: \"010af952-07a7-423e-b0dc-b2318dac9bdb\") " pod="kube-system/konnectivity-agent-r9vbh" Jun 09 15:02:24.526100 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.526078 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/010af952-07a7-423e-b0dc-b2318dac9bdb-konnectivity-ca\") pod \"konnectivity-agent-r9vbh\" (UID: \"010af952-07a7-423e-b0dc-b2318dac9bdb\") " pod="kube-system/konnectivity-agent-r9vbh" Jun 09 15:02:24.528025 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.528002 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/010af952-07a7-423e-b0dc-b2318dac9bdb-agent-certs\") pod \"konnectivity-agent-r9vbh\" (UID: \"010af952-07a7-423e-b0dc-b2318dac9bdb\") " pod="kube-system/konnectivity-agent-r9vbh" Jun 09 15:02:24.533257 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.533234 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lkm2\" (UniqueName: \"kubernetes.io/projected/554ab5a3-a06d-4031-849a-d0afc7d6de4a-kube-api-access-5lkm2\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:24.608256 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.608182 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-954rd" Jun 09 15:02:24.617057 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.617034 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:24.624690 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.624655 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" Jun 09 15:02:24.629500 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.629482 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gx72b" Jun 09 15:02:24.635906 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.635888 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7279q" Jun 09 15:02:24.642191 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.642040 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6tsz7" Jun 09 15:02:24.647401 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.647376 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gttwt" Jun 09 15:02:24.655324 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.655306 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wb4sw" Jun 09 15:02:24.659822 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.659808 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r9vbh" Jun 09 15:02:24.927681 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:24.927620 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:24.927809 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:24.927757 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:24.927847 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:24.927817 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret podName:d0ecc9aa-f7a5-45b9-a149-46935344e89d nodeName:}" failed. No retries permitted until 2026-06-09 15:02:25.927800955 +0000 UTC m=+3.992375387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret") pod "global-pull-secret-syncer-wzf42" (UID: "d0ecc9aa-f7a5-45b9-a149-46935344e89d") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:25.028500 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.028467 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:25.028663 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.028525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlpbp\" (UniqueName: \"kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp\") pod \"network-check-target-fk26t\" (UID: \"c520ba04-dcbe-447d-84d8-bc812c5e6569\") " pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:25.028663 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:25.028650 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:25.028767 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:25.028670 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:02:25.028767 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:25.028696 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:02:25.028767 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:25.028708 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlpbp for pod openshift-network-diagnostics/network-check-target-fk26t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:25.028767 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:25.028729 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs podName:554ab5a3-a06d-4031-849a-d0afc7d6de4a nodeName:}" failed. No retries permitted until 2026-06-09 15:02:26.028709566 +0000 UTC m=+4.093284001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs") pod "network-metrics-daemon-ngkbp" (UID: "554ab5a3-a06d-4031-849a-d0afc7d6de4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:25.028767 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:25.028749 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp podName:c520ba04-dcbe-447d-84d8-bc812c5e6569 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:26.028738439 +0000 UTC m=+4.093312868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vlpbp" (UniqueName: "kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp") pod "network-check-target-fk26t" (UID: "c520ba04-dcbe-447d-84d8-bc812c5e6569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:25.257876 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:25.257804 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d2fb819_c531_4e5c_90ba_69875d3e02fc.slice/crio-5a7a16ccc8267c0bee294d0946e1e089bbcbcec6102575fbda6b10d9db72051d WatchSource:0}: Error finding container 5a7a16ccc8267c0bee294d0946e1e089bbcbcec6102575fbda6b10d9db72051d: Status 404 returned error can't find the container with id 5a7a16ccc8267c0bee294d0946e1e089bbcbcec6102575fbda6b10d9db72051d Jun 09 15:02:25.258886 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:25.258867 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6112faf_ad05_4058_9ce5_bfc4565ade50.slice/crio-c012aad412606748fe3ea153d1ec3152dffde6e3590e6c7e36cbc11da0964664 WatchSource:0}: Error finding container c012aad412606748fe3ea153d1ec3152dffde6e3590e6c7e36cbc11da0964664: Status 404 returned error can't find the container with id c012aad412606748fe3ea153d1ec3152dffde6e3590e6c7e36cbc11da0964664 Jun 09 15:02:25.260137 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:25.260035 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e1e8ac9_833d_4d69_ad4d_e9ae9821a0dd.slice/crio-bfd4167deb430d92e17db6b1a3fca4ab9d392c5f8934dd633b20e15834f94865 WatchSource:0}: Error finding container bfd4167deb430d92e17db6b1a3fca4ab9d392c5f8934dd633b20e15834f94865: Status 404 returned error can't find the container with id bfd4167deb430d92e17db6b1a3fca4ab9d392c5f8934dd633b20e15834f94865 Jun 09 15:02:25.261450 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:25.261373 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010af952_07a7_423e_b0dc_b2318dac9bdb.slice/crio-fa670fac8910e73e41ab580e24699d75942e6e3a74aae7f36b15a04fa2c7b6db WatchSource:0}: Error finding container fa670fac8910e73e41ab580e24699d75942e6e3a74aae7f36b15a04fa2c7b6db: Status 404 returned error can't find the container with id fa670fac8910e73e41ab580e24699d75942e6e3a74aae7f36b15a04fa2c7b6db Jun 09 15:02:25.264373 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:25.264346 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81384d9b_95db_4f91_8330_4a7c5539f852.slice/crio-e405a14dd785f8e6513ae193be9a74abce16ddb54617779054916f641be03f3a WatchSource:0}: Error finding container e405a14dd785f8e6513ae193be9a74abce16ddb54617779054916f641be03f3a: Status 404 returned error can't find the container with id e405a14dd785f8e6513ae193be9a74abce16ddb54617779054916f641be03f3a Jun 09 15:02:25.265050 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:25.265024 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e2b3935_080c_42d7_9c11_02c58bd8d6ec.slice/crio-e1d94c4d0b840d80249c85396905f13f630191d79f9189aaa922e90e1247f884 WatchSource:0}: Error finding container e1d94c4d0b840d80249c85396905f13f630191d79f9189aaa922e90e1247f884: Status 404 returned error can't find the container with id e1d94c4d0b840d80249c85396905f13f630191d79f9189aaa922e90e1247f884 Jun 09 15:02:25.265888 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:25.265685 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0df8355_5708_4a2c_9ea3_1ca21d883758.slice/crio-96052190cc73f9edcee70c75d7d712b19dcf9d4c3e78434de8db49f470a5aefb WatchSource:0}: Error finding container 96052190cc73f9edcee70c75d7d712b19dcf9d4c3e78434de8db49f470a5aefb: Status 404 returned error can't find the container with id 96052190cc73f9edcee70c75d7d712b19dcf9d4c3e78434de8db49f470a5aefb Jun 09 15:02:25.269820 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:25.269798 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133e775b_f85e_4940_a6d1_5d3989eebe0a.slice/crio-0d7e37c5c14324c77f06c524ddbb369babf6b2435d1f84e267346ed4cb2c70ff WatchSource:0}: Error finding container 0d7e37c5c14324c77f06c524ddbb369babf6b2435d1f84e267346ed4cb2c70ff: Status 404 returned error can't find the container with id 0d7e37c5c14324c77f06c524ddbb369babf6b2435d1f84e267346ed4cb2c70ff Jun 09 15:02:25.270436 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:25.270215 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe3e493_a090_4fc2_aef0_f02d3b791af8.slice/crio-c8de7c07b9f91d46ccbcc8c33e436e41fa75828756f98ba51f8a32ed630a5151 WatchSource:0}: Error finding container c8de7c07b9f91d46ccbcc8c33e436e41fa75828756f98ba51f8a32ed630a5151: Status 404 returned error can't find the container with id c8de7c07b9f91d46ccbcc8c33e436e41fa75828756f98ba51f8a32ed630a5151 Jun 09 15:02:25.345149 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.344988 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:57:24 +0000 UTC" deadline="2028-03-25 07:15:43.464127692 +0000 UTC" Jun 09 15:02:25.345149 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.345150 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15712h13m18.118982259s" Jun 09 15:02:25.372449 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.372422 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:25.372562 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:25.372545 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:25.384011 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.383980 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-236.ec2.internal" event={"ID":"654ff8c271d406a1aee9355158204960","Type":"ContainerStarted","Data":"85d5bbf47e6e32a1e5fbffde018fca25e39de90d4debc2945638b3a18e56e81a"} Jun 09 15:02:25.385179 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.385156 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wb4sw" event={"ID":"7fe3e493-a090-4fc2-aef0-f02d3b791af8","Type":"ContainerStarted","Data":"c8de7c07b9f91d46ccbcc8c33e436e41fa75828756f98ba51f8a32ed630a5151"} Jun 09 15:02:25.386226 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.386206 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gx72b" event={"ID":"81384d9b-95db-4f91-8330-4a7c5539f852","Type":"ContainerStarted","Data":"e405a14dd785f8e6513ae193be9a74abce16ddb54617779054916f641be03f3a"} Jun 09 15:02:25.387297 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.387270 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" event={"ID":"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd","Type":"ContainerStarted","Data":"bfd4167deb430d92e17db6b1a3fca4ab9d392c5f8934dd633b20e15834f94865"} Jun 09 15:02:25.388437 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.388410 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-954rd" event={"ID":"c6112faf-ad05-4058-9ce5-bfc4565ade50","Type":"ContainerStarted","Data":"c012aad412606748fe3ea153d1ec3152dffde6e3590e6c7e36cbc11da0964664"} Jun 09 15:02:25.389495 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.389477 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gttwt" event={"ID":"133e775b-f85e-4940-a6d1-5d3989eebe0a","Type":"ContainerStarted","Data":"0d7e37c5c14324c77f06c524ddbb369babf6b2435d1f84e267346ed4cb2c70ff"} Jun 09 15:02:25.390458 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.390442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" event={"ID":"a0df8355-5708-4a2c-9ea3-1ca21d883758","Type":"ContainerStarted","Data":"96052190cc73f9edcee70c75d7d712b19dcf9d4c3e78434de8db49f470a5aefb"} Jun 09 15:02:25.391503 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.391478 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7279q" event={"ID":"3e2b3935-080c-42d7-9c11-02c58bd8d6ec","Type":"ContainerStarted","Data":"e1d94c4d0b840d80249c85396905f13f630191d79f9189aaa922e90e1247f884"} Jun 09 15:02:25.392656 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.392629 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r9vbh" event={"ID":"010af952-07a7-423e-b0dc-b2318dac9bdb","Type":"ContainerStarted","Data":"fa670fac8910e73e41ab580e24699d75942e6e3a74aae7f36b15a04fa2c7b6db"} Jun 09 15:02:25.393800 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.393780 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6tsz7" event={"ID":"6d2fb819-c531-4e5c-90ba-69875d3e02fc","Type":"ContainerStarted","Data":"5a7a16ccc8267c0bee294d0946e1e089bbcbcec6102575fbda6b10d9db72051d"} Jun 09 15:02:25.935895 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:25.935803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:25.936084 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:25.936012 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:25.936084 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:25.936078 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret podName:d0ecc9aa-f7a5-45b9-a149-46935344e89d nodeName:}" failed. No retries permitted until 2026-06-09 15:02:27.936057871 +0000 UTC m=+6.000632302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret") pod "global-pull-secret-syncer-wzf42" (UID: "d0ecc9aa-f7a5-45b9-a149-46935344e89d") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:26.036407 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:26.036367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:26.036599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:26.036453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlpbp\" (UniqueName: \"kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp\") pod \"network-check-target-fk26t\" (UID: \"c520ba04-dcbe-447d-84d8-bc812c5e6569\") " pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:26.037127 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:26.036729 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:26.037127 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:26.036796 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs podName:554ab5a3-a06d-4031-849a-d0afc7d6de4a nodeName:}" failed. No retries permitted until 2026-06-09 15:02:28.036778538 +0000 UTC m=+6.101352984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs") pod "network-metrics-daemon-ngkbp" (UID: "554ab5a3-a06d-4031-849a-d0afc7d6de4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:26.037444 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:26.037318 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:02:26.037444 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:26.037351 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:02:26.037444 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:26.037365 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlpbp for pod openshift-network-diagnostics/network-check-target-fk26t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:26.037444 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:26.037419 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp podName:c520ba04-dcbe-447d-84d8-bc812c5e6569 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:28.037403645 +0000 UTC m=+6.101978077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vlpbp" (UniqueName: "kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp") pod "network-check-target-fk26t" (UID: "c520ba04-dcbe-447d-84d8-bc812c5e6569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:26.345981 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:26.345913 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:57:24 +0000 UTC" deadline="2028-03-22 11:21:56.465457536 +0000 UTC" Jun 09 15:02:26.345981 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:26.345955 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15644h19m30.119507514s" Jun 09 15:02:26.375004 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:26.374974 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:26.375170 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:26.375113 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:26.375497 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:26.375478 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:26.375598 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:26.375580 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:26.446684 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:26.444367 2577 generic.go:356] "Generic (PLEG): container finished" podID="e58228f14a34ee3d1c345836d695c0b7" containerID="58be7b41c3fea4c7f7397f0502311477c427f23119bf9a0db296d883034b258a" exitCode=0 Jun 09 15:02:26.446684 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:26.444491 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal" event={"ID":"e58228f14a34ee3d1c345836d695c0b7","Type":"ContainerDied","Data":"58be7b41c3fea4c7f7397f0502311477c427f23119bf9a0db296d883034b258a"} Jun 09 15:02:26.459124 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:26.459075 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-236.ec2.internal" podStartSLOduration=3.459055606 podStartE2EDuration="3.459055606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:02:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:25.397416952 +0000 UTC m=+3.461991403" watchObservedRunningTime="2026-06-09 15:02:26.459055606 +0000 UTC m=+4.523630058" Jun 09 15:02:27.373624 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:27.373149 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:27.373624 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:27.373284 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:27.467137 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:27.466755 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal" event={"ID":"e58228f14a34ee3d1c345836d695c0b7","Type":"ContainerStarted","Data":"9e0d890d1e17d507a896dfa1134c5433a1e88372549bdeb2cce49e855a08efdd"} Jun 09 15:02:27.952464 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:27.952425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:27.952728 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:27.952574 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:27.952728 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:27.952651 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret podName:d0ecc9aa-f7a5-45b9-a149-46935344e89d nodeName:}" failed. No retries permitted until 2026-06-09 15:02:31.952632791 +0000 UTC m=+10.017207223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret") pod "global-pull-secret-syncer-wzf42" (UID: "d0ecc9aa-f7a5-45b9-a149-46935344e89d") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:28.053246 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:28.053217 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:28.053385 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:28.053294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlpbp\" (UniqueName: \"kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp\") pod \"network-check-target-fk26t\" (UID: \"c520ba04-dcbe-447d-84d8-bc812c5e6569\") " pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:28.053445 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:28.053429 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:02:28.053492 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:28.053446 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:02:28.053492 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:28.053459 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlpbp for pod openshift-network-diagnostics/network-check-target-fk26t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:28.053588 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:28.053515 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp podName:c520ba04-dcbe-447d-84d8-bc812c5e6569 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:32.053496679 +0000 UTC m=+10.118071108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vlpbp" (UniqueName: "kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp") pod "network-check-target-fk26t" (UID: "c520ba04-dcbe-447d-84d8-bc812c5e6569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:28.053934 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:28.053915 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:28.054003 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:28.053974 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs podName:554ab5a3-a06d-4031-849a-d0afc7d6de4a nodeName:}" failed. No retries permitted until 2026-06-09 15:02:32.053957671 +0000 UTC m=+10.118532102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs") pod "network-metrics-daemon-ngkbp" (UID: "554ab5a3-a06d-4031-849a-d0afc7d6de4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:28.372771 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:28.372654 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:28.372771 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:28.372703 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:28.372979 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:28.372798 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:28.372979 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:28.372963 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:29.372957 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:29.372925 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:29.373385 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:29.373065 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:30.379222 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:30.379192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:30.379696 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:30.379297 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:30.379696 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:30.379327 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:30.379696 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:30.379410 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:31.372845 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:31.372794 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:31.373014 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:31.372949 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:31.983222 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:31.983184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:31.983730 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:31.983358 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:31.983730 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:31.983423 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret podName:d0ecc9aa-f7a5-45b9-a149-46935344e89d nodeName:}" failed. No retries permitted until 2026-06-09 15:02:39.983404744 +0000 UTC m=+18.047979176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret") pod "global-pull-secret-syncer-wzf42" (UID: "d0ecc9aa-f7a5-45b9-a149-46935344e89d") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:32.084032 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:32.083998 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlpbp\" (UniqueName: \"kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp\") pod \"network-check-target-fk26t\" (UID: \"c520ba04-dcbe-447d-84d8-bc812c5e6569\") " pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:32.084191 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:32.084061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:32.084191 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:32.084137 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:02:32.084191 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:32.084160 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:32.084355 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:32.084222 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs podName:554ab5a3-a06d-4031-849a-d0afc7d6de4a nodeName:}" failed. No retries permitted until 2026-06-09 15:02:40.084204215 +0000 UTC m=+18.148778658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs") pod "network-metrics-daemon-ngkbp" (UID: "554ab5a3-a06d-4031-849a-d0afc7d6de4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:32.084355 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:32.084163 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:02:32.084355 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:32.084270 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlpbp for pod openshift-network-diagnostics/network-check-target-fk26t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:32.084355 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:32.084340 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp podName:c520ba04-dcbe-447d-84d8-bc812c5e6569 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:40.084313402 +0000 UTC m=+18.148887835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vlpbp" (UniqueName: "kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp") pod "network-check-target-fk26t" (UID: "c520ba04-dcbe-447d-84d8-bc812c5e6569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:32.375825 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:32.375756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:32.376019 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:32.375879 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:32.376256 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:32.376233 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:32.376383 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:32.376342 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:33.372813 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:33.372724 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:33.373235 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:33.372872 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:34.372752 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:34.372715 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:34.372909 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:34.372717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:34.372909 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:34.372854 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:34.372909 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:34.372904 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:35.372581 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:35.372549 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:35.372763 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:35.372668 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:36.375871 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:36.375827 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:36.376324 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:36.375840 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:36.376324 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:36.375943 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:36.376324 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:36.376030 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:37.372249 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:37.372216 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:37.372464 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:37.372356 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:38.373160 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:38.373126 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:38.373588 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:38.373233 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:38.373588 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:38.373322 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:38.373588 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:38.373416 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:39.372984 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:39.372954 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:39.373204 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:39.373058 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:40.048784 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:40.048747 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:40.048979 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:40.048872 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:40.048979 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:40.048945 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret podName:d0ecc9aa-f7a5-45b9-a149-46935344e89d nodeName:}" failed. No retries permitted until 2026-06-09 15:02:56.048923817 +0000 UTC m=+34.113498255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret") pod "global-pull-secret-syncer-wzf42" (UID: "d0ecc9aa-f7a5-45b9-a149-46935344e89d") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:40.150084 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:40.150045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlpbp\" (UniqueName: \"kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp\") pod \"network-check-target-fk26t\" (UID: \"c520ba04-dcbe-447d-84d8-bc812c5e6569\") " pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:40.150265 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:40.150110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:40.150265 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:40.150208 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:40.150370 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:40.150274 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs podName:554ab5a3-a06d-4031-849a-d0afc7d6de4a nodeName:}" failed. No retries permitted until 2026-06-09 15:02:56.15025921 +0000 UTC m=+34.214833640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs") pod "network-metrics-daemon-ngkbp" (UID: "554ab5a3-a06d-4031-849a-d0afc7d6de4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:40.150370 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:40.150221 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:02:40.150370 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:40.150314 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:02:40.150370 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:40.150328 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlpbp for pod openshift-network-diagnostics/network-check-target-fk26t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:40.150513 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:40.150371 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp podName:c520ba04-dcbe-447d-84d8-bc812c5e6569 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:56.150358398 +0000 UTC m=+34.214932844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vlpbp" (UniqueName: "kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp") pod "network-check-target-fk26t" (UID: "c520ba04-dcbe-447d-84d8-bc812c5e6569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:40.372254 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:40.372179 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:40.372254 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:40.372222 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:40.372472 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:40.372317 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:40.372472 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:40.372421 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:41.372923 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:41.372884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:41.373306 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:41.373007 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:42.373166 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:42.373124 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:42.373621 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:42.373256 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:42.373621 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:42.373347 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:42.373621 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:42.373446 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:43.372377 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:43.372340 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:43.372671 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:43.372467 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:44.372583 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.372302 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:44.373220 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.372354 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:44.373220 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:44.372695 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:44.373220 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:44.372817 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:44.499705 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.499675 2577 generic.go:356] "Generic (PLEG): container finished" podID="133e775b-f85e-4940-a6d1-5d3989eebe0a" containerID="d475d58a8f04116fe3d8c834516060cdab3ddb643843772ddb8e636f27837907" exitCode=0 Jun 09 15:02:44.499812 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.499766 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gttwt" event={"ID":"133e775b-f85e-4940-a6d1-5d3989eebe0a","Type":"ContainerDied","Data":"d475d58a8f04116fe3d8c834516060cdab3ddb643843772ddb8e636f27837907"} Jun 09 15:02:44.501461 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.501402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" event={"ID":"a0df8355-5708-4a2c-9ea3-1ca21d883758","Type":"ContainerStarted","Data":"2e93559c002e65e13f44bbbdb71cfe9c3e1f6bcbb2607dd2819cd16332eab4ff"} Jun 09 15:02:44.503340 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.503317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7279q" event={"ID":"3e2b3935-080c-42d7-9c11-02c58bd8d6ec","Type":"ContainerStarted","Data":"a056685f3c32bb1afcb3f7eef94641adace7cd523319d2c64e3fb245fd38d39c"} Jun 09 15:02:44.505017 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.504997 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r9vbh" event={"ID":"010af952-07a7-423e-b0dc-b2318dac9bdb","Type":"ContainerStarted","Data":"57b4775b24ca2bf464002e021bd527c42c69ca6bdfa12fe9d7613b81ee060ba8"} Jun 09 15:02:44.506999 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.506976 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6tsz7" event={"ID":"6d2fb819-c531-4e5c-90ba-69875d3e02fc","Type":"ContainerStarted","Data":"4b99257e2f4fcb877425dc48c16ea46d018641a64dcf7fbd149573892b2b78cf"} Jun 09 15:02:44.508819 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.508796 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wb4sw" event={"ID":"7fe3e493-a090-4fc2-aef0-f02d3b791af8","Type":"ContainerStarted","Data":"f69b146972b8c70f83aa01a32a9673d6ca96a48a17ca3563e829397f37735526"} Jun 09 15:02:44.510379 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.510340 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gx72b" event={"ID":"81384d9b-95db-4f91-8330-4a7c5539f852","Type":"ContainerStarted","Data":"02fce63472319b8daa013449cfef57b39cd7d644800cd2a2cc88bae9e82869e1"} Jun 09 15:02:44.513168 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.513149 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" event={"ID":"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd","Type":"ContainerStarted","Data":"fce6e6753536bcbe37b4f6be28333d0fbbef4a36c9d099a6ba9ca81b1c3bf260"} Jun 09 15:02:44.513261 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.513234 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" event={"ID":"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd","Type":"ContainerStarted","Data":"09dfbfcc043540a7f0c59a45b0bb0323f90f87a2920e4e1110b9fa0436e6e0be"} Jun 09 15:02:44.513317 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.513280 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" event={"ID":"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd","Type":"ContainerStarted","Data":"ead645a4031c1f0fa4a85299915d16ebbd04552373b39642edf3c13f65b90c21"} Jun 09 15:02:44.513317 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.513309 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" event={"ID":"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd","Type":"ContainerStarted","Data":"61e93a2d87267fbf204d624e0dfcb3b9c408bb438e975ea4057ccc61ec869237"} Jun 09 15:02:44.513411 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.513336 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" event={"ID":"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd","Type":"ContainerStarted","Data":"32306b5c9e8cc66e5a5c203083a1ec5220db643365d460fc09f82a0ff2cd2564"} Jun 09 15:02:44.530643 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.530580 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-236.ec2.internal" podStartSLOduration=21.530564642999998 podStartE2EDuration="21.530564643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:02:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:27.482552958 +0000 UTC m=+5.547127405" watchObservedRunningTime="2026-06-09 15:02:44.530564643 +0000 UTC m=+22.595139095" Jun 09 15:02:44.545575 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.545538 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r9vbh" podStartSLOduration=12.162627632 podStartE2EDuration="22.545525609s" totalImagesPullingTime="10.382897977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:44.545041651 +0000 UTC m=+22.609616109" watchObservedRunningTime="2026-06-09 15:02:44.545525609 +0000 UTC m=+22.610100060" Jun 09 15:02:44.560231 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.560190 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6tsz7" podStartSLOduration=4.013891106 podStartE2EDuration="22.560176754s" totalImagesPullingTime="18.546285648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:44.559914857 +0000 UTC m=+22.624489309" watchObservedRunningTime="2026-06-09 15:02:44.560176754 +0000 UTC m=+22.624751203" Jun 09 15:02:44.578916 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.578848 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wb4sw" podStartSLOduration=3.992364077 podStartE2EDuration="22.578835611s" totalImagesPullingTime="18.586471534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:44.578695158 +0000 UTC m=+22.643269620" watchObservedRunningTime="2026-06-09 15:02:44.578835611 +0000 UTC m=+22.643410060" Jun 09 15:02:44.597075 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.597033 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gx72b" podStartSLOduration=4.056666157 podStartE2EDuration="22.597020609s" totalImagesPullingTime="18.540354452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:44.596930802 +0000 UTC m=+22.661505254" watchObservedRunningTime="2026-06-09 15:02:44.597020609 +0000 UTC m=+22.661595059" Jun 09 15:02:44.722249 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.722199 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:44.786117 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.786081 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:44.798080 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.798056 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r9vbh" Jun 09 15:02:44.798512 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.798494 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r9vbh" Jun 09 15:02:44.818007 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:44.817967 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7279q" podStartSLOduration=4.280679332 podStartE2EDuration="22.817952525s" totalImagesPullingTime="18.537273193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:44.615503069 +0000 UTC m=+22.680077516" watchObservedRunningTime="2026-06-09 15:02:44.817952525 +0000 UTC m=+22.882526976" Jun 09 15:02:45.157091 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:45.157053 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 15:02:45.372247 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:45.372175 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:45.372517 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:45.372305 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:45.376544 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:45.376457 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T15:02:45.157072574Z","UUID":"cb12bc21-f537-4450-b4f9-a87b45e96368","Handler":null,"Name":"","Endpoint":""} Jun 09 15:02:45.378213 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:45.378192 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 15:02:45.378323 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:45.378233 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 15:02:45.519360 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:45.519325 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" event={"ID":"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd","Type":"ContainerStarted","Data":"a82f3e774f2eb36f37f11e1b9fc8bc52d4d55fbeff517e278e7bf0d549a2c012"} Jun 09 15:02:45.521059 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:45.520920 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-954rd" event={"ID":"c6112faf-ad05-4058-9ce5-bfc4565ade50","Type":"ContainerStarted","Data":"f8de10b06aa6fa034adb001391adca2808b127175996feca8d74234e15691886"} Jun 09 15:02:45.522945 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:45.522903 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" event={"ID":"a0df8355-5708-4a2c-9ea3-1ca21d883758","Type":"ContainerStarted","Data":"0138669baa0fc5aff1c4e981230c2b46b1965f446283afc55a74545df1640bef"} Jun 09 15:02:45.523308 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:45.523284 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r9vbh" Jun 09 15:02:45.523678 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:45.523656 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r9vbh" Jun 09 15:02:45.535936 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:45.535896 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-954rd" podStartSLOduration=4.993445756 podStartE2EDuration="23.535885477s" totalImagesPullingTime="18.542439721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:45.535834142 +0000 UTC m=+23.600408593" watchObservedRunningTime="2026-06-09 15:02:45.535885477 +0000 UTC m=+23.600459927" Jun 09 15:02:45.664540 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:45.664345 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:45.720379 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:45.720348 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:46.372704 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:46.372647 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:46.372704 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:46.372673 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:46.373043 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:46.372814 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:46.373043 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:46.372947 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:46.527498 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:46.527452 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" event={"ID":"a0df8355-5708-4a2c-9ea3-1ca21d883758","Type":"ContainerStarted","Data":"41533be7c740abdbf2bbe56dc9885581dc3e650b8d341ab2ff93998d9e42d3b1"} Jun 09 15:02:46.545139 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:46.545095 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2gx7" podStartSLOduration=3.994423692 podStartE2EDuration="24.545080961s" totalImagesPullingTime="20.550657269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:02:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:46.544839526 +0000 UTC m=+24.609413978" watchObservedRunningTime="2026-06-09 15:02:46.545080961 +0000 UTC m=+24.609655412" Jun 09 15:02:46.928638 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:46.928547 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:46.994878 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:46.994848 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:47.372394 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:47.372364 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:47.372555 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:47.372481 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:47.534138 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:47.533943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" event={"ID":"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd","Type":"ContainerStarted","Data":"f111293869ba3aac93367beada4abb5942907fb98436584ae76b0924a69451ec"} Jun 09 15:02:48.372857 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:48.372780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:48.373041 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:48.372918 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:48.373041 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:48.372978 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:48.373146 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:48.373090 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:49.216911 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:49.216713 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:49.275952 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:49.275923 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:49.372781 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:49.372756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:49.372896 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:49.372849 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:49.541025 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:49.540954 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" event={"ID":"3e1e8ac9-833d-4d69-ad4d-e9ae9821a0dd","Type":"ContainerStarted","Data":"f93f8564c63a9afaa2af1cad8856ed667ce98d9a06dfce18f10cd513af2f3c27"} Jun 09 15:02:49.541232 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:49.541214 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:49.542754 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:49.542729 2577 generic.go:356] "Generic (PLEG): container finished" podID="133e775b-f85e-4940-a6d1-5d3989eebe0a" containerID="682c0cb6cd4bf6a2c9b8317d2c548b00de4140788cdc78455bc4be6d3dcbf465" exitCode=0 Jun 09 15:02:49.542867 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:49.542765 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gttwt" event={"ID":"133e775b-f85e-4940-a6d1-5d3989eebe0a","Type":"ContainerDied","Data":"682c0cb6cd4bf6a2c9b8317d2c548b00de4140788cdc78455bc4be6d3dcbf465"} Jun 09 15:02:49.557031 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:49.557009 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:49.569943 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:49.569906 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" podStartSLOduration=8.958685569 podStartE2EDuration="27.569893914s" totalImagesPullingTime="18.611208345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:49.5690415 +0000 UTC m=+27.633615951" watchObservedRunningTime="2026-06-09 15:02:49.569893914 +0000 UTC m=+27.634468356" Jun 09 15:02:50.376473 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:50.376445 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:50.377132 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:50.376585 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:50.377132 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:50.376635 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:50.377132 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:50.376779 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:50.544970 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:50.544929 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:50.545163 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:50.545061 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:50.558954 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:50.558928 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:02:50.997510 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:50.997483 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wzf42"] Jun 09 15:02:50.997714 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:50.997589 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:50.997714 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:50.997689 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:50.998079 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:50.998058 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fk26t"] Jun 09 15:02:50.998156 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:50.998146 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:50.998258 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:50.998219 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:50.999737 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:50.999719 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ngkbp"] Jun 09 15:02:50.999814 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:50.999805 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:50.999888 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:50.999875 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:51.548892 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:51.548859 2577 generic.go:356] "Generic (PLEG): container finished" podID="133e775b-f85e-4940-a6d1-5d3989eebe0a" containerID="e7a854b22ed599d1df74055684b0b782c745ff6f036a494b4532b5ccef881b74" exitCode=0 Jun 09 15:02:51.549278 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:51.548950 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gttwt" event={"ID":"133e775b-f85e-4940-a6d1-5d3989eebe0a","Type":"ContainerDied","Data":"e7a854b22ed599d1df74055684b0b782c745ff6f036a494b4532b5ccef881b74"} Jun 09 15:02:52.373073 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:52.373034 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:52.373073 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:52.373069 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:52.373278 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:52.373146 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:52.373278 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:52.373243 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:53.045485 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:53.045291 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:53.097477 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:53.097449 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:53.372742 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:53.372699 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:53.372850 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:53.372816 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:53.429139 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:53.429110 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:53.554644 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:53.554602 2577 generic.go:356] "Generic (PLEG): container finished" podID="133e775b-f85e-4940-a6d1-5d3989eebe0a" containerID="8697e04a745ea037fb34cbdf2a6a3184857f367923ce03f81c00314c5c0e49e5" exitCode=0 Jun 09 15:02:53.554783 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:53.554673 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gttwt" event={"ID":"133e775b-f85e-4940-a6d1-5d3989eebe0a","Type":"ContainerDied","Data":"8697e04a745ea037fb34cbdf2a6a3184857f367923ce03f81c00314c5c0e49e5"} Jun 09 15:02:54.373076 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:54.373043 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:54.373582 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:54.373051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:54.373582 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:54.373165 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:54.373582 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:54.373227 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:55.372780 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:55.372741 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:55.372947 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:55.372872 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wzf42" podUID="d0ecc9aa-f7a5-45b9-a149-46935344e89d" Jun 09 15:02:56.071919 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.071889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:56.072412 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:56.071998 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:56.072412 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:56.072053 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret podName:d0ecc9aa-f7a5-45b9-a149-46935344e89d nodeName:}" failed. No retries permitted until 2026-06-09 15:03:28.072034275 +0000 UTC m=+66.136608704 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret") pod "global-pull-secret-syncer-wzf42" (UID: "d0ecc9aa-f7a5-45b9-a149-46935344e89d") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:02:56.173233 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.173197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlpbp\" (UniqueName: \"kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp\") pod \"network-check-target-fk26t\" (UID: \"c520ba04-dcbe-447d-84d8-bc812c5e6569\") " pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:56.173396 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.173263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:56.173448 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:56.173394 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:02:56.173448 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:56.173415 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:02:56.173448 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:56.173425 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlpbp for pod openshift-network-diagnostics/network-check-target-fk26t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:56.173578 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:56.173477 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp podName:c520ba04-dcbe-447d-84d8-bc812c5e6569 nodeName:}" failed. No retries permitted until 2026-06-09 15:03:28.173458564 +0000 UTC m=+66.238032996 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vlpbp" (UniqueName: "kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp") pod "network-check-target-fk26t" (UID: "c520ba04-dcbe-447d-84d8-bc812c5e6569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:02:56.173578 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:56.173399 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:56.173578 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:56.173549 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs podName:554ab5a3-a06d-4031-849a-d0afc7d6de4a nodeName:}" failed. No retries permitted until 2026-06-09 15:03:28.173530314 +0000 UTC m=+66.238104743 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs") pod "network-metrics-daemon-ngkbp" (UID: "554ab5a3-a06d-4031-849a-d0afc7d6de4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:02:56.372460 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.372427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:56.372641 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.372469 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:56.372641 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:56.372573 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:02:56.372791 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:56.372669 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fk26t" podUID="c520ba04-dcbe-447d-84d8-bc812c5e6569" Jun 09 15:02:56.737210 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.737177 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-236.ec2.internal" event="NodeReady" Jun 09 15:02:56.737384 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.737335 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 15:02:56.786474 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.786414 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lg9b8"] Jun 09 15:02:56.788902 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.788878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:56.791101 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.791079 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9l9tf"] Jun 09 15:02:56.791909 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.791890 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 15:02:56.792594 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.792577 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q8xkg\"" Jun 09 15:02:56.792594 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.792590 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 15:02:56.793011 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.792983 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9l9tf" Jun 09 15:02:56.795205 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.795008 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wkp5j\"" Jun 09 15:02:56.795205 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.795024 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 15:02:56.795205 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.795042 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 15:02:56.795205 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.795049 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 15:02:56.801870 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.801807 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lg9b8"] Jun 09 15:02:56.802693 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.802672 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9l9tf"] Jun 09 15:02:56.878597 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.878567 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-tmp-dir\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:56.878597 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.878600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:56.878844 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.878642 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn5w7\" (UniqueName: \"kubernetes.io/projected/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-kube-api-access-wn5w7\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:56.878844 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.878725 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcszg\" (UniqueName: \"kubernetes.io/projected/e3d76fef-ea75-4e7d-8de5-f1a607a448b6-kube-api-access-tcszg\") pod \"ingress-canary-9l9tf\" (UID: \"e3d76fef-ea75-4e7d-8de5-f1a607a448b6\") " pod="openshift-ingress-canary/ingress-canary-9l9tf" Jun 09 15:02:56.878844 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.878794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3d76fef-ea75-4e7d-8de5-f1a607a448b6-cert\") pod \"ingress-canary-9l9tf\" (UID: \"e3d76fef-ea75-4e7d-8de5-f1a607a448b6\") " pod="openshift-ingress-canary/ingress-canary-9l9tf" Jun 09 15:02:56.878957 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.878849 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-config-volume\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:56.907601 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.907570 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:56.980183 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.980148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcszg\" (UniqueName: \"kubernetes.io/projected/e3d76fef-ea75-4e7d-8de5-f1a607a448b6-kube-api-access-tcszg\") pod \"ingress-canary-9l9tf\" (UID: \"e3d76fef-ea75-4e7d-8de5-f1a607a448b6\") " pod="openshift-ingress-canary/ingress-canary-9l9tf" Jun 09 15:02:56.980328 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.980203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3d76fef-ea75-4e7d-8de5-f1a607a448b6-cert\") pod \"ingress-canary-9l9tf\" (UID: \"e3d76fef-ea75-4e7d-8de5-f1a607a448b6\") " pod="openshift-ingress-canary/ingress-canary-9l9tf" Jun 09 15:02:56.980328 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.980253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-config-volume\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:56.980328 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.980288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-tmp-dir\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:56.980328 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.980316 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:56.980526 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.980343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn5w7\" (UniqueName: \"kubernetes.io/projected/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-kube-api-access-wn5w7\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:56.980689 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:56.980663 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:02:56.980774 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.980737 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-tmp-dir\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:56.980774 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:56.980759 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls podName:3dda6239-4344-4d5f-91b7-fc9a0a6597c2 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:57.480739656 +0000 UTC m=+35.545314089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls") pod "dns-default-lg9b8" (UID: "3dda6239-4344-4d5f-91b7-fc9a0a6597c2") : secret "dns-default-metrics-tls" not found Jun 09 15:02:56.980927 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.980900 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-config-volume\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:56.984766 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.984744 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3d76fef-ea75-4e7d-8de5-f1a607a448b6-cert\") pod \"ingress-canary-9l9tf\" (UID: \"e3d76fef-ea75-4e7d-8de5-f1a607a448b6\") " pod="openshift-ingress-canary/ingress-canary-9l9tf" Jun 09 15:02:56.991305 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.991258 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn5w7\" (UniqueName: \"kubernetes.io/projected/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-kube-api-access-wn5w7\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:56.991379 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:56.991311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcszg\" (UniqueName: \"kubernetes.io/projected/e3d76fef-ea75-4e7d-8de5-f1a607a448b6-kube-api-access-tcszg\") pod \"ingress-canary-9l9tf\" (UID: \"e3d76fef-ea75-4e7d-8de5-f1a607a448b6\") " pod="openshift-ingress-canary/ingress-canary-9l9tf" Jun 09 15:02:57.108613 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:57.108563 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9l9tf" Jun 09 15:02:57.372796 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:57.372556 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:02:57.375577 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:57.375088 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:02:57.434638 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:57.434595 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9l9tf"] Jun 09 15:02:57.437345 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:57.437324 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d76fef_ea75_4e7d_8de5_f1a607a448b6.slice/crio-704c46586d27e9029d2fcd88705708d01c8aedab783876fbc795fc2f86e26260 WatchSource:0}: Error finding container 704c46586d27e9029d2fcd88705708d01c8aedab783876fbc795fc2f86e26260: Status 404 returned error can't find the container with id 704c46586d27e9029d2fcd88705708d01c8aedab783876fbc795fc2f86e26260 Jun 09 15:02:57.484693 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:57.484652 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:57.484838 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:57.484821 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:02:57.484898 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:57.484888 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls podName:3dda6239-4344-4d5f-91b7-fc9a0a6597c2 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:58.484871054 +0000 UTC m=+36.549445487 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls") pod "dns-default-lg9b8" (UID: "3dda6239-4344-4d5f-91b7-fc9a0a6597c2") : secret "dns-default-metrics-tls" not found Jun 09 15:02:57.563588 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:57.563505 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9l9tf" event={"ID":"e3d76fef-ea75-4e7d-8de5-f1a607a448b6","Type":"ContainerStarted","Data":"704c46586d27e9029d2fcd88705708d01c8aedab783876fbc795fc2f86e26260"} Jun 09 15:02:57.566071 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:57.566048 2577 generic.go:356] "Generic (PLEG): container finished" podID="133e775b-f85e-4940-a6d1-5d3989eebe0a" containerID="4bbd6ffd7fa223a920677f1ab3aa5dd60f4f44f7de27c3d44a3302c9b9617f03" exitCode=0 Jun 09 15:02:57.566163 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:57.566100 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gttwt" event={"ID":"133e775b-f85e-4940-a6d1-5d3989eebe0a","Type":"ContainerDied","Data":"4bbd6ffd7fa223a920677f1ab3aa5dd60f4f44f7de27c3d44a3302c9b9617f03"} Jun 09 15:02:58.376230 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.373339 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:02:58.376230 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.373354 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:02:58.376817 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.376377 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:02:58.377074 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.377052 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v7jx\"" Jun 09 15:02:58.377201 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.377088 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:02:58.377201 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.377112 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:02:58.377326 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.377240 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bs8v2\"" Jun 09 15:02:58.490425 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.490386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:02:58.490624 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:58.490538 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:02:58.490697 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:02:58.490641 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls podName:3dda6239-4344-4d5f-91b7-fc9a0a6597c2 nodeName:}" failed. No retries permitted until 2026-06-09 15:03:00.49060128 +0000 UTC m=+38.555175727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls") pod "dns-default-lg9b8" (UID: "3dda6239-4344-4d5f-91b7-fc9a0a6597c2") : secret "dns-default-metrics-tls" not found Jun 09 15:02:58.572298 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.572261 2577 generic.go:356] "Generic (PLEG): container finished" podID="133e775b-f85e-4940-a6d1-5d3989eebe0a" containerID="75c1c6be410371289df6de29538220dfcfa18c23884c62db49c84094cef3fd25" exitCode=0 Jun 09 15:02:58.572447 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.572302 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gttwt" event={"ID":"133e775b-f85e-4940-a6d1-5d3989eebe0a","Type":"ContainerDied","Data":"75c1c6be410371289df6de29538220dfcfa18c23884c62db49c84094cef3fd25"} Jun 09 15:02:58.831266 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.831223 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl"] Jun 09 15:02:58.834443 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.834407 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:58.837731 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.837697 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 15:02:58.837963 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.837863 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 15:02:58.837963 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.837958 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 15:02:58.838420 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.838401 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 15:02:58.838524 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.838443 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 15:02:58.838589 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.838524 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 15:02:58.838589 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.838561 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 15:02:58.849858 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.849833 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl"] Jun 09 15:02:58.994161 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.994124 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a305486-de66-4c01-8326-4211e0846c39-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:58.994328 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.994166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a305486-de66-4c01-8326-4211e0846c39-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:58.994328 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.994197 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5a305486-de66-4c01-8326-4211e0846c39-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:58.994328 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.994302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2gmv\" (UniqueName: \"kubernetes.io/projected/5a305486-de66-4c01-8326-4211e0846c39-kube-api-access-v2gmv\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:58.994504 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.994359 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5a305486-de66-4c01-8326-4211e0846c39-ca\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:58.994504 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:58.994448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5a305486-de66-4c01-8326-4211e0846c39-hub\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.095549 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.095528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5a305486-de66-4c01-8326-4211e0846c39-hub\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.095598 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.095569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a305486-de66-4c01-8326-4211e0846c39-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.095598 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.095589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a305486-de66-4c01-8326-4211e0846c39-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.095722 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.095619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5a305486-de66-4c01-8326-4211e0846c39-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.095822 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.095798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2gmv\" (UniqueName: \"kubernetes.io/projected/5a305486-de66-4c01-8326-4211e0846c39-kube-api-access-v2gmv\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.095886 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.095870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5a305486-de66-4c01-8326-4211e0846c39-ca\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.096537 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.096488 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a305486-de66-4c01-8326-4211e0846c39-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.099165 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.099140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5a305486-de66-4c01-8326-4211e0846c39-ca\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.099165 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.099153 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5a305486-de66-4c01-8326-4211e0846c39-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.099354 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.099249 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a305486-de66-4c01-8326-4211e0846c39-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.099354 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.099292 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5a305486-de66-4c01-8326-4211e0846c39-hub\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.103145 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.103125 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2gmv\" (UniqueName: \"kubernetes.io/projected/5a305486-de66-4c01-8326-4211e0846c39-kube-api-access-v2gmv\") pod \"cluster-proxy-proxy-agent-7698c7b6b-67zkl\" (UID: \"5a305486-de66-4c01-8326-4211e0846c39\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.153375 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.153351 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:02:59.404845 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.404577 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl"] Jun 09 15:02:59.409043 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:02:59.409017 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a305486_de66_4c01_8326_4211e0846c39.slice/crio-a6afbd4c433cca9011165c9133e552ecded96a5a76e0b79e641bfc6ac250b340 WatchSource:0}: Error finding container a6afbd4c433cca9011165c9133e552ecded96a5a76e0b79e641bfc6ac250b340: Status 404 returned error can't find the container with id a6afbd4c433cca9011165c9133e552ecded96a5a76e0b79e641bfc6ac250b340 Jun 09 15:02:59.577807 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.577772 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gttwt" event={"ID":"133e775b-f85e-4940-a6d1-5d3989eebe0a","Type":"ContainerStarted","Data":"454537ff4faedb10f486950318780c610fa5bdb62cd6628f03b6e226f8fcd037"} Jun 09 15:02:59.578927 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.578902 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" event={"ID":"5a305486-de66-4c01-8326-4211e0846c39","Type":"ContainerStarted","Data":"a6afbd4c433cca9011165c9133e552ecded96a5a76e0b79e641bfc6ac250b340"} Jun 09 15:02:59.580151 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.580126 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9l9tf" event={"ID":"e3d76fef-ea75-4e7d-8de5-f1a607a448b6","Type":"ContainerStarted","Data":"0cc4fbc7a3d0be713f10c0960a5e7d856821b144b4513628e21f1b8bc6c4a753"} Jun 09 15:02:59.598908 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.598866 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gttwt" podStartSLOduration=8.867465099 podStartE2EDuration="37.598830297s" totalImagesPullingTime="28.731365198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:02:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:59.597995301 +0000 UTC m=+37.662569776" watchObservedRunningTime="2026-06-09 15:02:59.598830297 +0000 UTC m=+37.663404746" Jun 09 15:02:59.612580 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.612544 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9l9tf" podStartSLOduration=1.7834297879999998 podStartE2EDuration="3.612532056s" totalImagesPullingTime="1.829102268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:59.612209402 +0000 UTC m=+37.676783865" watchObservedRunningTime="2026-06-09 15:02:59.612532056 +0000 UTC m=+37.677106505" Jun 09 15:02:59.685259 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.685186 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:59.787052 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.787020 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:02:59.887052 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:02:59.887019 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:03:00.508191 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:00.508159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:03:00.508773 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:03:00.508322 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:03:00.508773 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:03:00.508397 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls podName:3dda6239-4344-4d5f-91b7-fc9a0a6597c2 nodeName:}" failed. No retries permitted until 2026-06-09 15:03:04.508375376 +0000 UTC m=+42.572949806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls") pod "dns-default-lg9b8" (UID: "3dda6239-4344-4d5f-91b7-fc9a0a6597c2") : secret "dns-default-metrics-tls" not found Jun 09 15:03:01.893929 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:01.893897 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:03:01.943010 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:01.942976 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:03:03.590859 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:03.590829 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" event={"ID":"5a305486-de66-4c01-8326-4211e0846c39","Type":"ContainerStarted","Data":"b6c70ce058aabb8120485ce1be371bf222259f725717f023aed5fbb566af80a4"} Jun 09 15:03:03.591211 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:03.590875 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" event={"ID":"5a305486-de66-4c01-8326-4211e0846c39","Type":"ContainerStarted","Data":"a004d81e7eff4a81d37d6995ad353958714873a3389ea2227691d2e86c295790"} Jun 09 15:03:04.537052 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:04.537014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:03:04.537197 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:03:04.537171 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:03:04.537253 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:03:04.537233 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls podName:3dda6239-4344-4d5f-91b7-fc9a0a6597c2 nodeName:}" failed. No retries permitted until 2026-06-09 15:03:12.537218351 +0000 UTC m=+50.601792779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls") pod "dns-default-lg9b8" (UID: "3dda6239-4344-4d5f-91b7-fc9a0a6597c2") : secret "dns-default-metrics-tls" not found Jun 09 15:03:04.594771 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:04.594736 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" event={"ID":"5a305486-de66-4c01-8326-4211e0846c39","Type":"ContainerStarted","Data":"37d99c6e73457f5a7dc76d4140185e590a1a6aee8f4455a21b82f58895d68b43"} Jun 09 15:03:04.613006 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:04.612958 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" podStartSLOduration=2.6692512280000003 podStartE2EDuration="6.612944831s" totalImagesPullingTime="3.943693603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:03:04.612272709 +0000 UTC m=+42.676847162" watchObservedRunningTime="2026-06-09 15:03:04.612944831 +0000 UTC m=+42.677519281" Jun 09 15:03:08.891935 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:08.891901 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:03:08.955450 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:08.955416 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:03:12.592925 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:12.592883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:03:12.593310 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:03:12.593046 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:03:12.593310 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:03:12.593126 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls podName:3dda6239-4344-4d5f-91b7-fc9a0a6597c2 nodeName:}" failed. No retries permitted until 2026-06-09 15:03:28.593109317 +0000 UTC m=+66.657683747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls") pod "dns-default-lg9b8" (UID: "3dda6239-4344-4d5f-91b7-fc9a0a6597c2") : secret "dns-default-metrics-tls" not found Jun 09 15:03:15.030494 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:15.030457 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:03:15.091142 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:15.091115 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:03:22.567146 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:22.567114 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljbzl" Jun 09 15:03:22.680711 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:22.680671 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:03:22.734055 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:22.734017 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:03:28.104878 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.104848 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:03:28.107384 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.107367 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:03:28.118050 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.118029 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0ecc9aa-f7a5-45b9-a149-46935344e89d-original-pull-secret\") pod \"global-pull-secret-syncer-wzf42\" (UID: \"d0ecc9aa-f7a5-45b9-a149-46935344e89d\") " pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:03:28.205941 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.205908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlpbp\" (UniqueName: \"kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp\") pod \"network-check-target-fk26t\" (UID: \"c520ba04-dcbe-447d-84d8-bc812c5e6569\") " pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:03:28.206132 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.205954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:03:28.208304 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.208287 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:03:28.208377 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.208307 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:03:28.216918 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:03:28.216896 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:03:28.217004 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:03:28.216966 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs podName:554ab5a3-a06d-4031-849a-d0afc7d6de4a nodeName:}" failed. No retries permitted until 2026-06-09 15:04:32.216944441 +0000 UTC m=+130.281518876 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs") pod "network-metrics-daemon-ngkbp" (UID: "554ab5a3-a06d-4031-849a-d0afc7d6de4a") : secret "metrics-daemon-secret" not found Jun 09 15:03:28.218567 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.218552 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:03:28.229378 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.229353 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlpbp\" (UniqueName: \"kubernetes.io/projected/c520ba04-dcbe-447d-84d8-bc812c5e6569-kube-api-access-vlpbp\") pod \"network-check-target-fk26t\" (UID: \"c520ba04-dcbe-447d-84d8-bc812c5e6569\") " pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:03:28.284826 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.284798 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wzf42" Jun 09 15:03:28.403891 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.403673 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bs8v2\"" Jun 09 15:03:28.408223 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.405716 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:03:28.439693 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.439668 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wzf42"] Jun 09 15:03:28.443018 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:03:28.442990 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ecc9aa_f7a5_45b9_a149_46935344e89d.slice/crio-4fa6939184e174e650ac7923e0f90fb2993ac5746829b3cc49182236ce093ed4 WatchSource:0}: Error finding container 4fa6939184e174e650ac7923e0f90fb2993ac5746829b3cc49182236ce093ed4: Status 404 returned error can't find the container with id 4fa6939184e174e650ac7923e0f90fb2993ac5746829b3cc49182236ce093ed4 Jun 09 15:03:28.540847 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.540759 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fk26t"] Jun 09 15:03:28.544374 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:03:28.544346 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc520ba04_dcbe_447d_84d8_bc812c5e6569.slice/crio-65e26886e6550134e1fa7ffdba16fcbd607e5417fdc59e56bd5fe7dd47631f85 WatchSource:0}: Error finding container 65e26886e6550134e1fa7ffdba16fcbd607e5417fdc59e56bd5fe7dd47631f85: Status 404 returned error can't find the container with id 65e26886e6550134e1fa7ffdba16fcbd607e5417fdc59e56bd5fe7dd47631f85 Jun 09 15:03:28.608625 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.608558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:03:28.608729 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:03:28.608709 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:03:28.608778 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:03:28.608769 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls podName:3dda6239-4344-4d5f-91b7-fc9a0a6597c2 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:00.608754906 +0000 UTC m=+98.673329339 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls") pod "dns-default-lg9b8" (UID: "3dda6239-4344-4d5f-91b7-fc9a0a6597c2") : secret "dns-default-metrics-tls" not found Jun 09 15:03:28.651570 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.651536 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wzf42" event={"ID":"d0ecc9aa-f7a5-45b9-a149-46935344e89d","Type":"ContainerStarted","Data":"4fa6939184e174e650ac7923e0f90fb2993ac5746829b3cc49182236ce093ed4"} Jun 09 15:03:28.652551 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:28.652530 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fk26t" event={"ID":"c520ba04-dcbe-447d-84d8-bc812c5e6569","Type":"ContainerStarted","Data":"65e26886e6550134e1fa7ffdba16fcbd607e5417fdc59e56bd5fe7dd47631f85"} Jun 09 15:03:32.665387 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:32.665347 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fk26t" event={"ID":"c520ba04-dcbe-447d-84d8-bc812c5e6569","Type":"ContainerStarted","Data":"e57f56b4ccc96484a6026372f8939d146299fa9e37a8ae1152eb87e6b70c0e41"} Jun 09 15:03:32.665863 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:32.665431 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:03:32.680441 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:32.680395 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fk26t" podStartSLOduration=67.351585594 podStartE2EDuration="1m10.680379899s" totalImagesPullingTime="3.328794305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:03:32.680132613 +0000 UTC m=+70.744707072" watchObservedRunningTime="2026-06-09 15:03:32.680379899 +0000 UTC m=+70.744954352" Jun 09 15:03:34.671620 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:34.671583 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wzf42" event={"ID":"d0ecc9aa-f7a5-45b9-a149-46935344e89d","Type":"ContainerStarted","Data":"2ea0f7484d4ea9f603f72b21bc1e2601514bc39b6de01ac46197ceee3d2305fc"} Jun 09 15:03:34.686348 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:34.686304 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wzf42" podStartSLOduration=67.488794241 podStartE2EDuration="1m12.686289031s" totalImagesPullingTime="5.19749479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:03:34.685815453 +0000 UTC m=+72.750389895" watchObservedRunningTime="2026-06-09 15:03:34.686289031 +0000 UTC m=+72.750863523" Jun 09 15:03:47.208477 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:47.208356 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:03:47.261252 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:03:47.261217 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:04:00.619256 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:04:00.619163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:04:00.619670 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:04:00.619314 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:04:00.619670 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:04:00.619386 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls podName:3dda6239-4344-4d5f-91b7-fc9a0a6597c2 nodeName:}" failed. No retries permitted until 2026-06-09 15:05:04.619368972 +0000 UTC m=+162.683943401 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls") pod "dns-default-lg9b8" (UID: "3dda6239-4344-4d5f-91b7-fc9a0a6597c2") : secret "dns-default-metrics-tls" not found Jun 09 15:04:03.669789 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:04:03.669755 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fk26t" Jun 09 15:04:32.235719 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:04:32.235681 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:04:32.236203 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:04:32.235794 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:04:32.236203 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:04:32.235856 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs podName:554ab5a3-a06d-4031-849a-d0afc7d6de4a nodeName:}" failed. No retries permitted until 2026-06-09 15:06:34.235840834 +0000 UTC m=+252.300415267 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs") pod "network-metrics-daemon-ngkbp" (UID: "554ab5a3-a06d-4031-849a-d0afc7d6de4a") : secret "metrics-daemon-secret" not found Jun 09 15:04:59.802213 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:04:59.802170 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lg9b8" podUID="3dda6239-4344-4d5f-91b7-fc9a0a6597c2" Jun 09 15:04:59.902654 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:04:59.902628 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lg9b8" Jun 09 15:05:01.386227 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:05:01.386181 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ngkbp" podUID="554ab5a3-a06d-4031-849a-d0afc7d6de4a" Jun 09 15:05:04.660205 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:05:04.660158 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:05:04.660714 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:05:04.660326 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:05:04.660714 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:05:04.660402 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls podName:3dda6239-4344-4d5f-91b7-fc9a0a6597c2 nodeName:}" failed. No retries permitted until 2026-06-09 15:07:06.660385963 +0000 UTC m=+284.724960392 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls") pod "dns-default-lg9b8" (UID: "3dda6239-4344-4d5f-91b7-fc9a0a6597c2") : secret "dns-default-metrics-tls" not found Jun 09 15:05:16.372361 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:05:16.372293 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:05:32.845494 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:05:32.845464 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:05:35.826299 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:05:35.826265 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:14.556192 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.556155 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-jp4gp"] Jun 09 15:06:14.558032 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.558013 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.560738 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.560718 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 15:06:14.560829 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.560804 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-46g44\"" Jun 09 15:06:14.562597 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.562571 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 15:06:14.562597 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.562578 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 15:06:14.562773 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.562651 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 15:06:14.567927 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.567910 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 15:06:14.578242 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.578217 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-jp4gp"] Jun 09 15:06:14.637692 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.637662 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-serving-cert\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.637692 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.637693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-snapshots\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.637889 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.637733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-tmp\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.637889 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.637761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-trusted-ca-bundle\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.637889 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.637783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-service-ca-bundle\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.637889 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.637799 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t746\" (UniqueName: \"kubernetes.io/projected/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-kube-api-access-5t746\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.706188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.706158 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:14.738240 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.738213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-snapshots\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.738361 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.738274 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-tmp\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.738361 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.738303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-trusted-ca-bundle\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.738361 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.738329 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-service-ca-bundle\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.738361 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.738353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t746\" (UniqueName: \"kubernetes.io/projected/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-kube-api-access-5t746\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.738656 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.738629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-serving-cert\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.738860 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.738840 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-tmp\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.738932 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.738912 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-snapshots\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.738997 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.738982 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-service-ca-bundle\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.739277 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.739256 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-trusted-ca-bundle\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.740837 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.740813 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-serving-cert\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.746084 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.746054 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t746\" (UniqueName: \"kubernetes.io/projected/cb4d7536-714c-4647-bc2c-a9f7bf3d2369-kube-api-access-5t746\") pod \"insights-operator-896549976-jp4gp\" (UID: \"cb4d7536-714c-4647-bc2c-a9f7bf3d2369\") " pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.812671 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.812533 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:14.866614 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.866581 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-jp4gp" Jun 09 15:06:14.983169 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:14.983137 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-jp4gp"] Jun 09 15:06:14.987179 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:06:14.987151 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4d7536_714c_4647_bc2c_a9f7bf3d2369.slice/crio-85c1475c75ba50c8dcb96fbccdfad281e3e159b4ee3f3b063360eb6afe6f915d WatchSource:0}: Error finding container 85c1475c75ba50c8dcb96fbccdfad281e3e159b4ee3f3b063360eb6afe6f915d: Status 404 returned error can't find the container with id 85c1475c75ba50c8dcb96fbccdfad281e3e159b4ee3f3b063360eb6afe6f915d Jun 09 15:06:15.111520 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:15.111435 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-jp4gp" event={"ID":"cb4d7536-714c-4647-bc2c-a9f7bf3d2369","Type":"ContainerStarted","Data":"85c1475c75ba50c8dcb96fbccdfad281e3e159b4ee3f3b063360eb6afe6f915d"} Jun 09 15:06:16.508525 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:16.508496 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:16.568700 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:16.568669 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:18.123150 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:18.123115 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-jp4gp" event={"ID":"cb4d7536-714c-4647-bc2c-a9f7bf3d2369","Type":"ContainerStarted","Data":"5a68e0be8301d5f36fea9acb67ec76348165ee7dc42056d4124079f09c300f16"} Jun 09 15:06:18.139568 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:18.139523 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-jp4gp" podStartSLOduration=2.060629832 podStartE2EDuration="4.139506289s" totalImagesPullingTime="2.078876457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:06:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:06:18.138827679 +0000 UTC m=+236.203402130" watchObservedRunningTime="2026-06-09 15:06:18.139506289 +0000 UTC m=+236.204080740" Jun 09 15:06:18.595090 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:18.595051 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:18.694149 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:18.694117 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:18.804976 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:18.804944 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:18.895190 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:18.895110 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:18.994259 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:18.994230 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:19.094322 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:19.094294 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:19.149252 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:19.149188 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:19.332101 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:19.332070 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:19.386647 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:19.386602 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:20.303007 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:20.302983 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7279q_3e2b3935-080c-42d7-9c11-02c58bd8d6ec/dns-node-resolver/0.log" Jun 09 15:06:20.972999 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:20.972968 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:21.302601 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:21.302532 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6tsz7_6d2fb819-c531-4e5c-90ba-69875d3e02fc/node-ca/0.log" Jun 09 15:06:22.084054 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:22.084025 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:22.104250 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:22.104229 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9l9tf_e3d76fef-ea75-4e7d-8de5-f1a607a448b6/serve-healthcheck-canary/0.log" Jun 09 15:06:24.167555 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:24.167511 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:24.337393 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:24.337362 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:24.437799 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:24.437712 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:24.539568 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:24.539536 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:24.687265 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:24.687234 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:24.881590 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:24.881558 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:25.117291 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:25.117251 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:26.071825 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:26.071791 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:26.269805 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:26.269759 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:26.466997 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:26.466969 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:26.683598 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:26.683567 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:26.868990 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:26.868900 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:27.873518 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:27.873488 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:27.930827 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:27.930789 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:28.066354 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:28.066320 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:28.309746 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:28.309700 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:28.468354 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:28.468324 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:28.677058 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:28.676977 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:28.880930 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:28.880899 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:29.869079 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:29.869045 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:30.071509 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:30.071477 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:30.269283 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:30.269253 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:30.688487 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:30.688399 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:30.788520 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:30.788486 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:31.470927 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:31.470893 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:31.618542 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:31.618509 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:31.721323 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:31.721236 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:32.075419 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:32.075325 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:32.268763 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:32.268734 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:32.675164 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:32.675133 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:33.270526 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:33.270497 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:33.519353 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:33.519320 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:33.668642 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:33.668525 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:33.865625 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:33.865581 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:33.963843 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:33.963810 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:34.285094 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:34.285006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:06:34.287403 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:34.287374 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/554ab5a3-a06d-4031-849a-d0afc7d6de4a-metrics-certs\") pod \"network-metrics-daemon-ngkbp\" (UID: \"554ab5a3-a06d-4031-849a-d0afc7d6de4a\") " pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:06:34.374930 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:34.374903 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v7jx\"" Jun 09 15:06:34.383183 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:34.383159 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngkbp" Jun 09 15:06:34.469294 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:34.469266 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:34.503368 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:34.503332 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ngkbp"] Jun 09 15:06:34.508828 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:06:34.508798 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod554ab5a3_a06d_4031_849a_d0afc7d6de4a.slice/crio-81dd5a51906d9b91c938abdd9f1c5dd9d9093d639ac1bbddc33ac6432c06b48f WatchSource:0}: Error finding container 81dd5a51906d9b91c938abdd9f1c5dd9d9093d639ac1bbddc33ac6432c06b48f: Status 404 returned error can't find the container with id 81dd5a51906d9b91c938abdd9f1c5dd9d9093d639ac1bbddc33ac6432c06b48f Jun 09 15:06:34.668866 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:34.668775 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:34.872539 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:34.872508 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:35.170331 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:35.170296 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ngkbp" event={"ID":"554ab5a3-a06d-4031-849a-d0afc7d6de4a","Type":"ContainerStarted","Data":"81dd5a51906d9b91c938abdd9f1c5dd9d9093d639ac1bbddc33ac6432c06b48f"} Jun 09 15:06:36.175059 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:36.175023 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ngkbp" event={"ID":"554ab5a3-a06d-4031-849a-d0afc7d6de4a","Type":"ContainerStarted","Data":"1d4258b6404313c860f9128d262e34a18c4dc8770c1493df3663e91810da95f2"} Jun 09 15:06:36.175473 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:36.175105 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ngkbp" event={"ID":"554ab5a3-a06d-4031-849a-d0afc7d6de4a","Type":"ContainerStarted","Data":"de20fdd12c7c35d7a8cafd19084ca5183c547d3d9ed955816601fbb1fcac57e9"} Jun 09 15:06:36.192070 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:36.192017 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ngkbp" podStartSLOduration=253.064985867 podStartE2EDuration="4m14.192003213s" totalImagesPullingTime="1.127017346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:06:36.191212205 +0000 UTC m=+254.255786668" watchObservedRunningTime="2026-06-09 15:06:36.192003213 +0000 UTC m=+254.256577663" Jun 09 15:06:38.637481 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:38.637452 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:38.738332 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:38.738302 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:38.842392 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:38.842334 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:38.941462 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:38.941388 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:39.089901 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:39.089871 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:39.148068 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:39.148043 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:39.488913 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:39.488886 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:39.589386 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:39.589357 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:40.301943 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.301907 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:40.447787 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.447754 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dgl42"] Jun 09 15:06:40.451210 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.451183 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.453870 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.453824 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 15:06:40.453870 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.453865 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nbr45\"" Jun 09 15:06:40.454041 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.453841 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 15:06:40.464484 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.464462 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dgl42"] Jun 09 15:06:40.524213 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.524183 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d12388a-f2be-4278-8650-2a5c8b4b2f04-crio-socket\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.524213 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.524217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d12388a-f2be-4278-8650-2a5c8b4b2f04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.524441 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.524244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d12388a-f2be-4278-8650-2a5c8b4b2f04-data-volume\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.524441 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.524278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d12388a-f2be-4278-8650-2a5c8b4b2f04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.524441 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.524298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm7tr\" (UniqueName: \"kubernetes.io/projected/2d12388a-f2be-4278-8650-2a5c8b4b2f04-kube-api-access-pm7tr\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.532787 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.532759 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:40.536489 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.536467 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-qzb4x"] Jun 09 15:06:40.543860 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.543845 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-qzb4x" Jun 09 15:06:40.546015 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.545997 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 15:06:40.546173 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.546104 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-s69b8\"" Jun 09 15:06:40.546294 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.546281 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 15:06:40.554583 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.554501 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-qzb4x"] Jun 09 15:06:40.625271 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.625242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26wq7\" (UniqueName: \"kubernetes.io/projected/7207a032-507d-4078-bcc3-c77cf9e190a7-kube-api-access-26wq7\") pod \"downloads-6657875f97-qzb4x\" (UID: \"7207a032-507d-4078-bcc3-c77cf9e190a7\") " pod="openshift-console/downloads-6657875f97-qzb4x" Jun 09 15:06:40.625462 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.625292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d12388a-f2be-4278-8650-2a5c8b4b2f04-crio-socket\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.625462 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.625312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d12388a-f2be-4278-8650-2a5c8b4b2f04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.625462 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.625331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d12388a-f2be-4278-8650-2a5c8b4b2f04-data-volume\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.625462 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.625357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d12388a-f2be-4278-8650-2a5c8b4b2f04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.625462 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.625372 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm7tr\" (UniqueName: \"kubernetes.io/projected/2d12388a-f2be-4278-8650-2a5c8b4b2f04-kube-api-access-pm7tr\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.625462 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.625384 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d12388a-f2be-4278-8650-2a5c8b4b2f04-crio-socket\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.625799 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.625759 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d12388a-f2be-4278-8650-2a5c8b4b2f04-data-volume\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.625946 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.625926 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d12388a-f2be-4278-8650-2a5c8b4b2f04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.627705 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.627689 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d12388a-f2be-4278-8650-2a5c8b4b2f04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.636828 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.636804 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7445cd6d48-ngvsb"] Jun 09 15:06:40.637298 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.637280 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:40.640526 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.640508 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.640903 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.640880 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm7tr\" (UniqueName: \"kubernetes.io/projected/2d12388a-f2be-4278-8650-2a5c8b4b2f04-kube-api-access-pm7tr\") pod \"insights-runtime-extractor-dgl42\" (UID: \"2d12388a-f2be-4278-8650-2a5c8b4b2f04\") " pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.642794 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.642771 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 15:06:40.642907 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.642797 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 15:06:40.642907 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.642835 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pxmss\"" Jun 09 15:06:40.642907 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.642782 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 15:06:40.650430 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.650407 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 15:06:40.655460 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.655390 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7445cd6d48-ngvsb"] Jun 09 15:06:40.726586 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.726547 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a76db812-d3c4-4fdc-9835-01c5be6319d9-ca-trust-extracted\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.726586 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.726589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26wq7\" (UniqueName: \"kubernetes.io/projected/7207a032-507d-4078-bcc3-c77cf9e190a7-kube-api-access-26wq7\") pod \"downloads-6657875f97-qzb4x\" (UID: \"7207a032-507d-4078-bcc3-c77cf9e190a7\") " pod="openshift-console/downloads-6657875f97-qzb4x" Jun 09 15:06:40.726814 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.726628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nbkw\" (UniqueName: \"kubernetes.io/projected/a76db812-d3c4-4fdc-9835-01c5be6319d9-kube-api-access-4nbkw\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.726814 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.726663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a76db812-d3c4-4fdc-9835-01c5be6319d9-image-registry-private-configuration\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.726814 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.726682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a76db812-d3c4-4fdc-9835-01c5be6319d9-trusted-ca\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.726907 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.726803 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a76db812-d3c4-4fdc-9835-01c5be6319d9-registry-certificates\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.726907 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.726833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a76db812-d3c4-4fdc-9835-01c5be6319d9-bound-sa-token\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.726907 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.726878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76db812-d3c4-4fdc-9835-01c5be6319d9-registry-tls\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.726907 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.726899 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a76db812-d3c4-4fdc-9835-01c5be6319d9-installation-pull-secrets\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.728796 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.728770 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:40.739732 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.739707 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26wq7\" (UniqueName: \"kubernetes.io/projected/7207a032-507d-4078-bcc3-c77cf9e190a7-kube-api-access-26wq7\") pod \"downloads-6657875f97-qzb4x\" (UID: \"7207a032-507d-4078-bcc3-c77cf9e190a7\") " pod="openshift-console/downloads-6657875f97-qzb4x" Jun 09 15:06:40.759684 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.759662 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dgl42" Jun 09 15:06:40.828223 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.828150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a76db812-d3c4-4fdc-9835-01c5be6319d9-registry-certificates\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.828223 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.828184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a76db812-d3c4-4fdc-9835-01c5be6319d9-bound-sa-token\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.828223 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.828215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76db812-d3c4-4fdc-9835-01c5be6319d9-registry-tls\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.828449 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.828237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a76db812-d3c4-4fdc-9835-01c5be6319d9-installation-pull-secrets\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.828449 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.828325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a76db812-d3c4-4fdc-9835-01c5be6319d9-ca-trust-extracted\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.828794 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.828761 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a76db812-d3c4-4fdc-9835-01c5be6319d9-ca-trust-extracted\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.828794 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.828782 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nbkw\" (UniqueName: \"kubernetes.io/projected/a76db812-d3c4-4fdc-9835-01c5be6319d9-kube-api-access-4nbkw\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.828953 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.828862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a76db812-d3c4-4fdc-9835-01c5be6319d9-image-registry-private-configuration\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.828953 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.828907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a76db812-d3c4-4fdc-9835-01c5be6319d9-trusted-ca\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.829078 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.829057 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a76db812-d3c4-4fdc-9835-01c5be6319d9-registry-certificates\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.830098 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.830073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a76db812-d3c4-4fdc-9835-01c5be6319d9-trusted-ca\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.830815 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.830796 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a76db812-d3c4-4fdc-9835-01c5be6319d9-installation-pull-secrets\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.830904 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.830888 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76db812-d3c4-4fdc-9835-01c5be6319d9-registry-tls\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.831135 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.831118 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a76db812-d3c4-4fdc-9835-01c5be6319d9-image-registry-private-configuration\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.843214 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.843189 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nbkw\" (UniqueName: \"kubernetes.io/projected/a76db812-d3c4-4fdc-9835-01c5be6319d9-kube-api-access-4nbkw\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.843504 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.843483 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a76db812-d3c4-4fdc-9835-01c5be6319d9-bound-sa-token\") pod \"image-registry-7445cd6d48-ngvsb\" (UID: \"a76db812-d3c4-4fdc-9835-01c5be6319d9\") " pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.852233 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.852211 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-qzb4x" Jun 09 15:06:40.887811 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.887780 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dgl42"] Jun 09 15:06:40.957747 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.957716 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:40.983159 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:40.983129 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-qzb4x"] Jun 09 15:06:40.986545 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:06:40.986517 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7207a032_507d_4078_bcc3_c77cf9e190a7.slice/crio-6bdd3ee1ffb51e95947684257d356aded43c322b40de940faa640c6d6de0bb66 WatchSource:0}: Error finding container 6bdd3ee1ffb51e95947684257d356aded43c322b40de940faa640c6d6de0bb66: Status 404 returned error can't find the container with id 6bdd3ee1ffb51e95947684257d356aded43c322b40de940faa640c6d6de0bb66 Jun 09 15:06:41.085953 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:41.085870 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7445cd6d48-ngvsb"] Jun 09 15:06:41.088481 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:06:41.088460 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76db812_d3c4_4fdc_9835_01c5be6319d9.slice/crio-12789e3cb93bc2eb432b9a3210c73f4f53e37dcee31bcb244ec4f85aa0a69cf9 WatchSource:0}: Error finding container 12789e3cb93bc2eb432b9a3210c73f4f53e37dcee31bcb244ec4f85aa0a69cf9: Status 404 returned error can't find the container with id 12789e3cb93bc2eb432b9a3210c73f4f53e37dcee31bcb244ec4f85aa0a69cf9 Jun 09 15:06:41.144860 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:41.144836 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:41.191585 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:41.191546 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dgl42" event={"ID":"2d12388a-f2be-4278-8650-2a5c8b4b2f04","Type":"ContainerStarted","Data":"b6c7e06921ae7211e4c5c7355a07ad487308b52cd0ea8926a65cc3cdc920d11c"} Jun 09 15:06:41.191762 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:41.191633 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dgl42" event={"ID":"2d12388a-f2be-4278-8650-2a5c8b4b2f04","Type":"ContainerStarted","Data":"602593c7b484d9e61115ce3505d1dbe25fb43c3889bf53296d90dda8d2de0a30"} Jun 09 15:06:41.192960 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:41.192940 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" event={"ID":"a76db812-d3c4-4fdc-9835-01c5be6319d9","Type":"ContainerStarted","Data":"2c00873462b11e3b2a449db55e9563a9ca7fc069b7f8d442cc828ff8d863778e"} Jun 09 15:06:41.193029 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:41.192978 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" event={"ID":"a76db812-d3c4-4fdc-9835-01c5be6319d9","Type":"ContainerStarted","Data":"12789e3cb93bc2eb432b9a3210c73f4f53e37dcee31bcb244ec4f85aa0a69cf9"} Jun 09 15:06:41.193080 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:41.193055 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:06:41.194113 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:41.194096 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-qzb4x" event={"ID":"7207a032-507d-4078-bcc3-c77cf9e190a7","Type":"ContainerStarted","Data":"6bdd3ee1ffb51e95947684257d356aded43c322b40de940faa640c6d6de0bb66"} Jun 09 15:06:41.214830 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:41.214779 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" podStartSLOduration=1.214761756 podStartE2EDuration="1.214761756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:06:41.212771885 +0000 UTC m=+259.277346333" watchObservedRunningTime="2026-06-09 15:06:41.214761756 +0000 UTC m=+259.279336224" Jun 09 15:06:41.217385 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:41.217360 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:41.524287 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:41.524215 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:41.622242 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:41.622209 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:42.199145 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:42.199103 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dgl42" event={"ID":"2d12388a-f2be-4278-8650-2a5c8b4b2f04","Type":"ContainerStarted","Data":"f34f6d16c7f5260b6ee0c77c23ad136c27d1c6f6b0614234905ecfcdb6799bf3"} Jun 09 15:06:44.207460 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:44.207423 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dgl42" event={"ID":"2d12388a-f2be-4278-8650-2a5c8b4b2f04","Type":"ContainerStarted","Data":"9b969a5737574171d61ec54956feb2257569497cac05a72e077972270f2088b5"} Jun 09 15:06:44.224937 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:44.224880 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dgl42" podStartSLOduration=1.9744434100000001 podStartE2EDuration="4.224860755s" totalImagesPullingTime="2.250417345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:06:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:06:44.22316359 +0000 UTC m=+262.287738040" watchObservedRunningTime="2026-06-09 15:06:44.224860755 +0000 UTC m=+262.289435205" Jun 09 15:06:49.845571 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:49.845508 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:49.947186 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:49.947155 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:50.019301 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:50.019270 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:50.296560 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:50.296521 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:53.028062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:53.027994 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:53.091680 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:53.091646 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:53.164486 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:53.164454 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:54.966364 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:54.966335 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:55.928051 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:55.928017 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:56.031832 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.031797 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:56.518244 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.518211 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84ccf6b5db-vxqn4"] Jun 09 15:06:56.520903 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.520884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.523531 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.523503 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 15:06:56.523674 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.523566 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2phvh\"" Jun 09 15:06:56.523674 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.523634 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 15:06:56.523674 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.523656 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 15:06:56.523824 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.523678 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 15:06:56.523824 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.523509 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 15:06:56.530776 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.530752 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 15:06:56.532364 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.532345 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84ccf6b5db-vxqn4"] Jun 09 15:06:56.553396 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.553372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-serving-cert\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.553528 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.553400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-config\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.553528 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.553418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-service-ca\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.553528 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.553432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-oauth-serving-cert\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.553528 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.553487 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-trusted-ca-bundle\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.553687 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.553532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hqcp\" (UniqueName: \"kubernetes.io/projected/2477ceeb-c175-4fbd-98be-b39d539ecfe8-kube-api-access-7hqcp\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.553687 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.553547 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-oauth-config\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.568112 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.568074 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:56.628173 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.628109 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:56.654872 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.654834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-serving-cert\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.654872 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.654870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-config\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.655097 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.654890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-service-ca\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.655097 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.654912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-oauth-serving-cert\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.655097 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.654951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-trusted-ca-bundle\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.655097 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.655019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hqcp\" (UniqueName: \"kubernetes.io/projected/2477ceeb-c175-4fbd-98be-b39d539ecfe8-kube-api-access-7hqcp\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.655097 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.655042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-oauth-config\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.655690 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.655660 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-service-ca\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.655834 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.655733 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-oauth-serving-cert\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.655834 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.655733 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-config\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.655967 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.655869 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-trusted-ca-bundle\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.657432 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.657409 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-serving-cert\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.657586 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.657570 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-oauth-config\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.663474 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.663451 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hqcp\" (UniqueName: \"kubernetes.io/projected/2477ceeb-c175-4fbd-98be-b39d539ecfe8-kube-api-access-7hqcp\") pod \"console-84ccf6b5db-vxqn4\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.832068 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.831962 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:06:56.977945 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:56.977912 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84ccf6b5db-vxqn4"] Jun 09 15:06:56.981126 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:06:56.981093 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2477ceeb_c175_4fbd_98be_b39d539ecfe8.slice/crio-f56245f6a9f66702ceeb53cb06d04659d3738f69ac0510c96e62721a35ddddc0 WatchSource:0}: Error finding container f56245f6a9f66702ceeb53cb06d04659d3738f69ac0510c96e62721a35ddddc0: Status 404 returned error can't find the container with id f56245f6a9f66702ceeb53cb06d04659d3738f69ac0510c96e62721a35ddddc0 Jun 09 15:06:57.187709 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.187570 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:57.249396 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.249359 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ccf6b5db-vxqn4" event={"ID":"2477ceeb-c175-4fbd-98be-b39d539ecfe8","Type":"ContainerStarted","Data":"f56245f6a9f66702ceeb53cb06d04659d3738f69ac0510c96e62721a35ddddc0"} Jun 09 15:06:57.378966 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.378937 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:57.437430 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.437402 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-llq29"] Jun 09 15:06:57.440638 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.440564 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.444195 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.444170 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 15:06:57.444546 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.444529 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 15:06:57.444680 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.444532 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 15:06:57.444680 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.444532 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 15:06:57.445172 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.445155 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-thkmx\"" Jun 09 15:06:57.445263 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.445187 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 15:06:57.445325 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.445286 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 15:06:57.451884 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.451862 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx"] Jun 09 15:06:57.454204 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.454184 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.456682 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.456597 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 15:06:57.456784 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.456679 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 15:06:57.456784 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.456728 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 15:06:57.456784 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.456772 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xp7wf\"" Jun 09 15:06:57.470174 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.470153 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx"] Jun 09 15:06:57.482254 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.482233 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:57.552210 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.552177 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:57.561895 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.561864 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhs5c\" (UniqueName: \"kubernetes.io/projected/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-api-access-xhs5c\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.562044 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.561907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.562044 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.561930 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e46dded0-899e-4dfb-8535-f8eb08c8872a-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.562044 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.562016 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-wtmp\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.562182 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.562053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-textfile\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.562182 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.562118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-tls\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.562182 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.562142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-sys\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.562182 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.562160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-metrics-client-ca\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.562377 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.562216 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-accelerators-collector-config\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.562377 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.562250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhhsf\" (UniqueName: \"kubernetes.io/projected/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-kube-api-access-mhhsf\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.562377 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.562277 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e46dded0-899e-4dfb-8535-f8eb08c8872a-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.562377 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.562313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.562377 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.562342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.562563 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.562392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-root\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.562563 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.562424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-textfile\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-tls\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-sys\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-metrics-client-ca\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-accelerators-collector-config\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhsf\" (UniqueName: \"kubernetes.io/projected/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-kube-api-access-mhhsf\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e46dded0-899e-4dfb-8535-f8eb08c8872a-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663795 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-root\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhs5c\" (UniqueName: \"kubernetes.io/projected/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-api-access-xhs5c\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.663985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e46dded0-899e-4dfb-8535-f8eb08c8872a-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.664007 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-textfile\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.664405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.664158 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-wtmp\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.665521 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.664017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-wtmp\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.665521 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:06:57.664225 2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 09 15:06:57.665521 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:06:57.664329 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-state-metrics-tls podName:e46dded0-899e-4dfb-8535-f8eb08c8872a nodeName:}" failed. No retries permitted until 2026-06-09 15:06:58.164306886 +0000 UTC m=+276.228881319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-dnswx" (UID: "e46dded0-899e-4dfb-8535-f8eb08c8872a") : secret "kube-state-metrics-tls" not found Jun 09 15:06:57.665521 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.664849 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-accelerators-collector-config\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.665521 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.664895 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-root\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.665521 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.665166 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e46dded0-899e-4dfb-8535-f8eb08c8872a-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.665521 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.665235 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-sys\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.665521 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.665290 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-metrics-client-ca\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.665521 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.665503 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.666147 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.665753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e46dded0-899e-4dfb-8535-f8eb08c8872a-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.668569 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.668542 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.669906 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.669883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-node-exporter-tls\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.670697 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.670671 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.681722 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.681666 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhhsf\" (UniqueName: \"kubernetes.io/projected/2477b750-9ef5-4d46-8b86-eda6cd19ffdb-kube-api-access-mhhsf\") pod \"node-exporter-llq29\" (UID: \"2477b750-9ef5-4d46-8b86-eda6cd19ffdb\") " pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.683850 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.682673 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhs5c\" (UniqueName: \"kubernetes.io/projected/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-api-access-xhs5c\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:57.723216 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.723181 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:57.751622 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.751578 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llq29" Jun 09 15:06:57.762922 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:06:57.762891 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2477b750_9ef5_4d46_8b86_eda6cd19ffdb.slice/crio-3cc4bfcc35384e69837474ad8f74c70b4f8cbf54488bcac06875d8ded6c057c6 WatchSource:0}: Error finding container 3cc4bfcc35384e69837474ad8f74c70b4f8cbf54488bcac06875d8ded6c057c6: Status 404 returned error can't find the container with id 3cc4bfcc35384e69837474ad8f74c70b4f8cbf54488bcac06875d8ded6c057c6 Jun 09 15:06:57.815584 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.815530 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:57.915281 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:57.915233 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:58.106424 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:58.106340 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:58.168704 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:58.168668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:58.171379 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:58.171353 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e46dded0-899e-4dfb-8535-f8eb08c8872a-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-dnswx\" (UID: \"e46dded0-899e-4dfb-8535-f8eb08c8872a\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:58.254185 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:58.254140 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llq29" event={"ID":"2477b750-9ef5-4d46-8b86-eda6cd19ffdb","Type":"ContainerStarted","Data":"3cc4bfcc35384e69837474ad8f74c70b4f8cbf54488bcac06875d8ded6c057c6"} Jun 09 15:06:58.364969 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:58.364891 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" Jun 09 15:06:58.410375 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:58.410342 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:58.496529 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:58.496494 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:58.835087 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:58.835051 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:06:59.154836 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:06:59.154735 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" podUID="5a305486-de66-4c01-8326-4211e0846c39" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 15:07:00.116434 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:00.116398 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:00.216860 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:00.216828 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:00.350211 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:00.350178 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:00.451665 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:00.451592 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:00.708370 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:00.708295 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:00.908851 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:00.908814 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:00.963253 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:00.963166 2577 patch_prober.go:28] interesting pod/image-registry-7445cd6d48-ngvsb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:07:00.963421 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:00.963242 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" podUID="a76db812-d3c4-4fdc-9835-01c5be6319d9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:07:02.122914 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.122875 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:02.203032 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.202944 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs"] Jun 09 15:07:02.203218 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.203087 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:02.204410 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.204384 2577 patch_prober.go:28] interesting pod/image-registry-7445cd6d48-ngvsb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:07:02.204686 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.204429 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" podUID="a76db812-d3c4-4fdc-9835-01c5be6319d9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:07:02.205269 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.205241 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs" Jun 09 15:07:02.207227 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.207202 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 15:07:02.207329 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.207278 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zrwq2\"" Jun 09 15:07:02.213276 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.213253 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs"] Jun 09 15:07:02.306760 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.306727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39caef52-48e7-4579-87dd-83626270df26-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-6cbbs\" (UID: \"39caef52-48e7-4579-87dd-83626270df26\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs" Jun 09 15:07:02.306760 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.306768 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wjv8\" (UniqueName: \"kubernetes.io/projected/39caef52-48e7-4579-87dd-83626270df26-kube-api-access-8wjv8\") pod \"monitoring-plugin-76b68cc874-6cbbs\" (UID: \"39caef52-48e7-4579-87dd-83626270df26\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs" Jun 09 15:07:02.323687 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.323653 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:02.407621 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.407514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39caef52-48e7-4579-87dd-83626270df26-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-6cbbs\" (UID: \"39caef52-48e7-4579-87dd-83626270df26\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs" Jun 09 15:07:02.407621 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.407571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wjv8\" (UniqueName: \"kubernetes.io/projected/39caef52-48e7-4579-87dd-83626270df26-kube-api-access-8wjv8\") pod \"monitoring-plugin-76b68cc874-6cbbs\" (UID: \"39caef52-48e7-4579-87dd-83626270df26\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs" Jun 09 15:07:02.410281 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.410255 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39caef52-48e7-4579-87dd-83626270df26-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-6cbbs\" (UID: \"39caef52-48e7-4579-87dd-83626270df26\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs" Jun 09 15:07:02.416471 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.416440 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wjv8\" (UniqueName: \"kubernetes.io/projected/39caef52-48e7-4579-87dd-83626270df26-kube-api-access-8wjv8\") pod \"monitoring-plugin-76b68cc874-6cbbs\" (UID: \"39caef52-48e7-4579-87dd-83626270df26\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs" Jun 09 15:07:02.421789 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.421755 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:02.516839 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:02.516800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs" Jun 09 15:07:02.903182 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:07:02.903126 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lg9b8" podUID="3dda6239-4344-4d5f-91b7-fc9a0a6597c2" Jun 09 15:07:03.272109 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:03.272076 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lg9b8" Jun 09 15:07:03.666593 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:03.666481 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:05.522116 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:05.522073 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:05.622884 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:05.622833 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:06.283295 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:06.283257 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs"] Jun 09 15:07:06.304858 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:06.304821 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx"] Jun 09 15:07:06.368460 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:07:06.368422 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39caef52_48e7_4579_87dd_83626270df26.slice/crio-ccf80b3d312306d3e615fd5042fddf502c0f0897c3b5587f1c0ac83329280978 WatchSource:0}: Error finding container ccf80b3d312306d3e615fd5042fddf502c0f0897c3b5587f1c0ac83329280978: Status 404 returned error can't find the container with id ccf80b3d312306d3e615fd5042fddf502c0f0897c3b5587f1c0ac83329280978 Jun 09 15:07:06.368935 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:07:06.368915 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46dded0_899e_4dfb_8535_f8eb08c8872a.slice/crio-3d8fd441c8abb6d19f72f5c89e3f458fb4a93f429543b95b5f267a3bd61e6c35 WatchSource:0}: Error finding container 3d8fd441c8abb6d19f72f5c89e3f458fb4a93f429543b95b5f267a3bd61e6c35: Status 404 returned error can't find the container with id 3d8fd441c8abb6d19f72f5c89e3f458fb4a93f429543b95b5f267a3bd61e6c35 Jun 09 15:07:06.741110 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:06.741066 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:07:06.743949 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:06.743916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3dda6239-4344-4d5f-91b7-fc9a0a6597c2-metrics-tls\") pod \"dns-default-lg9b8\" (UID: \"3dda6239-4344-4d5f-91b7-fc9a0a6597c2\") " pod="openshift-dns/dns-default-lg9b8" Jun 09 15:07:06.875298 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:06.875074 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q8xkg\"" Jun 09 15:07:06.883003 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:06.882968 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lg9b8" Jun 09 15:07:07.071734 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:07.071649 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lg9b8"] Jun 09 15:07:07.079813 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:07:07.079775 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dda6239_4344_4d5f_91b7_fc9a0a6597c2.slice/crio-30fb18c236da4e7c4041b96e7489a6ec74fdcce596d001248667e5d3419764ac WatchSource:0}: Error finding container 30fb18c236da4e7c4041b96e7489a6ec74fdcce596d001248667e5d3419764ac: Status 404 returned error can't find the container with id 30fb18c236da4e7c4041b96e7489a6ec74fdcce596d001248667e5d3419764ac Jun 09 15:07:07.294678 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:07.294442 2577 generic.go:356] "Generic (PLEG): container finished" podID="2477b750-9ef5-4d46-8b86-eda6cd19ffdb" containerID="77e1b4147d29aa66ba2b4752622f87577d445de7bb35e862d820cf225e34fc02" exitCode=0 Jun 09 15:07:07.294678 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:07.294564 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llq29" event={"ID":"2477b750-9ef5-4d46-8b86-eda6cd19ffdb","Type":"ContainerDied","Data":"77e1b4147d29aa66ba2b4752622f87577d445de7bb35e862d820cf225e34fc02"} Jun 09 15:07:07.297841 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:07.297722 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" event={"ID":"e46dded0-899e-4dfb-8535-f8eb08c8872a","Type":"ContainerStarted","Data":"3d8fd441c8abb6d19f72f5c89e3f458fb4a93f429543b95b5f267a3bd61e6c35"} Jun 09 15:07:07.301201 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:07.301142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-qzb4x" event={"ID":"7207a032-507d-4078-bcc3-c77cf9e190a7","Type":"ContainerStarted","Data":"ada997dbb496eb5a8a46e1b4920903d9f2f5eb80bda75b3022c72356b408aa21"} Jun 09 15:07:07.303432 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:07.301545 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-qzb4x" Jun 09 15:07:07.303432 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:07.302842 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs" event={"ID":"39caef52-48e7-4579-87dd-83626270df26","Type":"ContainerStarted","Data":"ccf80b3d312306d3e615fd5042fddf502c0f0897c3b5587f1c0ac83329280978"} Jun 09 15:07:07.305204 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:07.305153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ccf6b5db-vxqn4" event={"ID":"2477ceeb-c175-4fbd-98be-b39d539ecfe8","Type":"ContainerStarted","Data":"35b7d54f6bd4f5006b7df7466132932057933231bd95c988908cb86f44974d9c"} Jun 09 15:07:07.306656 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:07.306591 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lg9b8" event={"ID":"3dda6239-4344-4d5f-91b7-fc9a0a6597c2","Type":"ContainerStarted","Data":"30fb18c236da4e7c4041b96e7489a6ec74fdcce596d001248667e5d3419764ac"} Jun 09 15:07:07.314693 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:07.314667 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-qzb4x" Jun 09 15:07:07.353022 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:07.352064 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-qzb4x" podStartSLOduration=1.971522889 podStartE2EDuration="27.352041959s" totalImagesPullingTime="25.38051907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:07:07.334736785 +0000 UTC m=+285.399311237" watchObservedRunningTime="2026-06-09 15:07:07.352041959 +0000 UTC m=+285.416616606" Jun 09 15:07:08.317257 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:08.316319 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llq29" event={"ID":"2477b750-9ef5-4d46-8b86-eda6cd19ffdb","Type":"ContainerStarted","Data":"08b953c3efeea59721c5b280567024c43f5f5498477d9bb7b40cc9946918b9bb"} Jun 09 15:07:08.317257 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:08.316421 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llq29" event={"ID":"2477b750-9ef5-4d46-8b86-eda6cd19ffdb","Type":"ContainerStarted","Data":"bda8730b4b0b767e1f188988d8836ce9b7cf1a4e41aa2aff7b4a5940bd9399d1"} Jun 09 15:07:08.320144 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:08.319747 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" event={"ID":"e46dded0-899e-4dfb-8535-f8eb08c8872a","Type":"ContainerStarted","Data":"06ea678bcdb3eebcc570a2c78ac97434ab3f2f7a97870e9d8f837fc29c2b5c5b"} Jun 09 15:07:08.320144 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:08.319803 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" event={"ID":"e46dded0-899e-4dfb-8535-f8eb08c8872a","Type":"ContainerStarted","Data":"2c57689110c8b01eb1d1aecae43d739b083adc8f7a24646f03bc6f69f6d83f64"} Jun 09 15:07:08.336411 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:08.336352 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84ccf6b5db-vxqn4" podStartSLOduration=2.949980422 podStartE2EDuration="12.336330737s" totalImagesPullingTime="9.386350315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:07:07.353693391 +0000 UTC m=+285.418267845" watchObservedRunningTime="2026-06-09 15:07:08.336330737 +0000 UTC m=+286.400905190" Jun 09 15:07:08.336803 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:08.336763 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-llq29" podStartSLOduration=2.628036571 podStartE2EDuration="11.336748316s" totalImagesPullingTime="8.641122731s" totalInitContainerRuntime="67.589014ms" isStatefulPod=true podCreationTimestamp="2026-06-09 15:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:07:08.335403995 +0000 UTC m=+286.399978458" watchObservedRunningTime="2026-06-09 15:07:08.336748316 +0000 UTC m=+286.401322769" Jun 09 15:07:09.155073 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:09.154983 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" podUID="5a305486-de66-4c01-8326-4211e0846c39" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 15:07:09.325436 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:09.325393 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs" event={"ID":"39caef52-48e7-4579-87dd-83626270df26","Type":"ContainerStarted","Data":"77f5b4994de186a79a75bbecc3920572465b022356f335e4b29f4090c0a090bf"} Jun 09 15:07:09.325910 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:09.325465 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs" Jun 09 15:07:09.328089 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:09.328065 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" event={"ID":"e46dded0-899e-4dfb-8535-f8eb08c8872a","Type":"ContainerStarted","Data":"eb76c1fbd9a8df0d5fae3f8815ec9a96f98699289844638f4722461b82abcf58"} Jun 09 15:07:09.332345 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:09.332323 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs" Jun 09 15:07:09.341148 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:09.341104 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6cbbs" podStartSLOduration=4.958489005 podStartE2EDuration="7.341086014s" totalImagesPullingTime="2.382597009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:07:09.340160884 +0000 UTC m=+287.404735347" watchObservedRunningTime="2026-06-09 15:07:09.341086014 +0000 UTC m=+287.405660444" Jun 09 15:07:09.375209 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:09.375153 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dnswx" podStartSLOduration=11.048671046 podStartE2EDuration="12.375130096s" totalImagesPullingTime="1.32645905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:07:09.37368897 +0000 UTC m=+287.438263422" watchObservedRunningTime="2026-06-09 15:07:09.375130096 +0000 UTC m=+287.439704560" Jun 09 15:07:10.962499 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:10.962459 2577 patch_prober.go:28] interesting pod/image-registry-7445cd6d48-ngvsb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:07:10.963001 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:10.962526 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" podUID="a76db812-d3c4-4fdc-9835-01c5be6319d9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:07:10.989142 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:10.989106 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:11.089119 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:11.089087 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:11.214929 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:11.214855 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:11.338881 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:11.338745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lg9b8" event={"ID":"3dda6239-4344-4d5f-91b7-fc9a0a6597c2","Type":"ContainerStarted","Data":"23348c8dc1bb4dce7e4cc1daca4fb57f797c0492f53d476f0e5a86293b516f2e"} Jun 09 15:07:11.338881 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:11.338844 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lg9b8" event={"ID":"3dda6239-4344-4d5f-91b7-fc9a0a6597c2","Type":"ContainerStarted","Data":"c34a93508479b8789423adecd761f244522f61a6bd8e21a4e79e44f38a17380c"} Jun 09 15:07:11.358666 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:11.358202 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lg9b8" podStartSLOduration=251.455037086 podStartE2EDuration="4m15.358151742s" totalImagesPullingTime="3.903114656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:07:11.356393246 +0000 UTC m=+289.420967697" watchObservedRunningTime="2026-06-09 15:07:11.358151742 +0000 UTC m=+289.422726194" Jun 09 15:07:12.204281 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:12.204251 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7445cd6d48-ngvsb" Jun 09 15:07:12.326720 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:12.326683 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:12.342966 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:12.342939 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lg9b8" Jun 09 15:07:12.427153 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:12.427119 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:12.527721 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:12.527633 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:12.581967 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:12.581927 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:15.712938 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:15.712370 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84ccf6b5db-vxqn4"] Jun 09 15:07:15.936135 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:15.936096 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:16.025124 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:16.025047 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:16.832506 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:16.832466 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:07:17.104367 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:17.104290 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:17.205066 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:17.205022 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:17.584529 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:17.584503 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:18.335460 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:18.335426 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:18.435777 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:18.435742 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:19.155377 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:19.155344 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" podUID="5a305486-de66-4c01-8326-4211e0846c39" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 15:07:19.155549 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:19.155409 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" Jun 09 15:07:19.155900 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:19.155870 2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"37d99c6e73457f5a7dc76d4140185e590a1a6aee8f4455a21b82f58895d68b43"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 15:07:19.155980 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:19.155919 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" podUID="5a305486-de66-4c01-8326-4211e0846c39" containerName="service-proxy" containerID="cri-o://37d99c6e73457f5a7dc76d4140185e590a1a6aee8f4455a21b82f58895d68b43" gracePeriod=30 Jun 09 15:07:19.369439 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:19.369411 2577 generic.go:356] "Generic (PLEG): container finished" podID="5a305486-de66-4c01-8326-4211e0846c39" containerID="37d99c6e73457f5a7dc76d4140185e590a1a6aee8f4455a21b82f58895d68b43" exitCode=2 Jun 09 15:07:19.369742 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:19.369464 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" event={"ID":"5a305486-de66-4c01-8326-4211e0846c39","Type":"ContainerDied","Data":"37d99c6e73457f5a7dc76d4140185e590a1a6aee8f4455a21b82f58895d68b43"} Jun 09 15:07:20.381101 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:20.378338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7698c7b6b-67zkl" event={"ID":"5a305486-de66-4c01-8326-4211e0846c39","Type":"ContainerStarted","Data":"2493e9451dd50daefbd92415b3007b177bb8b0cad688364cebb5a70a7b6e3e5e"} Jun 09 15:07:22.332876 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:22.332852 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 15:07:22.348941 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:22.348918 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lg9b8" Jun 09 15:07:22.465795 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:22.465770 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:22.573762 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:22.573732 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:25.132794 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:25.132758 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:25.232357 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:25.232325 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:26.172687 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:26.172658 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:26.226861 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:26.226831 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:35.600381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:35.600349 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:35.653920 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:35.653891 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:40.120709 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:40.120661 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:40.176228 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:40.176205 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:40.733456 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:40.733400 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-84ccf6b5db-vxqn4" podUID="2477ceeb-c175-4fbd-98be-b39d539ecfe8" containerName="console" containerID="cri-o://35b7d54f6bd4f5006b7df7466132932057933231bd95c988908cb86f44974d9c" gracePeriod=15 Jun 09 15:07:40.992196 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:40.992138 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:07:41.105345 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.105319 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-oauth-serving-cert\") pod \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " Jun 09 15:07:41.105345 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.105354 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-service-ca\") pod \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " Jun 09 15:07:41.105554 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.105409 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-oauth-config\") pod \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " Jun 09 15:07:41.105554 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.105437 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-trusted-ca-bundle\") pod \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " Jun 09 15:07:41.105554 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.105475 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-serving-cert\") pod \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " Jun 09 15:07:41.105554 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.105503 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-config\") pod \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " Jun 09 15:07:41.105554 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.105530 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hqcp\" (UniqueName: \"kubernetes.io/projected/2477ceeb-c175-4fbd-98be-b39d539ecfe8-kube-api-access-7hqcp\") pod \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\" (UID: \"2477ceeb-c175-4fbd-98be-b39d539ecfe8\") " Jun 09 15:07:41.105796 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.105749 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2477ceeb-c175-4fbd-98be-b39d539ecfe8" (UID: "2477ceeb-c175-4fbd-98be-b39d539ecfe8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:07:41.106030 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.105998 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2477ceeb-c175-4fbd-98be-b39d539ecfe8" (UID: "2477ceeb-c175-4fbd-98be-b39d539ecfe8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:07:41.106159 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.106085 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-config" (OuterVolumeSpecName: "console-config") pod "2477ceeb-c175-4fbd-98be-b39d539ecfe8" (UID: "2477ceeb-c175-4fbd-98be-b39d539ecfe8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:07:41.106159 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.106121 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-service-ca" (OuterVolumeSpecName: "service-ca") pod "2477ceeb-c175-4fbd-98be-b39d539ecfe8" (UID: "2477ceeb-c175-4fbd-98be-b39d539ecfe8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:07:41.107749 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.107721 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2477ceeb-c175-4fbd-98be-b39d539ecfe8" (UID: "2477ceeb-c175-4fbd-98be-b39d539ecfe8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:07:41.107749 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.107738 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2477ceeb-c175-4fbd-98be-b39d539ecfe8" (UID: "2477ceeb-c175-4fbd-98be-b39d539ecfe8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:07:41.107886 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.107742 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2477ceeb-c175-4fbd-98be-b39d539ecfe8-kube-api-access-7hqcp" (OuterVolumeSpecName: "kube-api-access-7hqcp") pod "2477ceeb-c175-4fbd-98be-b39d539ecfe8" (UID: "2477ceeb-c175-4fbd-98be-b39d539ecfe8"). InnerVolumeSpecName "kube-api-access-7hqcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:07:41.206380 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.206351 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-serving-cert\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:07:41.206380 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.206375 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-config\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:07:41.206380 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.206385 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hqcp\" (UniqueName: \"kubernetes.io/projected/2477ceeb-c175-4fbd-98be-b39d539ecfe8-kube-api-access-7hqcp\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:07:41.206785 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.206394 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-oauth-serving-cert\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:07:41.206785 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.206402 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-service-ca\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:07:41.206785 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.206411 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2477ceeb-c175-4fbd-98be-b39d539ecfe8-console-oauth-config\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:07:41.206785 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.206420 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2477ceeb-c175-4fbd-98be-b39d539ecfe8-trusted-ca-bundle\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:07:41.445754 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.445722 2577 generic.go:356] "Generic (PLEG): container finished" podID="2477ceeb-c175-4fbd-98be-b39d539ecfe8" containerID="35b7d54f6bd4f5006b7df7466132932057933231bd95c988908cb86f44974d9c" exitCode=0 Jun 09 15:07:41.445937 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.445765 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ccf6b5db-vxqn4" Jun 09 15:07:41.445937 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.445818 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ccf6b5db-vxqn4" event={"ID":"2477ceeb-c175-4fbd-98be-b39d539ecfe8","Type":"ContainerDied","Data":"35b7d54f6bd4f5006b7df7466132932057933231bd95c988908cb86f44974d9c"} Jun 09 15:07:41.445937 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.445868 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ccf6b5db-vxqn4" event={"ID":"2477ceeb-c175-4fbd-98be-b39d539ecfe8","Type":"ContainerDied","Data":"f56245f6a9f66702ceeb53cb06d04659d3738f69ac0510c96e62721a35ddddc0"} Jun 09 15:07:41.445937 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.445900 2577 scope.go:117] "RemoveContainer" containerID="35b7d54f6bd4f5006b7df7466132932057933231bd95c988908cb86f44974d9c" Jun 09 15:07:41.454097 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.454077 2577 scope.go:117] "RemoveContainer" containerID="35b7d54f6bd4f5006b7df7466132932057933231bd95c988908cb86f44974d9c" Jun 09 15:07:41.454385 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:07:41.454365 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35b7d54f6bd4f5006b7df7466132932057933231bd95c988908cb86f44974d9c\": container with ID starting with 35b7d54f6bd4f5006b7df7466132932057933231bd95c988908cb86f44974d9c not found: ID does not exist" containerID="35b7d54f6bd4f5006b7df7466132932057933231bd95c988908cb86f44974d9c" Jun 09 15:07:41.454442 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.454392 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35b7d54f6bd4f5006b7df7466132932057933231bd95c988908cb86f44974d9c"} err="failed to get container status \"35b7d54f6bd4f5006b7df7466132932057933231bd95c988908cb86f44974d9c\": rpc error: code = NotFound desc = could not find container \"35b7d54f6bd4f5006b7df7466132932057933231bd95c988908cb86f44974d9c\": container with ID starting with 35b7d54f6bd4f5006b7df7466132932057933231bd95c988908cb86f44974d9c not found: ID does not exist" Jun 09 15:07:41.468301 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.468276 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84ccf6b5db-vxqn4"] Jun 09 15:07:41.472971 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:41.472953 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84ccf6b5db-vxqn4"] Jun 09 15:07:42.377708 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:42.377670 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2477ceeb-c175-4fbd-98be-b39d539ecfe8" path="/var/lib/kubelet/pods/2477ceeb-c175-4fbd-98be-b39d539ecfe8/volumes" Jun 09 15:07:48.470530 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:48.470495 2577 generic.go:356] "Generic (PLEG): container finished" podID="cb4d7536-714c-4647-bc2c-a9f7bf3d2369" containerID="5a68e0be8301d5f36fea9acb67ec76348165ee7dc42056d4124079f09c300f16" exitCode=0 Jun 09 15:07:48.470967 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:48.470578 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-jp4gp" event={"ID":"cb4d7536-714c-4647-bc2c-a9f7bf3d2369","Type":"ContainerDied","Data":"5a68e0be8301d5f36fea9acb67ec76348165ee7dc42056d4124079f09c300f16"} Jun 09 15:07:48.470967 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:48.470908 2577 scope.go:117] "RemoveContainer" containerID="5a68e0be8301d5f36fea9acb67ec76348165ee7dc42056d4124079f09c300f16" Jun 09 15:07:49.485047 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:49.485001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-jp4gp" event={"ID":"cb4d7536-714c-4647-bc2c-a9f7bf3d2369","Type":"ContainerStarted","Data":"00868f51b18afeff102ec949e45f98639f607c89a7ccdc23d4fe11c4aa292d21"} Jun 09 15:07:49.524134 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:49.524100 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9l9tf_e3d76fef-ea75-4e7d-8de5-f1a607a448b6/serve-healthcheck-canary/0.log" Jun 09 15:07:57.539444 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:57.539407 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:57.640321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:57.640288 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:07:57.743428 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:07:57.743382 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:16.656688 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:16.656588 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:17.302640 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:17.302584 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:23.965278 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:23.965247 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:24.029995 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:24.029963 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:25.999364 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:25.999331 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-785566c766-zjvqt"] Jun 09 15:08:25.999820 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:25.999764 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2477ceeb-c175-4fbd-98be-b39d539ecfe8" containerName="console" Jun 09 15:08:25.999820 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:25.999783 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2477ceeb-c175-4fbd-98be-b39d539ecfe8" containerName="console" Jun 09 15:08:25.999929 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:25.999863 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2477ceeb-c175-4fbd-98be-b39d539ecfe8" containerName="console" Jun 09 15:08:26.002396 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.002377 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.004811 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.004793 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 15:08:26.004926 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.004796 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 15:08:26.005588 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.005569 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 15:08:26.005702 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.005590 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 15:08:26.005863 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.005849 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2phvh\"" Jun 09 15:08:26.005926 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.005858 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 15:08:26.010454 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.010437 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 15:08:26.016297 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.016277 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785566c766-zjvqt"] Jun 09 15:08:26.054100 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.054079 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:26.093250 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.093214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4335439d-31cf-4404-90fd-ba97e9b69c92-console-oauth-config\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.093250 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.093254 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-console-config\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.093377 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.093301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9f8v\" (UniqueName: \"kubernetes.io/projected/4335439d-31cf-4404-90fd-ba97e9b69c92-kube-api-access-c9f8v\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.093377 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.093323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4335439d-31cf-4404-90fd-ba97e9b69c92-console-serving-cert\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.093377 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.093352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-trusted-ca-bundle\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.093474 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.093407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-service-ca\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.093474 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.093439 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-oauth-serving-cert\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.194203 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.194168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-oauth-serving-cert\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.194381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.194213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4335439d-31cf-4404-90fd-ba97e9b69c92-console-oauth-config\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.194381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.194238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-console-config\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.194381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.194272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9f8v\" (UniqueName: \"kubernetes.io/projected/4335439d-31cf-4404-90fd-ba97e9b69c92-kube-api-access-c9f8v\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.194381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.194302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4335439d-31cf-4404-90fd-ba97e9b69c92-console-serving-cert\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.194381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.194348 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-trusted-ca-bundle\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.194381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.194378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-service-ca\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.195072 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.195050 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-service-ca\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.195072 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.195068 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-console-config\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.195187 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.195068 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-oauth-serving-cert\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.195305 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.195282 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-trusted-ca-bundle\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.196784 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.196764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4335439d-31cf-4404-90fd-ba97e9b69c92-console-oauth-config\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.196981 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.196963 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4335439d-31cf-4404-90fd-ba97e9b69c92-console-serving-cert\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.202386 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.202366 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9f8v\" (UniqueName: \"kubernetes.io/projected/4335439d-31cf-4404-90fd-ba97e9b69c92-kube-api-access-c9f8v\") pod \"console-785566c766-zjvqt\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.311695 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.311587 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:26.439749 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.439720 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785566c766-zjvqt"] Jun 09 15:08:26.442695 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:08:26.442668 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4335439d_31cf_4404_90fd_ba97e9b69c92.slice/crio-12aa4b7e1a450515ea2563ad8d8f7b2a9fcd178d139b01917e079701c10a0cc0 WatchSource:0}: Error finding container 12aa4b7e1a450515ea2563ad8d8f7b2a9fcd178d139b01917e079701c10a0cc0: Status 404 returned error can't find the container with id 12aa4b7e1a450515ea2563ad8d8f7b2a9fcd178d139b01917e079701c10a0cc0 Jun 09 15:08:26.608824 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.608742 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785566c766-zjvqt" event={"ID":"4335439d-31cf-4404-90fd-ba97e9b69c92","Type":"ContainerStarted","Data":"642eb6022e7b08ef8b6ceae560478292e9eeedee8c3e8f9404923d9977eee2de"} Jun 09 15:08:26.608824 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.608788 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785566c766-zjvqt" event={"ID":"4335439d-31cf-4404-90fd-ba97e9b69c92","Type":"ContainerStarted","Data":"12aa4b7e1a450515ea2563ad8d8f7b2a9fcd178d139b01917e079701c10a0cc0"} Jun 09 15:08:26.625956 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:26.625906 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-785566c766-zjvqt" podStartSLOduration=1.625890483 podStartE2EDuration="1.625890483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:08:26.624858588 +0000 UTC m=+364.689433040" watchObservedRunningTime="2026-06-09 15:08:26.625890483 +0000 UTC m=+364.690464933" Jun 09 15:08:31.112543 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:31.112509 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:31.213146 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:31.213117 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:31.947229 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:31.947180 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:32.047639 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:32.047583 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:36.311779 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.311740 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:36.312156 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.311810 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:36.316409 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.316393 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:36.645724 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.645651 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:08:36.781827 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.781796 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76995796f6-x5jgp"] Jun 09 15:08:36.783884 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.783865 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.797186 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.797166 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76995796f6-x5jgp"] Jun 09 15:08:36.878747 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.878713 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-console-config\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.878747 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.878755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-trusted-ca-bundle\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.878990 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.878829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dmw7\" (UniqueName: \"kubernetes.io/projected/216e94db-dedf-44f1-b63d-aadd76e0294f-kube-api-access-2dmw7\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.878990 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.878881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-service-ca\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.878990 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.878913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/216e94db-dedf-44f1-b63d-aadd76e0294f-console-serving-cert\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.878990 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.878978 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/216e94db-dedf-44f1-b63d-aadd76e0294f-console-oauth-config\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.879114 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.879003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-oauth-serving-cert\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.979311 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.979276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dmw7\" (UniqueName: \"kubernetes.io/projected/216e94db-dedf-44f1-b63d-aadd76e0294f-kube-api-access-2dmw7\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.979477 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.979317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-service-ca\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.979477 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.979342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/216e94db-dedf-44f1-b63d-aadd76e0294f-console-serving-cert\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.979477 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.979380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/216e94db-dedf-44f1-b63d-aadd76e0294f-console-oauth-config\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.979477 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.979401 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-oauth-serving-cert\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.979477 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.979436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-console-config\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.979764 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.979566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-trusted-ca-bundle\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.980053 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.980032 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-service-ca\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.980157 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.980125 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-oauth-serving-cert\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.980212 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.980162 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-console-config\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.980359 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.980334 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-trusted-ca-bundle\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.981881 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.981853 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/216e94db-dedf-44f1-b63d-aadd76e0294f-console-serving-cert\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.981975 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.981957 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/216e94db-dedf-44f1-b63d-aadd76e0294f-console-oauth-config\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:36.987900 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:36.987881 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dmw7\" (UniqueName: \"kubernetes.io/projected/216e94db-dedf-44f1-b63d-aadd76e0294f-kube-api-access-2dmw7\") pod \"console-76995796f6-x5jgp\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:37.092432 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:37.092394 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:37.157362 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:37.157331 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:37.214723 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:37.214558 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76995796f6-x5jgp"] Jun 09 15:08:37.217271 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:08:37.217236 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod216e94db_dedf_44f1_b63d_aadd76e0294f.slice/crio-881fc3c1b8dc3a378be3852b77c7208fda1d25b5c6d206b6505275d434dccb63 WatchSource:0}: Error finding container 881fc3c1b8dc3a378be3852b77c7208fda1d25b5c6d206b6505275d434dccb63: Status 404 returned error can't find the container with id 881fc3c1b8dc3a378be3852b77c7208fda1d25b5c6d206b6505275d434dccb63 Jun 09 15:08:37.217487 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:37.217468 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:37.651145 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:37.651053 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76995796f6-x5jgp" event={"ID":"216e94db-dedf-44f1-b63d-aadd76e0294f","Type":"ContainerStarted","Data":"b660c5151e5ee3e12f889132c8627d2d289343484df32be619e0b37c7b8dffd7"} Jun 09 15:08:37.651493 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:37.651143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76995796f6-x5jgp" event={"ID":"216e94db-dedf-44f1-b63d-aadd76e0294f","Type":"ContainerStarted","Data":"881fc3c1b8dc3a378be3852b77c7208fda1d25b5c6d206b6505275d434dccb63"} Jun 09 15:08:37.673585 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:37.673538 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76995796f6-x5jgp" podStartSLOduration=1.673524541 podStartE2EDuration="1.673524541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:08:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:08:37.672123136 +0000 UTC m=+375.736697588" watchObservedRunningTime="2026-06-09 15:08:37.673524541 +0000 UTC m=+375.738098991" Jun 09 15:08:37.758811 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:37.758781 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:37.858590 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:37.858560 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:43.787919 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:43.787886 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:43.840501 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:43.840470 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:46.724741 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:46.724711 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:46.824687 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:46.824654 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:47.093668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:47.093568 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:47.093668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:47.093644 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:47.098937 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:47.098915 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:47.689201 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:47.689173 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:08:47.734147 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:47.734117 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785566c766-zjvqt"] Jun 09 15:08:47.843048 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:47.843015 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:47.902422 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:47.902394 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:47.955053 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:47.955018 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:55.137862 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:55.137830 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:08:55.240651 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:08:55.240599 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:09:12.753998 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:12.753933 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-785566c766-zjvqt" podUID="4335439d-31cf-4404-90fd-ba97e9b69c92" containerName="console" containerID="cri-o://642eb6022e7b08ef8b6ceae560478292e9eeedee8c3e8f9404923d9977eee2de" gracePeriod=15 Jun 09 15:09:12.987726 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:12.987703 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:09:13.159071 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.158988 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-console-config\") pod \"4335439d-31cf-4404-90fd-ba97e9b69c92\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " Jun 09 15:09:13.159071 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.159029 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9f8v\" (UniqueName: \"kubernetes.io/projected/4335439d-31cf-4404-90fd-ba97e9b69c92-kube-api-access-c9f8v\") pod \"4335439d-31cf-4404-90fd-ba97e9b69c92\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " Jun 09 15:09:13.159071 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.159054 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-service-ca\") pod \"4335439d-31cf-4404-90fd-ba97e9b69c92\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " Jun 09 15:09:13.159303 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.159115 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-oauth-serving-cert\") pod \"4335439d-31cf-4404-90fd-ba97e9b69c92\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " Jun 09 15:09:13.159303 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.159154 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4335439d-31cf-4404-90fd-ba97e9b69c92-console-oauth-config\") pod \"4335439d-31cf-4404-90fd-ba97e9b69c92\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " Jun 09 15:09:13.159303 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.159178 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-trusted-ca-bundle\") pod \"4335439d-31cf-4404-90fd-ba97e9b69c92\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " Jun 09 15:09:13.159303 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.159203 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4335439d-31cf-4404-90fd-ba97e9b69c92-console-serving-cert\") pod \"4335439d-31cf-4404-90fd-ba97e9b69c92\" (UID: \"4335439d-31cf-4404-90fd-ba97e9b69c92\") " Jun 09 15:09:13.159568 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.159459 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-console-config" (OuterVolumeSpecName: "console-config") pod "4335439d-31cf-4404-90fd-ba97e9b69c92" (UID: "4335439d-31cf-4404-90fd-ba97e9b69c92"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:09:13.159687 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.159572 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-service-ca" (OuterVolumeSpecName: "service-ca") pod "4335439d-31cf-4404-90fd-ba97e9b69c92" (UID: "4335439d-31cf-4404-90fd-ba97e9b69c92"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:09:13.159687 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.159580 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4335439d-31cf-4404-90fd-ba97e9b69c92" (UID: "4335439d-31cf-4404-90fd-ba97e9b69c92"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:09:13.159775 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.159698 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4335439d-31cf-4404-90fd-ba97e9b69c92" (UID: "4335439d-31cf-4404-90fd-ba97e9b69c92"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:09:13.161320 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.161289 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4335439d-31cf-4404-90fd-ba97e9b69c92-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4335439d-31cf-4404-90fd-ba97e9b69c92" (UID: "4335439d-31cf-4404-90fd-ba97e9b69c92"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:09:13.161400 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.161345 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4335439d-31cf-4404-90fd-ba97e9b69c92-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4335439d-31cf-4404-90fd-ba97e9b69c92" (UID: "4335439d-31cf-4404-90fd-ba97e9b69c92"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:09:13.161400 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.161356 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4335439d-31cf-4404-90fd-ba97e9b69c92-kube-api-access-c9f8v" (OuterVolumeSpecName: "kube-api-access-c9f8v") pod "4335439d-31cf-4404-90fd-ba97e9b69c92" (UID: "4335439d-31cf-4404-90fd-ba97e9b69c92"). InnerVolumeSpecName "kube-api-access-c9f8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:09:13.260093 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.260056 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4335439d-31cf-4404-90fd-ba97e9b69c92-console-oauth-config\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:09:13.260093 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.260099 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-trusted-ca-bundle\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:09:13.260293 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.260113 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4335439d-31cf-4404-90fd-ba97e9b69c92-console-serving-cert\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:09:13.260293 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.260125 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-console-config\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:09:13.260293 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.260138 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9f8v\" (UniqueName: \"kubernetes.io/projected/4335439d-31cf-4404-90fd-ba97e9b69c92-kube-api-access-c9f8v\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:09:13.260293 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.260153 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-service-ca\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:09:13.260293 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.260164 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4335439d-31cf-4404-90fd-ba97e9b69c92-oauth-serving-cert\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:09:13.775697 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.775661 2577 generic.go:356] "Generic (PLEG): container finished" podID="4335439d-31cf-4404-90fd-ba97e9b69c92" containerID="642eb6022e7b08ef8b6ceae560478292e9eeedee8c3e8f9404923d9977eee2de" exitCode=0 Jun 09 15:09:13.776150 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.775709 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785566c766-zjvqt" Jun 09 15:09:13.776150 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.775745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785566c766-zjvqt" event={"ID":"4335439d-31cf-4404-90fd-ba97e9b69c92","Type":"ContainerDied","Data":"642eb6022e7b08ef8b6ceae560478292e9eeedee8c3e8f9404923d9977eee2de"} Jun 09 15:09:13.776150 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.775796 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785566c766-zjvqt" event={"ID":"4335439d-31cf-4404-90fd-ba97e9b69c92","Type":"ContainerDied","Data":"12aa4b7e1a450515ea2563ad8d8f7b2a9fcd178d139b01917e079701c10a0cc0"} Jun 09 15:09:13.776150 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.775817 2577 scope.go:117] "RemoveContainer" containerID="642eb6022e7b08ef8b6ceae560478292e9eeedee8c3e8f9404923d9977eee2de" Jun 09 15:09:13.783776 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.783673 2577 scope.go:117] "RemoveContainer" containerID="642eb6022e7b08ef8b6ceae560478292e9eeedee8c3e8f9404923d9977eee2de" Jun 09 15:09:13.783952 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:09:13.783935 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"642eb6022e7b08ef8b6ceae560478292e9eeedee8c3e8f9404923d9977eee2de\": container with ID starting with 642eb6022e7b08ef8b6ceae560478292e9eeedee8c3e8f9404923d9977eee2de not found: ID does not exist" containerID="642eb6022e7b08ef8b6ceae560478292e9eeedee8c3e8f9404923d9977eee2de" Jun 09 15:09:13.784014 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.783964 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"642eb6022e7b08ef8b6ceae560478292e9eeedee8c3e8f9404923d9977eee2de"} err="failed to get container status \"642eb6022e7b08ef8b6ceae560478292e9eeedee8c3e8f9404923d9977eee2de\": rpc error: code = NotFound desc = could not find container \"642eb6022e7b08ef8b6ceae560478292e9eeedee8c3e8f9404923d9977eee2de\": container with ID starting with 642eb6022e7b08ef8b6ceae560478292e9eeedee8c3e8f9404923d9977eee2de not found: ID does not exist" Jun 09 15:09:13.796399 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.796379 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785566c766-zjvqt"] Jun 09 15:09:13.801909 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:13.801890 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-785566c766-zjvqt"] Jun 09 15:09:14.377307 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:14.377264 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4335439d-31cf-4404-90fd-ba97e9b69c92" path="/var/lib/kubelet/pods/4335439d-31cf-4404-90fd-ba97e9b69c92/volumes" Jun 09 15:09:19.684858 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:19.684821 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:09:19.752056 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:09:19.752022 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:10:45.833487 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:10:45.833456 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:11:13.946911 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:11:13.946874 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:11:21.040762 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:11:21.040723 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:11:21.139784 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:11:21.139753 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:11:53.446149 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:11:53.446102 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:11:54.812033 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:11:54.811995 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:11:57.865743 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:11:57.865712 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:11:58.006994 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:11:58.006961 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:11:59.007135 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:11:59.007104 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:11:59.334948 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:11:59.334856 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:11:59.561481 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:11:59.561454 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:11:59.717511 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:11:59.717471 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:02.402558 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:02.402502 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:02.646160 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:02.646125 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:03.840269 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:03.840237 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:03.967982 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:03.967943 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:09.417144 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:09.417111 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:10.424977 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.424944 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-wfskm"] Jun 09 15:12:10.425339 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.425194 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4335439d-31cf-4404-90fd-ba97e9b69c92" containerName="console" Jun 09 15:12:10.425339 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.425204 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4335439d-31cf-4404-90fd-ba97e9b69c92" containerName="console" Jun 09 15:12:10.425339 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.425255 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4335439d-31cf-4404-90fd-ba97e9b69c92" containerName="console" Jun 09 15:12:10.429177 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.427859 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-wfskm" Jun 09 15:12:10.431437 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.431412 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-h2vmm\"" Jun 09 15:12:10.431547 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.431530 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 15:12:10.431819 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.431800 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 15:12:10.440861 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.440833 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-wfskm"] Jun 09 15:12:10.568990 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.568957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsrbk\" (UniqueName: \"kubernetes.io/projected/80c32459-ee00-4420-9651-db5e7b751716-kube-api-access-nsrbk\") pod \"cert-manager-59c77684cc-wfskm\" (UID: \"80c32459-ee00-4420-9651-db5e7b751716\") " pod="cert-manager/cert-manager-59c77684cc-wfskm" Jun 09 15:12:10.569156 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.569008 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80c32459-ee00-4420-9651-db5e7b751716-bound-sa-token\") pod \"cert-manager-59c77684cc-wfskm\" (UID: \"80c32459-ee00-4420-9651-db5e7b751716\") " pod="cert-manager/cert-manager-59c77684cc-wfskm" Jun 09 15:12:10.669964 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.669929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80c32459-ee00-4420-9651-db5e7b751716-bound-sa-token\") pod \"cert-manager-59c77684cc-wfskm\" (UID: \"80c32459-ee00-4420-9651-db5e7b751716\") " pod="cert-manager/cert-manager-59c77684cc-wfskm" Jun 09 15:12:10.670131 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.669993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsrbk\" (UniqueName: \"kubernetes.io/projected/80c32459-ee00-4420-9651-db5e7b751716-kube-api-access-nsrbk\") pod \"cert-manager-59c77684cc-wfskm\" (UID: \"80c32459-ee00-4420-9651-db5e7b751716\") " pod="cert-manager/cert-manager-59c77684cc-wfskm" Jun 09 15:12:10.680338 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.680272 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsrbk\" (UniqueName: \"kubernetes.io/projected/80c32459-ee00-4420-9651-db5e7b751716-kube-api-access-nsrbk\") pod \"cert-manager-59c77684cc-wfskm\" (UID: \"80c32459-ee00-4420-9651-db5e7b751716\") " pod="cert-manager/cert-manager-59c77684cc-wfskm" Jun 09 15:12:10.680577 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.680560 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80c32459-ee00-4420-9651-db5e7b751716-bound-sa-token\") pod \"cert-manager-59c77684cc-wfskm\" (UID: \"80c32459-ee00-4420-9651-db5e7b751716\") " pod="cert-manager/cert-manager-59c77684cc-wfskm" Jun 09 15:12:10.737757 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.737712 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-wfskm" Jun 09 15:12:10.881732 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.881667 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-wfskm"] Jun 09 15:12:10.883816 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:12:10.883793 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80c32459_ee00_4420_9651_db5e7b751716.slice/crio-c2c35689b0dbb8627780de6cd9915d7a8a16f5c132398346c4b83bf2a988f64c WatchSource:0}: Error finding container c2c35689b0dbb8627780de6cd9915d7a8a16f5c132398346c4b83bf2a988f64c: Status 404 returned error can't find the container with id c2c35689b0dbb8627780de6cd9915d7a8a16f5c132398346c4b83bf2a988f64c Jun 09 15:12:10.885736 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:10.885722 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:12:11.382766 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:11.382726 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-wfskm" event={"ID":"80c32459-ee00-4420-9651-db5e7b751716","Type":"ContainerStarted","Data":"c2c35689b0dbb8627780de6cd9915d7a8a16f5c132398346c4b83bf2a988f64c"} Jun 09 15:12:14.393508 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:14.393473 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-wfskm" event={"ID":"80c32459-ee00-4420-9651-db5e7b751716","Type":"ContainerStarted","Data":"eff3b937835ecde0d133ac90604ac8b2daa1f5ec1736e87d8b0b7d168875b8b8"} Jun 09 15:12:14.413742 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:14.413693 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-wfskm" podStartSLOduration=1.55655923 podStartE2EDuration="4.413677389s" totalImagesPullingTime="2.857118159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:12:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:12:14.41222411 +0000 UTC m=+592.476798562" watchObservedRunningTime="2026-06-09 15:12:14.413677389 +0000 UTC m=+592.478251840" Jun 09 15:12:21.621114 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:21.621077 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:21.804418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:21.804395 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:23.548282 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:23.548248 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:23.623061 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:23.623034 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:24.202532 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:24.202503 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:26.808796 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:26.808762 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:26.923928 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:26.923895 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:27.722987 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:27.722955 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:27.849426 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:27.849384 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:29.527963 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:29.527934 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:37.765908 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:37.765875 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:37.856730 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:37.856698 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:41.411045 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:41.411014 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:41.541407 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:41.541377 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:41.748236 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:41.748209 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:41.922634 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:41.922558 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:41.937653 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:41.937625 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg"] Jun 09 15:12:41.939730 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:41.939713 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:41.950045 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:41.950030 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pfnhf\"" Jun 09 15:12:41.950872 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:41.950855 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 15:12:41.951655 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:41.951642 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 15:12:41.951705 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:41.951684 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 15:12:41.952720 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:41.952703 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:12:41.952787 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:41.952773 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 15:12:41.982326 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:41.981902 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg"] Jun 09 15:12:42.005003 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.004933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f006ff89-aa41-4c77-aa4b-b908aee97ff8-manager-config\") pod \"lws-controller-manager-6b54fb96bd-nc5hg\" (UID: \"f006ff89-aa41-4c77-aa4b-b908aee97ff8\") " pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:42.005126 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.005013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f006ff89-aa41-4c77-aa4b-b908aee97ff8-metrics-cert\") pod \"lws-controller-manager-6b54fb96bd-nc5hg\" (UID: \"f006ff89-aa41-4c77-aa4b-b908aee97ff8\") " pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:42.005126 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.005075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f006ff89-aa41-4c77-aa4b-b908aee97ff8-cert\") pod \"lws-controller-manager-6b54fb96bd-nc5hg\" (UID: \"f006ff89-aa41-4c77-aa4b-b908aee97ff8\") " pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:42.005126 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.005094 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2ps6\" (UniqueName: \"kubernetes.io/projected/f006ff89-aa41-4c77-aa4b-b908aee97ff8-kube-api-access-q2ps6\") pod \"lws-controller-manager-6b54fb96bd-nc5hg\" (UID: \"f006ff89-aa41-4c77-aa4b-b908aee97ff8\") " pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:42.105798 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.105757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f006ff89-aa41-4c77-aa4b-b908aee97ff8-metrics-cert\") pod \"lws-controller-manager-6b54fb96bd-nc5hg\" (UID: \"f006ff89-aa41-4c77-aa4b-b908aee97ff8\") " pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:42.106014 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.105820 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f006ff89-aa41-4c77-aa4b-b908aee97ff8-cert\") pod \"lws-controller-manager-6b54fb96bd-nc5hg\" (UID: \"f006ff89-aa41-4c77-aa4b-b908aee97ff8\") " pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:42.106014 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.105838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2ps6\" (UniqueName: \"kubernetes.io/projected/f006ff89-aa41-4c77-aa4b-b908aee97ff8-kube-api-access-q2ps6\") pod \"lws-controller-manager-6b54fb96bd-nc5hg\" (UID: \"f006ff89-aa41-4c77-aa4b-b908aee97ff8\") " pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:42.106014 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.105869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f006ff89-aa41-4c77-aa4b-b908aee97ff8-manager-config\") pod \"lws-controller-manager-6b54fb96bd-nc5hg\" (UID: \"f006ff89-aa41-4c77-aa4b-b908aee97ff8\") " pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:42.106575 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.106547 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f006ff89-aa41-4c77-aa4b-b908aee97ff8-manager-config\") pod \"lws-controller-manager-6b54fb96bd-nc5hg\" (UID: \"f006ff89-aa41-4c77-aa4b-b908aee97ff8\") " pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:42.108265 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.108233 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f006ff89-aa41-4c77-aa4b-b908aee97ff8-cert\") pod \"lws-controller-manager-6b54fb96bd-nc5hg\" (UID: \"f006ff89-aa41-4c77-aa4b-b908aee97ff8\") " pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:42.108360 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.108323 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f006ff89-aa41-4c77-aa4b-b908aee97ff8-metrics-cert\") pod \"lws-controller-manager-6b54fb96bd-nc5hg\" (UID: \"f006ff89-aa41-4c77-aa4b-b908aee97ff8\") " pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:42.154327 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.154300 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2ps6\" (UniqueName: \"kubernetes.io/projected/f006ff89-aa41-4c77-aa4b-b908aee97ff8-kube-api-access-q2ps6\") pod \"lws-controller-manager-6b54fb96bd-nc5hg\" (UID: \"f006ff89-aa41-4c77-aa4b-b908aee97ff8\") " pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:42.221755 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.221722 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:42.248190 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.248145 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:42.397535 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.397508 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg"] Jun 09 15:12:42.400986 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:12:42.400964 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf006ff89_aa41_4c77_aa4b_b908aee97ff8.slice/crio-03d2150cffbc506ca6d03f0ab200422ec5c2026c6382cfeddcc77f5076feef4d WatchSource:0}: Error finding container 03d2150cffbc506ca6d03f0ab200422ec5c2026c6382cfeddcc77f5076feef4d: Status 404 returned error can't find the container with id 03d2150cffbc506ca6d03f0ab200422ec5c2026c6382cfeddcc77f5076feef4d Jun 09 15:12:42.488267 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:42.488236 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" event={"ID":"f006ff89-aa41-4c77-aa4b-b908aee97ff8","Type":"ContainerStarted","Data":"03d2150cffbc506ca6d03f0ab200422ec5c2026c6382cfeddcc77f5076feef4d"} Jun 09 15:12:43.591136 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:43.591102 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:43.808853 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:43.808808 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:43.921935 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:43.921856 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw"] Jun 09 15:12:43.924528 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:43.924503 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:43.930672 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:43.930652 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 15:12:43.930809 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:43.930728 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 15:12:43.931617 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:43.931587 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pkhfx\"" Jun 09 15:12:43.931978 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:43.931952 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 15:12:43.933776 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:43.933755 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 15:12:43.995284 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:43.995253 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw"] Jun 09 15:12:44.022442 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.022358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dddrr\" (UniqueName: \"kubernetes.io/projected/d2a1a060-9d11-4aff-bc58-89042cfce0e2-kube-api-access-dddrr\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.022442 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.022423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2a1a060-9d11-4aff-bc58-89042cfce0e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.022708 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.022490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d2a1a060-9d11-4aff-bc58-89042cfce0e2-manifests\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.022708 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.022617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d2a1a060-9d11-4aff-bc58-89042cfce0e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.022708 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.022669 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2a1a060-9d11-4aff-bc58-89042cfce0e2-tmp\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.123100 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.123060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2a1a060-9d11-4aff-bc58-89042cfce0e2-tmp\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.123366 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.123113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dddrr\" (UniqueName: \"kubernetes.io/projected/d2a1a060-9d11-4aff-bc58-89042cfce0e2-kube-api-access-dddrr\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.123366 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.123158 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2a1a060-9d11-4aff-bc58-89042cfce0e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.123366 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.123182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d2a1a060-9d11-4aff-bc58-89042cfce0e2-manifests\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.123366 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.123248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d2a1a060-9d11-4aff-bc58-89042cfce0e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.124239 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.124215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d2a1a060-9d11-4aff-bc58-89042cfce0e2-manifests\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.125927 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.125901 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2a1a060-9d11-4aff-bc58-89042cfce0e2-tmp\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.126023 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.125949 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2a1a060-9d11-4aff-bc58-89042cfce0e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.126023 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.126004 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d2a1a060-9d11-4aff-bc58-89042cfce0e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.165741 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.165713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dddrr\" (UniqueName: \"kubernetes.io/projected/d2a1a060-9d11-4aff-bc58-89042cfce0e2-kube-api-access-dddrr\") pod \"opendatahub-operator-controller-manager-7ff5447b54-z6ffw\" (UID: \"d2a1a060-9d11-4aff-bc58-89042cfce0e2\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.236670 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.236634 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:44.444996 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.444971 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw"] Jun 09 15:12:44.449119 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:12:44.449089 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a1a060_9d11_4aff_bc58_89042cfce0e2.slice/crio-b7f108c9bf83d742a67ef261d5664cdcf863cbb5d6100de4d2ef3aa2983e302e WatchSource:0}: Error finding container b7f108c9bf83d742a67ef261d5664cdcf863cbb5d6100de4d2ef3aa2983e302e: Status 404 returned error can't find the container with id b7f108c9bf83d742a67ef261d5664cdcf863cbb5d6100de4d2ef3aa2983e302e Jun 09 15:12:44.498290 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.498201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" event={"ID":"d2a1a060-9d11-4aff-bc58-89042cfce0e2","Type":"ContainerStarted","Data":"b7f108c9bf83d742a67ef261d5664cdcf863cbb5d6100de4d2ef3aa2983e302e"} Jun 09 15:12:44.565682 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.565640 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:44.850325 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:44.850244 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:45.099464 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:45.099429 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:45.268096 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:45.268060 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:12:46.508347 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:46.508303 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" event={"ID":"f006ff89-aa41-4c77-aa4b-b908aee97ff8","Type":"ContainerStarted","Data":"bad3a9589bcf4f5057397927db709c75b17f16864bdef044117d7daad95def40"} Jun 09 15:12:46.508830 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:46.508484 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:12:46.590052 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:46.589991 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" podStartSLOduration=2.464973977 podStartE2EDuration="5.589974994s" totalImagesPullingTime="3.125001017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:12:46.589227028 +0000 UTC m=+624.653801481" watchObservedRunningTime="2026-06-09 15:12:46.589974994 +0000 UTC m=+624.654549444" Jun 09 15:12:48.517658 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:48.517626 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" event={"ID":"d2a1a060-9d11-4aff-bc58-89042cfce0e2","Type":"ContainerStarted","Data":"68495612bf9c11010801568b7302b7ed6576657ee57556508eb7cd5353d01c55"} Jun 09 15:12:49.522753 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:49.522660 2577 generic.go:356] "Generic (PLEG): container finished" podID="d2a1a060-9d11-4aff-bc58-89042cfce0e2" containerID="68495612bf9c11010801568b7302b7ed6576657ee57556508eb7cd5353d01c55" exitCode=0 Jun 09 15:12:49.522753 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:49.522731 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" event={"ID":"d2a1a060-9d11-4aff-bc58-89042cfce0e2","Type":"ContainerDied","Data":"68495612bf9c11010801568b7302b7ed6576657ee57556508eb7cd5353d01c55"} Jun 09 15:12:50.528333 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:50.528296 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" event={"ID":"d2a1a060-9d11-4aff-bc58-89042cfce0e2","Type":"ContainerStarted","Data":"e59dd31d63b2dad1735d4433893d85ac6dd776c9e0680add87260690515c4e7c"} Jun 09 15:12:50.528842 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:50.528418 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:12:50.586186 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:50.586137 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" podStartSLOduration=2.570470918 podStartE2EDuration="7.586121243s" totalImagesPullingTime="4.027836591s" totalInitContainerRuntime="987.813734ms" isStatefulPod=false podCreationTimestamp="2026-06-09 15:12:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:12:50.585865131 +0000 UTC m=+628.650439591" watchObservedRunningTime="2026-06-09 15:12:50.586121243 +0000 UTC m=+628.650695694" Jun 09 15:12:57.514162 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:12:57.514133 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6b54fb96bd-nc5hg" Jun 09 15:13:01.437973 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:01.437943 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:01.534380 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:01.534356 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7ff5447b54-z6ffw" Jun 09 15:13:03.616229 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:03.616193 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:03.821089 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:03.821049 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:04.359997 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:04.359961 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:04.539000 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:04.538963 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:04.644897 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:04.644814 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:05.271432 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:05.271399 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:05.646778 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:05.646686 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:14.995420 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:14.995382 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:15.165490 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:15.165458 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:15.457961 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:15.457928 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:15.594539 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:15.594503 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:15.804027 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:15.803949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:15.912450 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:15.912419 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:28.624049 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:28.624014 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:28.737844 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:28.737807 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:30.354146 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:30.354103 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:30.695479 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:30.695451 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:31.192242 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:31.192157 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:31.429336 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:31.429302 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:32.162843 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.162804 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5c7f895466-8swrv"] Jun 09 15:13:32.170677 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.170652 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5c7f895466-8swrv" Jun 09 15:13:32.176282 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.176238 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bl52h\"" Jun 09 15:13:32.176436 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.176408 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 15:13:32.181737 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.181715 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:32.189649 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.189625 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5c7f895466-8swrv"] Jun 09 15:13:32.216280 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.216251 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cfe31481-cd09-4075-9729-0932342805b0-redirect-config\") pod \"dashboard-redirect-5c7f895466-8swrv\" (UID: \"cfe31481-cd09-4075-9729-0932342805b0\") " pod="opendatahub/dashboard-redirect-5c7f895466-8swrv" Jun 09 15:13:32.216496 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.216289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf994\" (UniqueName: \"kubernetes.io/projected/cfe31481-cd09-4075-9729-0932342805b0-kube-api-access-qf994\") pod \"dashboard-redirect-5c7f895466-8swrv\" (UID: \"cfe31481-cd09-4075-9729-0932342805b0\") " pod="opendatahub/dashboard-redirect-5c7f895466-8swrv" Jun 09 15:13:32.317222 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.317177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cfe31481-cd09-4075-9729-0932342805b0-redirect-config\") pod \"dashboard-redirect-5c7f895466-8swrv\" (UID: \"cfe31481-cd09-4075-9729-0932342805b0\") " pod="opendatahub/dashboard-redirect-5c7f895466-8swrv" Jun 09 15:13:32.317222 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.317223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf994\" (UniqueName: \"kubernetes.io/projected/cfe31481-cd09-4075-9729-0932342805b0-kube-api-access-qf994\") pod \"dashboard-redirect-5c7f895466-8swrv\" (UID: \"cfe31481-cd09-4075-9729-0932342805b0\") " pod="opendatahub/dashboard-redirect-5c7f895466-8swrv" Jun 09 15:13:32.317913 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.317892 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cfe31481-cd09-4075-9729-0932342805b0-redirect-config\") pod \"dashboard-redirect-5c7f895466-8swrv\" (UID: \"cfe31481-cd09-4075-9729-0932342805b0\") " pod="opendatahub/dashboard-redirect-5c7f895466-8swrv" Jun 09 15:13:32.327370 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.327351 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf994\" (UniqueName: \"kubernetes.io/projected/cfe31481-cd09-4075-9729-0932342805b0-kube-api-access-qf994\") pod \"dashboard-redirect-5c7f895466-8swrv\" (UID: \"cfe31481-cd09-4075-9729-0932342805b0\") " pod="opendatahub/dashboard-redirect-5c7f895466-8swrv" Jun 09 15:13:32.481239 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.481193 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5c7f895466-8swrv" Jun 09 15:13:32.617389 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.617226 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5c7f895466-8swrv"] Jun 09 15:13:32.620668 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:13:32.620640 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe31481_cd09_4075_9729_0932342805b0.slice/crio-425b1e4c796a6c20b9c0762c3cb6030c7d2eed54b4bda6328bda73e72c25332e WatchSource:0}: Error finding container 425b1e4c796a6c20b9c0762c3cb6030c7d2eed54b4bda6328bda73e72c25332e: Status 404 returned error can't find the container with id 425b1e4c796a6c20b9c0762c3cb6030c7d2eed54b4bda6328bda73e72c25332e Jun 09 15:13:32.678356 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:32.678318 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5c7f895466-8swrv" event={"ID":"cfe31481-cd09-4075-9729-0932342805b0","Type":"ContainerStarted","Data":"425b1e4c796a6c20b9c0762c3cb6030c7d2eed54b4bda6328bda73e72c25332e"} Jun 09 15:13:33.360626 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:33.360565 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:33.479497 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:33.479460 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:34.689130 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:34.689038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5c7f895466-8swrv" event={"ID":"cfe31481-cd09-4075-9729-0932342805b0","Type":"ContainerStarted","Data":"ec801a787468c6b06d66271dba914aad4882a4515d6c0d54b4c23e6bf676f8db"} Jun 09 15:13:34.739465 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:34.739409 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5c7f895466-8swrv" podStartSLOduration=1.045769441 podStartE2EDuration="2.739392577s" totalImagesPullingTime="1.693623136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:13:34.738145658 +0000 UTC m=+672.802720108" watchObservedRunningTime="2026-06-09 15:13:34.739392577 +0000 UTC m=+672.803967028" Jun 09 15:13:41.660742 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:41.660706 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:41.807536 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:41.807502 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:42.245728 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:42.245690 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:42.403965 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:42.403931 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:42.879004 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:42.878967 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:44.308447 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:44.308413 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76995796f6-x5jgp"] Jun 09 15:13:44.425907 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:44.425872 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:44.527664 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:44.527635 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:44.629729 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:44.629646 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:45.683292 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:45.683261 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:45.780577 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:45.780545 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:45.933238 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:45.933211 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4"] Jun 09 15:13:45.936654 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:45.936584 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:45.939629 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:45.939593 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 15:13:45.939752 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:45.939650 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 15:13:45.939752 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:45.939727 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gj7fv\"" Jun 09 15:13:45.939939 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:45.939921 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 15:13:45.950722 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:45.950701 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4"] Jun 09 15:13:45.976805 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:45.976774 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:46.038260 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.038228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.038458 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.038297 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.038458 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.038386 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.038458 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.038424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f9c23a3-a786-40e6-a635-1fe87aa51578-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.038633 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.038501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f9c23a3-a786-40e6-a635-1fe87aa51578-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.038633 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.038539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f9c23a3-a786-40e6-a635-1fe87aa51578-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.038633 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.038561 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsgn8\" (UniqueName: \"kubernetes.io/projected/7f9c23a3-a786-40e6-a635-1fe87aa51578-kube-api-access-jsgn8\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.038633 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.038625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.038832 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.038643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.139800 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.139768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.139997 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.139809 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.139997 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.139827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f9c23a3-a786-40e6-a635-1fe87aa51578-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.139997 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.139963 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f9c23a3-a786-40e6-a635-1fe87aa51578-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.140172 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.140011 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f9c23a3-a786-40e6-a635-1fe87aa51578-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.140172 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.140045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsgn8\" (UniqueName: \"kubernetes.io/projected/7f9c23a3-a786-40e6-a635-1fe87aa51578-kube-api-access-jsgn8\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.140172 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.140085 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.140172 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.140112 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.140172 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.140157 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.140411 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.140286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.140515 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.140491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.140574 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.140518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.140650 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.140598 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.140868 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.140849 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f9c23a3-a786-40e6-a635-1fe87aa51578-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.142239 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.142217 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f9c23a3-a786-40e6-a635-1fe87aa51578-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.142467 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.142451 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f9c23a3-a786-40e6-a635-1fe87aa51578-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.150981 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.150957 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f9c23a3-a786-40e6-a635-1fe87aa51578-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.151773 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.151751 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsgn8\" (UniqueName: \"kubernetes.io/projected/7f9c23a3-a786-40e6-a635-1fe87aa51578-kube-api-access-jsgn8\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjkvj4\" (UID: \"7f9c23a3-a786-40e6-a635-1fe87aa51578\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.182567 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.182543 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:46.246625 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.246567 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:46.388721 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.388692 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4"] Jun 09 15:13:46.391754 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:13:46.391712 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9c23a3_a786_40e6_a635_1fe87aa51578.slice/crio-d9030b84995b5b9322ec6b2e2d14c38e8056800ca17c2d9a234bc6d1ce8dbf7e WatchSource:0}: Error finding container d9030b84995b5b9322ec6b2e2d14c38e8056800ca17c2d9a234bc6d1ce8dbf7e: Status 404 returned error can't find the container with id d9030b84995b5b9322ec6b2e2d14c38e8056800ca17c2d9a234bc6d1ce8dbf7e Jun 09 15:13:46.408832 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.408804 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:46.509034 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.508951 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:13:46.736052 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:46.736018 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" event={"ID":"7f9c23a3-a786-40e6-a635-1fe87aa51578","Type":"ContainerStarted","Data":"d9030b84995b5b9322ec6b2e2d14c38e8056800ca17c2d9a234bc6d1ce8dbf7e"} Jun 09 15:13:49.005024 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:49.004986 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:13:49.005268 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:49.005066 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:13:49.005268 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:49.005097 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:13:49.750326 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:49.750293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" event={"ID":"7f9c23a3-a786-40e6-a635-1fe87aa51578","Type":"ContainerStarted","Data":"2c4912dccbde4087fca11f6bb003593a2c4c7f1f6a944503b97fd603a05696f0"} Jun 09 15:13:49.790918 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:49.790860 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" podStartSLOduration=2.179904872 podStartE2EDuration="4.790842687s" totalImagesPullingTime="2.610937815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:13:49.788158907 +0000 UTC m=+687.852733359" watchObservedRunningTime="2026-06-09 15:13:49.790842687 +0000 UTC m=+687.855417207" Jun 09 15:13:50.247536 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:50.247503 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:50.252403 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:50.252374 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:50.754041 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:50.753998 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:13:50.755001 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:13:50.754983 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjkvj4" Jun 09 15:14:05.131937 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.131885 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:05.221250 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.221207 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:05.229687 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.229657 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgg6l"] Jun 09 15:14:05.232933 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.232917 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sgg6l" Jun 09 15:14:05.235528 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.235509 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 15:14:05.235651 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.235512 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mwdzd\"" Jun 09 15:14:05.235651 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.235590 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 15:14:05.242915 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.242895 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgg6l"] Jun 09 15:14:05.305654 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.305598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjtl9\" (UniqueName: \"kubernetes.io/projected/966f6e96-dc28-48de-ba62-93c4a6ed2374-kube-api-access-kjtl9\") pod \"kuadrant-operator-catalog-sgg6l\" (UID: \"966f6e96-dc28-48de-ba62-93c4a6ed2374\") " pod="kuadrant-system/kuadrant-operator-catalog-sgg6l" Jun 09 15:14:05.320909 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.320871 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:05.406580 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.406491 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjtl9\" (UniqueName: \"kubernetes.io/projected/966f6e96-dc28-48de-ba62-93c4a6ed2374-kube-api-access-kjtl9\") pod \"kuadrant-operator-catalog-sgg6l\" (UID: \"966f6e96-dc28-48de-ba62-93c4a6ed2374\") " pod="kuadrant-system/kuadrant-operator-catalog-sgg6l" Jun 09 15:14:05.415148 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.415115 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjtl9\" (UniqueName: \"kubernetes.io/projected/966f6e96-dc28-48de-ba62-93c4a6ed2374-kube-api-access-kjtl9\") pod \"kuadrant-operator-catalog-sgg6l\" (UID: \"966f6e96-dc28-48de-ba62-93c4a6ed2374\") " pod="kuadrant-system/kuadrant-operator-catalog-sgg6l" Jun 09 15:14:05.543467 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.543426 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sgg6l" Jun 09 15:14:05.596953 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.596922 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgg6l"] Jun 09 15:14:05.671728 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.671515 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgg6l"] Jun 09 15:14:05.674414 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:14:05.674387 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod966f6e96_dc28_48de_ba62_93c4a6ed2374.slice/crio-6d14e1004ac5c48a78a2f767664d884a44c07f374a0f4bd347dc3aa1777449b0 WatchSource:0}: Error finding container 6d14e1004ac5c48a78a2f767664d884a44c07f374a0f4bd347dc3aa1777449b0: Status 404 returned error can't find the container with id 6d14e1004ac5c48a78a2f767664d884a44c07f374a0f4bd347dc3aa1777449b0 Jun 09 15:14:05.809913 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.809882 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9hc84"] Jun 09 15:14:05.814178 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.814152 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sgg6l" event={"ID":"966f6e96-dc28-48de-ba62-93c4a6ed2374","Type":"ContainerStarted","Data":"6d14e1004ac5c48a78a2f767664d884a44c07f374a0f4bd347dc3aa1777449b0"} Jun 09 15:14:05.814302 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.814239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9hc84" Jun 09 15:14:05.822277 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.822253 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9hc84"] Jun 09 15:14:05.910821 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:05.910782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w9xv\" (UniqueName: \"kubernetes.io/projected/0f2f6b84-3b6f-47ed-a67a-2f384213143e-kube-api-access-6w9xv\") pod \"kuadrant-operator-catalog-9hc84\" (UID: \"0f2f6b84-3b6f-47ed-a67a-2f384213143e\") " pod="kuadrant-system/kuadrant-operator-catalog-9hc84" Jun 09 15:14:06.011862 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:06.011826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w9xv\" (UniqueName: \"kubernetes.io/projected/0f2f6b84-3b6f-47ed-a67a-2f384213143e-kube-api-access-6w9xv\") pod \"kuadrant-operator-catalog-9hc84\" (UID: \"0f2f6b84-3b6f-47ed-a67a-2f384213143e\") " pod="kuadrant-system/kuadrant-operator-catalog-9hc84" Jun 09 15:14:06.020532 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:06.020506 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w9xv\" (UniqueName: \"kubernetes.io/projected/0f2f6b84-3b6f-47ed-a67a-2f384213143e-kube-api-access-6w9xv\") pod \"kuadrant-operator-catalog-9hc84\" (UID: \"0f2f6b84-3b6f-47ed-a67a-2f384213143e\") " pod="kuadrant-system/kuadrant-operator-catalog-9hc84" Jun 09 15:14:06.123769 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:06.123724 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9hc84" Jun 09 15:14:06.262741 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:06.262698 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9hc84"] Jun 09 15:14:06.285637 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:14:06.285585 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f2f6b84_3b6f_47ed_a67a_2f384213143e.slice/crio-e0db3baae1a1135e0705861ebdb2c32794b750813a844c154ae03d715e92471c WatchSource:0}: Error finding container e0db3baae1a1135e0705861ebdb2c32794b750813a844c154ae03d715e92471c: Status 404 returned error can't find the container with id e0db3baae1a1135e0705861ebdb2c32794b750813a844c154ae03d715e92471c Jun 09 15:14:06.821791 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:06.821750 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9hc84" event={"ID":"0f2f6b84-3b6f-47ed-a67a-2f384213143e","Type":"ContainerStarted","Data":"e0db3baae1a1135e0705861ebdb2c32794b750813a844c154ae03d715e92471c"} Jun 09 15:14:08.831642 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:08.831584 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9hc84" event={"ID":"0f2f6b84-3b6f-47ed-a67a-2f384213143e","Type":"ContainerStarted","Data":"7735af2488cbcc4162bba0ffbbacd95c66d08f9cc07df2a12f89b74bea4019c1"} Jun 09 15:14:08.833078 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:08.833053 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sgg6l" event={"ID":"966f6e96-dc28-48de-ba62-93c4a6ed2374","Type":"ContainerStarted","Data":"9eae7e4a4b481cf2bbf2157cec1046d7f0a13c1e40da8686511c506dc317837c"} Jun 09 15:14:08.833182 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:08.833129 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-sgg6l" podUID="966f6e96-dc28-48de-ba62-93c4a6ed2374" containerName="registry-server" containerID="cri-o://9eae7e4a4b481cf2bbf2157cec1046d7f0a13c1e40da8686511c506dc317837c" gracePeriod=2 Jun 09 15:14:08.860970 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:08.860922 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9hc84" podStartSLOduration=2.112054008 podStartE2EDuration="3.860904498s" totalImagesPullingTime="1.74885049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:08.854877828 +0000 UTC m=+706.919452279" watchObservedRunningTime="2026-06-09 15:14:08.860904498 +0000 UTC m=+706.925478948" Jun 09 15:14:09.081728 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.081674 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sgg6l" Jun 09 15:14:09.140683 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.140638 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjtl9\" (UniqueName: \"kubernetes.io/projected/966f6e96-dc28-48de-ba62-93c4a6ed2374-kube-api-access-kjtl9\") pod \"966f6e96-dc28-48de-ba62-93c4a6ed2374\" (UID: \"966f6e96-dc28-48de-ba62-93c4a6ed2374\") " Jun 09 15:14:09.142968 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.142940 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/966f6e96-dc28-48de-ba62-93c4a6ed2374-kube-api-access-kjtl9" (OuterVolumeSpecName: "kube-api-access-kjtl9") pod "966f6e96-dc28-48de-ba62-93c4a6ed2374" (UID: "966f6e96-dc28-48de-ba62-93c4a6ed2374"). InnerVolumeSpecName "kube-api-access-kjtl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:14:09.242197 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.242155 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjtl9\" (UniqueName: \"kubernetes.io/projected/966f6e96-dc28-48de-ba62-93c4a6ed2374-kube-api-access-kjtl9\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:14:09.329135 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.329080 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-76995796f6-x5jgp" podUID="216e94db-dedf-44f1-b63d-aadd76e0294f" containerName="console" containerID="cri-o://b660c5151e5ee3e12f889132c8627d2d289343484df32be619e0b37c7b8dffd7" gracePeriod=15 Jun 09 15:14:09.571304 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.571280 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:14:09.645533 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.645443 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dmw7\" (UniqueName: \"kubernetes.io/projected/216e94db-dedf-44f1-b63d-aadd76e0294f-kube-api-access-2dmw7\") pod \"216e94db-dedf-44f1-b63d-aadd76e0294f\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " Jun 09 15:14:09.645533 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.645480 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/216e94db-dedf-44f1-b63d-aadd76e0294f-console-serving-cert\") pod \"216e94db-dedf-44f1-b63d-aadd76e0294f\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " Jun 09 15:14:09.645788 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.645539 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-oauth-serving-cert\") pod \"216e94db-dedf-44f1-b63d-aadd76e0294f\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " Jun 09 15:14:09.645788 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.645643 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-service-ca\") pod \"216e94db-dedf-44f1-b63d-aadd76e0294f\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " Jun 09 15:14:09.645788 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.645678 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-trusted-ca-bundle\") pod \"216e94db-dedf-44f1-b63d-aadd76e0294f\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " Jun 09 15:14:09.645788 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.645701 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/216e94db-dedf-44f1-b63d-aadd76e0294f-console-oauth-config\") pod \"216e94db-dedf-44f1-b63d-aadd76e0294f\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " Jun 09 15:14:09.645788 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.645723 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-console-config\") pod \"216e94db-dedf-44f1-b63d-aadd76e0294f\" (UID: \"216e94db-dedf-44f1-b63d-aadd76e0294f\") " Jun 09 15:14:09.646044 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.645947 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "216e94db-dedf-44f1-b63d-aadd76e0294f" (UID: "216e94db-dedf-44f1-b63d-aadd76e0294f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:14:09.646197 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.646169 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "216e94db-dedf-44f1-b63d-aadd76e0294f" (UID: "216e94db-dedf-44f1-b63d-aadd76e0294f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:14:09.646263 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.646200 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-console-config" (OuterVolumeSpecName: "console-config") pod "216e94db-dedf-44f1-b63d-aadd76e0294f" (UID: "216e94db-dedf-44f1-b63d-aadd76e0294f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:14:09.646320 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.646283 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-service-ca" (OuterVolumeSpecName: "service-ca") pod "216e94db-dedf-44f1-b63d-aadd76e0294f" (UID: "216e94db-dedf-44f1-b63d-aadd76e0294f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:14:09.647787 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.647765 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/216e94db-dedf-44f1-b63d-aadd76e0294f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "216e94db-dedf-44f1-b63d-aadd76e0294f" (UID: "216e94db-dedf-44f1-b63d-aadd76e0294f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:14:09.648217 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.648180 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/216e94db-dedf-44f1-b63d-aadd76e0294f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "216e94db-dedf-44f1-b63d-aadd76e0294f" (UID: "216e94db-dedf-44f1-b63d-aadd76e0294f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:14:09.648217 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.648194 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/216e94db-dedf-44f1-b63d-aadd76e0294f-kube-api-access-2dmw7" (OuterVolumeSpecName: "kube-api-access-2dmw7") pod "216e94db-dedf-44f1-b63d-aadd76e0294f" (UID: "216e94db-dedf-44f1-b63d-aadd76e0294f"). InnerVolumeSpecName "kube-api-access-2dmw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:14:09.746655 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.746594 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dmw7\" (UniqueName: \"kubernetes.io/projected/216e94db-dedf-44f1-b63d-aadd76e0294f-kube-api-access-2dmw7\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:14:09.746655 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.746647 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/216e94db-dedf-44f1-b63d-aadd76e0294f-console-serving-cert\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:14:09.746655 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.746659 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-oauth-serving-cert\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:14:09.746655 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.746668 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-service-ca\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:14:09.746932 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.746677 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-trusted-ca-bundle\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:14:09.746932 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.746685 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/216e94db-dedf-44f1-b63d-aadd76e0294f-console-oauth-config\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:14:09.746932 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.746694 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/216e94db-dedf-44f1-b63d-aadd76e0294f-console-config\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:14:09.844222 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.844181 2577 generic.go:356] "Generic (PLEG): container finished" podID="216e94db-dedf-44f1-b63d-aadd76e0294f" containerID="b660c5151e5ee3e12f889132c8627d2d289343484df32be619e0b37c7b8dffd7" exitCode=0 Jun 09 15:14:09.844683 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.844237 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76995796f6-x5jgp" Jun 09 15:14:09.844683 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.844265 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76995796f6-x5jgp" event={"ID":"216e94db-dedf-44f1-b63d-aadd76e0294f","Type":"ContainerDied","Data":"b660c5151e5ee3e12f889132c8627d2d289343484df32be619e0b37c7b8dffd7"} Jun 09 15:14:09.844683 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.844338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76995796f6-x5jgp" event={"ID":"216e94db-dedf-44f1-b63d-aadd76e0294f","Type":"ContainerDied","Data":"881fc3c1b8dc3a378be3852b77c7208fda1d25b5c6d206b6505275d434dccb63"} Jun 09 15:14:09.844683 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.844366 2577 scope.go:117] "RemoveContainer" containerID="b660c5151e5ee3e12f889132c8627d2d289343484df32be619e0b37c7b8dffd7" Jun 09 15:14:09.845576 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.845553 2577 generic.go:356] "Generic (PLEG): container finished" podID="966f6e96-dc28-48de-ba62-93c4a6ed2374" containerID="9eae7e4a4b481cf2bbf2157cec1046d7f0a13c1e40da8686511c506dc317837c" exitCode=0 Jun 09 15:14:09.845721 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.845626 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sgg6l" Jun 09 15:14:09.845721 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.845651 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sgg6l" event={"ID":"966f6e96-dc28-48de-ba62-93c4a6ed2374","Type":"ContainerDied","Data":"9eae7e4a4b481cf2bbf2157cec1046d7f0a13c1e40da8686511c506dc317837c"} Jun 09 15:14:09.845721 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.845702 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sgg6l" event={"ID":"966f6e96-dc28-48de-ba62-93c4a6ed2374","Type":"ContainerDied","Data":"6d14e1004ac5c48a78a2f767664d884a44c07f374a0f4bd347dc3aa1777449b0"} Jun 09 15:14:09.852979 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.852872 2577 scope.go:117] "RemoveContainer" containerID="b660c5151e5ee3e12f889132c8627d2d289343484df32be619e0b37c7b8dffd7" Jun 09 15:14:09.853318 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:14:09.853284 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b660c5151e5ee3e12f889132c8627d2d289343484df32be619e0b37c7b8dffd7\": container with ID starting with b660c5151e5ee3e12f889132c8627d2d289343484df32be619e0b37c7b8dffd7 not found: ID does not exist" containerID="b660c5151e5ee3e12f889132c8627d2d289343484df32be619e0b37c7b8dffd7" Jun 09 15:14:09.853421 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.853314 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b660c5151e5ee3e12f889132c8627d2d289343484df32be619e0b37c7b8dffd7"} err="failed to get container status \"b660c5151e5ee3e12f889132c8627d2d289343484df32be619e0b37c7b8dffd7\": rpc error: code = NotFound desc = could not find container \"b660c5151e5ee3e12f889132c8627d2d289343484df32be619e0b37c7b8dffd7\": container with ID starting with b660c5151e5ee3e12f889132c8627d2d289343484df32be619e0b37c7b8dffd7 not found: ID does not exist" Jun 09 15:14:09.853421 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.853337 2577 scope.go:117] "RemoveContainer" containerID="9eae7e4a4b481cf2bbf2157cec1046d7f0a13c1e40da8686511c506dc317837c" Jun 09 15:14:09.861332 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.861315 2577 scope.go:117] "RemoveContainer" containerID="9eae7e4a4b481cf2bbf2157cec1046d7f0a13c1e40da8686511c506dc317837c" Jun 09 15:14:09.861559 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:14:09.861541 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eae7e4a4b481cf2bbf2157cec1046d7f0a13c1e40da8686511c506dc317837c\": container with ID starting with 9eae7e4a4b481cf2bbf2157cec1046d7f0a13c1e40da8686511c506dc317837c not found: ID does not exist" containerID="9eae7e4a4b481cf2bbf2157cec1046d7f0a13c1e40da8686511c506dc317837c" Jun 09 15:14:09.861632 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.861569 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eae7e4a4b481cf2bbf2157cec1046d7f0a13c1e40da8686511c506dc317837c"} err="failed to get container status \"9eae7e4a4b481cf2bbf2157cec1046d7f0a13c1e40da8686511c506dc317837c\": rpc error: code = NotFound desc = could not find container \"9eae7e4a4b481cf2bbf2157cec1046d7f0a13c1e40da8686511c506dc317837c\": container with ID starting with 9eae7e4a4b481cf2bbf2157cec1046d7f0a13c1e40da8686511c506dc317837c not found: ID does not exist" Jun 09 15:14:09.865129 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.865106 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76995796f6-x5jgp"] Jun 09 15:14:09.869715 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.869696 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76995796f6-x5jgp"] Jun 09 15:14:09.879150 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.879123 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgg6l"] Jun 09 15:14:09.883513 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:09.883491 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgg6l"] Jun 09 15:14:10.377313 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:10.377236 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="216e94db-dedf-44f1-b63d-aadd76e0294f" path="/var/lib/kubelet/pods/216e94db-dedf-44f1-b63d-aadd76e0294f/volumes" Jun 09 15:14:10.377560 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:10.377547 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="966f6e96-dc28-48de-ba62-93c4a6ed2374" path="/var/lib/kubelet/pods/966f6e96-dc28-48de-ba62-93c4a6ed2374/volumes" Jun 09 15:14:16.124665 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:16.124623 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9hc84" Jun 09 15:14:16.125220 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:16.124717 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9hc84" Jun 09 15:14:16.146680 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:16.146648 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9hc84" Jun 09 15:14:16.895935 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:16.895906 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9hc84" Jun 09 15:14:23.258731 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:23.258686 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:33.957210 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:33.957165 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:34.560274 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:34.560240 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:35.393265 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:35.393229 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:35.498795 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:35.498762 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:37.467479 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.467443 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lzzwp"] Jun 09 15:14:37.467881 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.467738 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="966f6e96-dc28-48de-ba62-93c4a6ed2374" containerName="registry-server" Jun 09 15:14:37.467881 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.467749 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="966f6e96-dc28-48de-ba62-93c4a6ed2374" containerName="registry-server" Jun 09 15:14:37.467881 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.467765 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="216e94db-dedf-44f1-b63d-aadd76e0294f" containerName="console" Jun 09 15:14:37.467881 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.467770 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="216e94db-dedf-44f1-b63d-aadd76e0294f" containerName="console" Jun 09 15:14:37.467881 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.467818 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="216e94db-dedf-44f1-b63d-aadd76e0294f" containerName="console" Jun 09 15:14:37.467881 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.467828 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="966f6e96-dc28-48de-ba62-93c4a6ed2374" containerName="registry-server" Jun 09 15:14:37.476917 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.476894 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lzzwp" Jun 09 15:14:37.480763 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.480726 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6t6ln\"" Jun 09 15:14:37.496943 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.496910 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lzzwp"] Jun 09 15:14:37.590161 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.590121 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x89m4\" (UniqueName: \"kubernetes.io/projected/6b28ccdc-16bc-4318-b2b1-4b6654b53338-kube-api-access-x89m4\") pod \"authorino-operator-75cc8d5cb7-lzzwp\" (UID: \"6b28ccdc-16bc-4318-b2b1-4b6654b53338\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lzzwp" Jun 09 15:14:37.690939 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.690890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x89m4\" (UniqueName: \"kubernetes.io/projected/6b28ccdc-16bc-4318-b2b1-4b6654b53338-kube-api-access-x89m4\") pod \"authorino-operator-75cc8d5cb7-lzzwp\" (UID: \"6b28ccdc-16bc-4318-b2b1-4b6654b53338\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lzzwp" Jun 09 15:14:37.704858 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.704829 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x89m4\" (UniqueName: \"kubernetes.io/projected/6b28ccdc-16bc-4318-b2b1-4b6654b53338-kube-api-access-x89m4\") pod \"authorino-operator-75cc8d5cb7-lzzwp\" (UID: \"6b28ccdc-16bc-4318-b2b1-4b6654b53338\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lzzwp" Jun 09 15:14:37.787435 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.787350 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lzzwp" Jun 09 15:14:37.951982 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:37.951948 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lzzwp"] Jun 09 15:14:37.955895 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:14:37.955862 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b28ccdc_16bc_4318_b2b1_4b6654b53338.slice/crio-9ae0831f16338e600ef772bd3a53f0903d172b64fda5f18cc7ac6de96fae22bf WatchSource:0}: Error finding container 9ae0831f16338e600ef772bd3a53f0903d172b64fda5f18cc7ac6de96fae22bf: Status 404 returned error can't find the container with id 9ae0831f16338e600ef772bd3a53f0903d172b64fda5f18cc7ac6de96fae22bf Jun 09 15:14:38.838092 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:38.838059 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:38.962209 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:38.962173 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lzzwp" event={"ID":"6b28ccdc-16bc-4318-b2b1-4b6654b53338","Type":"ContainerStarted","Data":"9ae0831f16338e600ef772bd3a53f0903d172b64fda5f18cc7ac6de96fae22bf"} Jun 09 15:14:40.972778 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:40.972730 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lzzwp" event={"ID":"6b28ccdc-16bc-4318-b2b1-4b6654b53338","Type":"ContainerStarted","Data":"1feeda59e37855230ebd1dec468a5c75fce54877a3b0027f085f2d59c8876098"} Jun 09 15:14:40.973243 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:40.972866 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lzzwp" Jun 09 15:14:41.001895 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:41.001847 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lzzwp" podStartSLOduration=1.356309384 podStartE2EDuration="4.00183253s" totalImagesPullingTime="2.645523146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:41.000431934 +0000 UTC m=+739.065006423" watchObservedRunningTime="2026-06-09 15:14:41.00183253 +0000 UTC m=+739.066407045" Jun 09 15:14:41.988527 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:41.988487 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:43.657840 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:43.657807 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:45.227476 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:45.227440 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:46.611290 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:46.611254 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:47.826324 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:47.826293 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:48.237403 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:48.237370 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qk5f2"] Jun 09 15:14:48.239660 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:48.239641 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qk5f2" Jun 09 15:14:48.242658 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:48.242635 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xqlls\"" Jun 09 15:14:48.243219 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:48.243203 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 15:14:48.271577 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:48.271556 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qk5f2"] Jun 09 15:14:48.276315 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:48.276294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk2x4\" (UniqueName: \"kubernetes.io/projected/9088d720-9608-421a-aaeb-100aa162f324-kube-api-access-sk2x4\") pod \"dns-operator-controller-manager-864dd78c4c-qk5f2\" (UID: \"9088d720-9608-421a-aaeb-100aa162f324\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qk5f2" Jun 09 15:14:48.377398 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:48.377366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk2x4\" (UniqueName: \"kubernetes.io/projected/9088d720-9608-421a-aaeb-100aa162f324-kube-api-access-sk2x4\") pod \"dns-operator-controller-manager-864dd78c4c-qk5f2\" (UID: \"9088d720-9608-421a-aaeb-100aa162f324\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qk5f2" Jun 09 15:14:48.388848 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:48.388822 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk2x4\" (UniqueName: \"kubernetes.io/projected/9088d720-9608-421a-aaeb-100aa162f324-kube-api-access-sk2x4\") pod \"dns-operator-controller-manager-864dd78c4c-qk5f2\" (UID: \"9088d720-9608-421a-aaeb-100aa162f324\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qk5f2" Jun 09 15:14:48.549252 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:48.549169 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qk5f2" Jun 09 15:14:48.676451 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:48.676420 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qk5f2"] Jun 09 15:14:48.679709 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:14:48.679683 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9088d720_9608_421a_aaeb_100aa162f324.slice/crio-495e8f899d77eb267ed74b0bdff4cc1c8ce9a51d0603e5a96a5f4f6310d54bab WatchSource:0}: Error finding container 495e8f899d77eb267ed74b0bdff4cc1c8ce9a51d0603e5a96a5f4f6310d54bab: Status 404 returned error can't find the container with id 495e8f899d77eb267ed74b0bdff4cc1c8ce9a51d0603e5a96a5f4f6310d54bab Jun 09 15:14:49.006973 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:49.006945 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qk5f2" event={"ID":"9088d720-9608-421a-aaeb-100aa162f324","Type":"ContainerStarted","Data":"495e8f899d77eb267ed74b0bdff4cc1c8ce9a51d0603e5a96a5f4f6310d54bab"} Jun 09 15:14:49.771762 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:49.771729 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:49.835706 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:49.835680 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:50.168084 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:50.168014 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:50.248518 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:50.248489 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:51.979031 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:51.979002 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lzzwp" Jun 09 15:14:52.020719 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:52.020685 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qk5f2" event={"ID":"9088d720-9608-421a-aaeb-100aa162f324","Type":"ContainerStarted","Data":"5b1ae8a33f12a34f0d41a7eb8cb9dde5720d2daa0fd19184964609792e097f37"} Jun 09 15:14:52.020886 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:52.020818 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qk5f2" Jun 09 15:14:52.045201 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:52.045158 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qk5f2" podStartSLOduration=1.258171927 podStartE2EDuration="4.045144382s" totalImagesPullingTime="2.786972455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:52.043238183 +0000 UTC m=+750.107812633" watchObservedRunningTime="2026-06-09 15:14:52.045144382 +0000 UTC m=+750.109718894" Jun 09 15:14:53.767283 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:53.767248 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:53.867329 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:53.867293 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:56.987381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:56.987347 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:57.084001 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:57.083975 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:58.257886 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.257852 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn"] Jun 09 15:14:58.262106 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.262084 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" Jun 09 15:14:58.264379 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.264355 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 15:14:58.264525 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.264442 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5tg9d\"" Jun 09 15:14:58.264525 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.264441 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 15:14:58.268365 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.268339 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:58.269584 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.269562 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn"] Jun 09 15:14:58.353088 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.353055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e12295cb-77b7-4cdb-b157-c5a4aef81b42-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6wxhn\" (UID: \"e12295cb-77b7-4cdb-b157-c5a4aef81b42\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" Jun 09 15:14:58.353251 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.353095 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjvp5\" (UniqueName: \"kubernetes.io/projected/e12295cb-77b7-4cdb-b157-c5a4aef81b42-kube-api-access-gjvp5\") pod \"kuadrant-console-plugin-66b5774985-6wxhn\" (UID: \"e12295cb-77b7-4cdb-b157-c5a4aef81b42\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" Jun 09 15:14:58.353251 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.353174 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e12295cb-77b7-4cdb-b157-c5a4aef81b42-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6wxhn\" (UID: \"e12295cb-77b7-4cdb-b157-c5a4aef81b42\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" Jun 09 15:14:58.453592 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.453556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e12295cb-77b7-4cdb-b157-c5a4aef81b42-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6wxhn\" (UID: \"e12295cb-77b7-4cdb-b157-c5a4aef81b42\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" Jun 09 15:14:58.453748 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.453649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e12295cb-77b7-4cdb-b157-c5a4aef81b42-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6wxhn\" (UID: \"e12295cb-77b7-4cdb-b157-c5a4aef81b42\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" Jun 09 15:14:58.453748 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.453673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjvp5\" (UniqueName: \"kubernetes.io/projected/e12295cb-77b7-4cdb-b157-c5a4aef81b42-kube-api-access-gjvp5\") pod \"kuadrant-console-plugin-66b5774985-6wxhn\" (UID: \"e12295cb-77b7-4cdb-b157-c5a4aef81b42\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" Jun 09 15:14:58.453748 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:14:58.453688 2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 09 15:14:58.453858 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:14:58.453763 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12295cb-77b7-4cdb-b157-c5a4aef81b42-plugin-serving-cert podName:e12295cb-77b7-4cdb-b157-c5a4aef81b42 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:58.953746796 +0000 UTC m=+757.018321224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e12295cb-77b7-4cdb-b157-c5a4aef81b42-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-6wxhn" (UID: "e12295cb-77b7-4cdb-b157-c5a4aef81b42") : secret "plugin-serving-cert" not found Jun 09 15:14:58.454300 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.454282 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e12295cb-77b7-4cdb-b157-c5a4aef81b42-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6wxhn\" (UID: \"e12295cb-77b7-4cdb-b157-c5a4aef81b42\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" Jun 09 15:14:58.463112 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.463082 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjvp5\" (UniqueName: \"kubernetes.io/projected/e12295cb-77b7-4cdb-b157-c5a4aef81b42-kube-api-access-gjvp5\") pod \"kuadrant-console-plugin-66b5774985-6wxhn\" (UID: \"e12295cb-77b7-4cdb-b157-c5a4aef81b42\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" Jun 09 15:14:58.757964 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.757933 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:58.957017 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.956984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e12295cb-77b7-4cdb-b157-c5a4aef81b42-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6wxhn\" (UID: \"e12295cb-77b7-4cdb-b157-c5a4aef81b42\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" Jun 09 15:14:58.959284 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:58.959253 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e12295cb-77b7-4cdb-b157-c5a4aef81b42-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6wxhn\" (UID: \"e12295cb-77b7-4cdb-b157-c5a4aef81b42\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" Jun 09 15:14:59.171783 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:59.171702 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" Jun 09 15:14:59.297895 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:14:59.297824 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn"] Jun 09 15:14:59.300361 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:14:59.300338 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode12295cb_77b7_4cdb_b157_c5a4aef81b42.slice/crio-d67e33154607a66f2b5ea3e3575e77a9e6ca18babcab873cb558fc5206c910b2 WatchSource:0}: Error finding container d67e33154607a66f2b5ea3e3575e77a9e6ca18babcab873cb558fc5206c910b2: Status 404 returned error can't find the container with id d67e33154607a66f2b5ea3e3575e77a9e6ca18babcab873cb558fc5206c910b2 Jun 09 15:15:00.053910 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:00.053876 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" event={"ID":"e12295cb-77b7-4cdb-b157-c5a4aef81b42","Type":"ContainerStarted","Data":"d67e33154607a66f2b5ea3e3575e77a9e6ca18babcab873cb558fc5206c910b2"} Jun 09 15:15:03.026812 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:03.026775 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qk5f2" Jun 09 15:15:03.603278 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:03.603244 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:03.778437 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:03.778404 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:06.788155 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:15:06.788109 2577 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:87eaaaafa46101e12baff2281b088832a6274eee10812ea5de4b494cb3ef4a65: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/kuadrant/console-plugin:v0.3.4" Jun 09 15:15:06.788563 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:15:06.788253 2577 kuberuntime_manager.go:1459] "Unhandled Error" err="container kuadrant-console-plugin start failed in pod kuadrant-console-plugin-66b5774985-6wxhn_kuadrant-system(e12295cb-77b7-4cdb-b157-c5a4aef81b42): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:87eaaaafa46101e12baff2281b088832a6274eee10812ea5de4b494cb3ef4a65: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError" Jun 09 15:15:06.788563 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:15:06.788305 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kuadrant-console-plugin\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:87eaaaafa46101e12baff2281b088832a6274eee10812ea5de4b494cb3ef4a65: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" podUID="e12295cb-77b7-4cdb-b157-c5a4aef81b42" Jun 09 15:15:07.085644 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:15:07.085584 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kuadrant-console-plugin\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/kuadrant/console-plugin:v0.3.4\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:87eaaaafa46101e12baff2281b088832a6274eee10812ea5de4b494cb3ef4a65: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" podUID="e12295cb-77b7-4cdb-b157-c5a4aef81b42" Jun 09 15:15:08.184650 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.184597 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz"] Jun 09 15:15:08.187002 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.186985 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:08.190262 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.190242 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k4jg2\"" Jun 09 15:15:08.204756 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.204729 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz"] Jun 09 15:15:08.240096 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.240072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a3c381d-39cf-41ce-b220-3dd9be3029e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-r29gz\" (UID: \"2a3c381d-39cf-41ce-b220-3dd9be3029e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:08.240205 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.240129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkkm4\" (UniqueName: \"kubernetes.io/projected/2a3c381d-39cf-41ce-b220-3dd9be3029e1-kube-api-access-dkkm4\") pod \"kuadrant-operator-controller-manager-55467d9f7-r29gz\" (UID: \"2a3c381d-39cf-41ce-b220-3dd9be3029e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:08.341389 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.341357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a3c381d-39cf-41ce-b220-3dd9be3029e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-r29gz\" (UID: \"2a3c381d-39cf-41ce-b220-3dd9be3029e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:08.341542 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.341412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkkm4\" (UniqueName: \"kubernetes.io/projected/2a3c381d-39cf-41ce-b220-3dd9be3029e1-kube-api-access-dkkm4\") pod \"kuadrant-operator-controller-manager-55467d9f7-r29gz\" (UID: \"2a3c381d-39cf-41ce-b220-3dd9be3029e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:08.341775 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.341755 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a3c381d-39cf-41ce-b220-3dd9be3029e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-r29gz\" (UID: \"2a3c381d-39cf-41ce-b220-3dd9be3029e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:08.352857 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.352839 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkkm4\" (UniqueName: \"kubernetes.io/projected/2a3c381d-39cf-41ce-b220-3dd9be3029e1-kube-api-access-dkkm4\") pod \"kuadrant-operator-controller-manager-55467d9f7-r29gz\" (UID: \"2a3c381d-39cf-41ce-b220-3dd9be3029e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:08.457964 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.457938 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz"] Jun 09 15:15:08.458215 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.458201 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:08.462295 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.462273 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz"] Jun 09 15:15:08.493229 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.493201 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2"] Jun 09 15:15:08.496097 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.496082 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" Jun 09 15:15:08.523005 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.522977 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2"] Jun 09 15:15:08.543194 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.543163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k6c6\" (UniqueName: \"kubernetes.io/projected/ca84b830-d6e4-4832-972d-705ec3e7e026-kube-api-access-6k6c6\") pod \"kuadrant-operator-controller-manager-55467d9f7-fwjp2\" (UID: \"ca84b830-d6e4-4832-972d-705ec3e7e026\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" Jun 09 15:15:08.543339 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.543228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca84b830-d6e4-4832-972d-705ec3e7e026-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fwjp2\" (UID: \"ca84b830-d6e4-4832-972d-705ec3e7e026\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" Jun 09 15:15:08.644405 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.644363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6c6\" (UniqueName: \"kubernetes.io/projected/ca84b830-d6e4-4832-972d-705ec3e7e026-kube-api-access-6k6c6\") pod \"kuadrant-operator-controller-manager-55467d9f7-fwjp2\" (UID: \"ca84b830-d6e4-4832-972d-705ec3e7e026\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" Jun 09 15:15:08.644573 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.644426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca84b830-d6e4-4832-972d-705ec3e7e026-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fwjp2\" (UID: \"ca84b830-d6e4-4832-972d-705ec3e7e026\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" Jun 09 15:15:08.644879 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.644860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca84b830-d6e4-4832-972d-705ec3e7e026-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fwjp2\" (UID: \"ca84b830-d6e4-4832-972d-705ec3e7e026\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" Jun 09 15:15:08.652901 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.652884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k6c6\" (UniqueName: \"kubernetes.io/projected/ca84b830-d6e4-4832-972d-705ec3e7e026-kube-api-access-6k6c6\") pod \"kuadrant-operator-controller-manager-55467d9f7-fwjp2\" (UID: \"ca84b830-d6e4-4832-972d-705ec3e7e026\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" Jun 09 15:15:08.807667 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.807572 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" Jun 09 15:15:08.946422 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:08.946390 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2"] Jun 09 15:15:08.950195 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:15:08.950163 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca84b830_d6e4_4832_972d_705ec3e7e026.slice/crio-62553f2a921d25908db6bbd9fcfdc58ad175244597409a7bfeeef61922278157 WatchSource:0}: Error finding container 62553f2a921d25908db6bbd9fcfdc58ad175244597409a7bfeeef61922278157: Status 404 returned error can't find the container with id 62553f2a921d25908db6bbd9fcfdc58ad175244597409a7bfeeef61922278157 Jun 09 15:15:09.094374 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:09.094288 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" event={"ID":"ca84b830-d6e4-4832-972d-705ec3e7e026","Type":"ContainerStarted","Data":"62553f2a921d25908db6bbd9fcfdc58ad175244597409a7bfeeef61922278157"} Jun 09 15:15:09.263133 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:09.263101 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:09.358238 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:09.358159 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:09.671065 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:09.670994 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:09.771724 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:09.771687 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:10.997957 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:15:10.997908 2577 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-r29gz_kuadrant-system_2a3c381d-39cf-41ce-b220-3dd9be3029e1_0(0c943162738afd871ae74b4a52e5a64ac65a035914f95aa45d700662b95e5810): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-r29gz to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 09 15:15:10.998222 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:15:10.997982 2577 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-r29gz_kuadrant-system_2a3c381d-39cf-41ce-b220-3dd9be3029e1_0(0c943162738afd871ae74b4a52e5a64ac65a035914f95aa45d700662b95e5810): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-r29gz to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:11.103491 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:11.103457 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:11.110803 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:11.110771 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:11.113526 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:15:11.113493 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-r29gz\" is forbidden: User \"system:node:ip-10-0-131-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-236.ec2.internal' and this object" podUID="2a3c381d-39cf-41ce-b220-3dd9be3029e1" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:11.168053 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:11.168025 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkkm4\" (UniqueName: \"kubernetes.io/projected/2a3c381d-39cf-41ce-b220-3dd9be3029e1-kube-api-access-dkkm4\") pod \"2a3c381d-39cf-41ce-b220-3dd9be3029e1\" (UID: \"2a3c381d-39cf-41ce-b220-3dd9be3029e1\") " Jun 09 15:15:11.168197 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:11.168081 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a3c381d-39cf-41ce-b220-3dd9be3029e1-extensions-socket-volume\") pod \"2a3c381d-39cf-41ce-b220-3dd9be3029e1\" (UID: \"2a3c381d-39cf-41ce-b220-3dd9be3029e1\") " Jun 09 15:15:11.168448 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:11.168419 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a3c381d-39cf-41ce-b220-3dd9be3029e1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2a3c381d-39cf-41ce-b220-3dd9be3029e1" (UID: "2a3c381d-39cf-41ce-b220-3dd9be3029e1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:15:11.170499 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:11.170476 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a3c381d-39cf-41ce-b220-3dd9be3029e1-kube-api-access-dkkm4" (OuterVolumeSpecName: "kube-api-access-dkkm4") pod "2a3c381d-39cf-41ce-b220-3dd9be3029e1" (UID: "2a3c381d-39cf-41ce-b220-3dd9be3029e1"). InnerVolumeSpecName "kube-api-access-dkkm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:15:11.268935 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:11.268847 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a3c381d-39cf-41ce-b220-3dd9be3029e1-extensions-socket-volume\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:15:11.268935 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:11.268879 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkkm4\" (UniqueName: \"kubernetes.io/projected/2a3c381d-39cf-41ce-b220-3dd9be3029e1-kube-api-access-dkkm4\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:15:12.107377 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:12.107345 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:12.109511 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:15:12.109478 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-r29gz\" is forbidden: User \"system:node:ip-10-0-131-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-236.ec2.internal' and this object" podUID="2a3c381d-39cf-41ce-b220-3dd9be3029e1" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:12.115088 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:15:12.115062 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-r29gz\" is forbidden: User \"system:node:ip-10-0-131-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-236.ec2.internal' and this object" podUID="2a3c381d-39cf-41ce-b220-3dd9be3029e1" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:12.376451 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:15:12.376376 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-r29gz\" is forbidden: User \"system:node:ip-10-0-131-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-236.ec2.internal' and this object" podUID="2a3c381d-39cf-41ce-b220-3dd9be3029e1" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r29gz" Jun 09 15:15:12.378704 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:12.378679 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a3c381d-39cf-41ce-b220-3dd9be3029e1" path="/var/lib/kubelet/pods/2a3c381d-39cf-41ce-b220-3dd9be3029e1/volumes" Jun 09 15:15:13.067446 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:13.067409 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:13.186269 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:13.186239 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:14.118127 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:14.118091 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" event={"ID":"ca84b830-d6e4-4832-972d-705ec3e7e026","Type":"ContainerStarted","Data":"c1ea9a0ec2d79c97a5a140473e21f14abb7b44a50403353614286d48327d4180"} Jun 09 15:15:14.118298 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:14.118193 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" Jun 09 15:15:14.142775 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:14.142725 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" podStartSLOduration=1.545112607 podStartE2EDuration="6.142708801s" totalImagesPullingTime="4.597596194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:14.140892123 +0000 UTC m=+772.205466598" watchObservedRunningTime="2026-06-09 15:15:14.142708801 +0000 UTC m=+772.207283251" Jun 09 15:15:15.608511 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:15.608479 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:15.709432 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:15.709394 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:22.104571 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:22.104537 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:22.202587 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:22.202553 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:25.124562 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:25.124530 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" Jun 09 15:15:37.751365 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:37.751330 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2"] Jun 09 15:15:37.751889 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:37.751627 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" podUID="ca84b830-d6e4-4832-972d-705ec3e7e026" containerName="manager" containerID="cri-o://c1ea9a0ec2d79c97a5a140473e21f14abb7b44a50403353614286d48327d4180" gracePeriod=10 Jun 09 15:15:38.622819 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:38.622769 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:38.731068 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:38.731017 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:41.513462 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.513427 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd"] Jun 09 15:15:41.564180 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.564120 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:41.584784 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.584746 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd"] Jun 09 15:15:41.584933 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.584841 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.587250 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.587215 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bg2nr\"" Jun 09 15:15:41.624902 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.624845 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:41.632478 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.632448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d1a401c-03ab-4b5a-a520-400a445540f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.632664 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.632501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.632664 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.632525 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.632664 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.632576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d1a401c-03ab-4b5a-a520-400a445540f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.632664 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.632632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zczg\" (UniqueName: \"kubernetes.io/projected/7d1a401c-03ab-4b5a-a520-400a445540f9-kube-api-access-7zczg\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.632932 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.632704 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.632932 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.632731 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d1a401c-03ab-4b5a-a520-400a445540f9-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.632932 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.632767 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.632932 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.632802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.733840 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.733807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.734016 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.733852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d1a401c-03ab-4b5a-a520-400a445540f9-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.734016 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.733888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.734016 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.733927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.734016 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.733975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d1a401c-03ab-4b5a-a520-400a445540f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.734254 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.734021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.734254 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.734047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.734254 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.734079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d1a401c-03ab-4b5a-a520-400a445540f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.734254 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.734111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zczg\" (UniqueName: \"kubernetes.io/projected/7d1a401c-03ab-4b5a-a520-400a445540f9-kube-api-access-7zczg\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.734469 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.734364 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.734924 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.734883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.735053 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.734889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d1a401c-03ab-4b5a-a520-400a445540f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.735132 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.735116 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.735191 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.735145 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.736657 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.736634 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d1a401c-03ab-4b5a-a520-400a445540f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.737103 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.737075 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d1a401c-03ab-4b5a-a520-400a445540f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.743028 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.742993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zczg\" (UniqueName: \"kubernetes.io/projected/7d1a401c-03ab-4b5a-a520-400a445540f9-kube-api-access-7zczg\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.743178 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.743124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d1a401c-03ab-4b5a-a520-400a445540f9-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-mc5bd\" (UID: \"7d1a401c-03ab-4b5a-a520-400a445540f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:41.896640 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:41.896495 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:43.997321 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:43.997298 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" Jun 09 15:15:44.007411 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.007390 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd"] Jun 09 15:15:44.008784 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:15:44.008750 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1a401c_03ab_4b5a_a520_400a445540f9.slice/crio-e8ed77bc36ae8d39ce0de62e5903afb73db80cec10ce842814b74c05d46aaa3e WatchSource:0}: Error finding container e8ed77bc36ae8d39ce0de62e5903afb73db80cec10ce842814b74c05d46aaa3e: Status 404 returned error can't find the container with id e8ed77bc36ae8d39ce0de62e5903afb73db80cec10ce842814b74c05d46aaa3e Jun 09 15:15:44.010735 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.010708 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:15:44.010835 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.010778 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:15:44.010835 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.010822 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:15:44.053530 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.053504 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca84b830-d6e4-4832-972d-705ec3e7e026-extensions-socket-volume\") pod \"ca84b830-d6e4-4832-972d-705ec3e7e026\" (UID: \"ca84b830-d6e4-4832-972d-705ec3e7e026\") " Jun 09 15:15:44.053651 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.053602 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k6c6\" (UniqueName: \"kubernetes.io/projected/ca84b830-d6e4-4832-972d-705ec3e7e026-kube-api-access-6k6c6\") pod \"ca84b830-d6e4-4832-972d-705ec3e7e026\" (UID: \"ca84b830-d6e4-4832-972d-705ec3e7e026\") " Jun 09 15:15:44.053904 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.053878 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca84b830-d6e4-4832-972d-705ec3e7e026-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ca84b830-d6e4-4832-972d-705ec3e7e026" (UID: "ca84b830-d6e4-4832-972d-705ec3e7e026"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:15:44.055412 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.055391 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca84b830-d6e4-4832-972d-705ec3e7e026-kube-api-access-6k6c6" (OuterVolumeSpecName: "kube-api-access-6k6c6") pod "ca84b830-d6e4-4832-972d-705ec3e7e026" (UID: "ca84b830-d6e4-4832-972d-705ec3e7e026"). InnerVolumeSpecName "kube-api-access-6k6c6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:15:44.154902 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.154819 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k6c6\" (UniqueName: \"kubernetes.io/projected/ca84b830-d6e4-4832-972d-705ec3e7e026-kube-api-access-6k6c6\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:15:44.154902 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.154855 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca84b830-d6e4-4832-972d-705ec3e7e026-extensions-socket-volume\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:15:44.267573 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.267519 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" event={"ID":"7d1a401c-03ab-4b5a-a520-400a445540f9","Type":"ContainerStarted","Data":"4a47130b9790b6ad3504be5f82a1493524864527b31797a5b6acfb1fa7766f57"} Jun 09 15:15:44.267766 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.267628 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" event={"ID":"7d1a401c-03ab-4b5a-a520-400a445540f9","Type":"ContainerStarted","Data":"e8ed77bc36ae8d39ce0de62e5903afb73db80cec10ce842814b74c05d46aaa3e"} Jun 09 15:15:44.269407 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.269376 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" event={"ID":"e12295cb-77b7-4cdb-b157-c5a4aef81b42","Type":"ContainerStarted","Data":"f4bbbb1f4000f47a1182761a69176fd6800bb1e8478128d9a3e42c760d0cac8e"} Jun 09 15:15:44.270953 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.270925 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca84b830-d6e4-4832-972d-705ec3e7e026" containerID="c1ea9a0ec2d79c97a5a140473e21f14abb7b44a50403353614286d48327d4180" exitCode=0 Jun 09 15:15:44.271082 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.270989 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" Jun 09 15:15:44.271082 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.271006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" event={"ID":"ca84b830-d6e4-4832-972d-705ec3e7e026","Type":"ContainerDied","Data":"c1ea9a0ec2d79c97a5a140473e21f14abb7b44a50403353614286d48327d4180"} Jun 09 15:15:44.271082 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.271062 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2" event={"ID":"ca84b830-d6e4-4832-972d-705ec3e7e026","Type":"ContainerDied","Data":"62553f2a921d25908db6bbd9fcfdc58ad175244597409a7bfeeef61922278157"} Jun 09 15:15:44.271240 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.271092 2577 scope.go:117] "RemoveContainer" containerID="c1ea9a0ec2d79c97a5a140473e21f14abb7b44a50403353614286d48327d4180" Jun 09 15:15:44.285481 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.285460 2577 scope.go:117] "RemoveContainer" containerID="c1ea9a0ec2d79c97a5a140473e21f14abb7b44a50403353614286d48327d4180" Jun 09 15:15:44.285874 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:15:44.285833 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1ea9a0ec2d79c97a5a140473e21f14abb7b44a50403353614286d48327d4180\": container with ID starting with c1ea9a0ec2d79c97a5a140473e21f14abb7b44a50403353614286d48327d4180 not found: ID does not exist" containerID="c1ea9a0ec2d79c97a5a140473e21f14abb7b44a50403353614286d48327d4180" Jun 09 15:15:44.285957 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.285869 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1ea9a0ec2d79c97a5a140473e21f14abb7b44a50403353614286d48327d4180"} err="failed to get container status \"c1ea9a0ec2d79c97a5a140473e21f14abb7b44a50403353614286d48327d4180\": rpc error: code = NotFound desc = could not find container \"c1ea9a0ec2d79c97a5a140473e21f14abb7b44a50403353614286d48327d4180\": container with ID starting with c1ea9a0ec2d79c97a5a140473e21f14abb7b44a50403353614286d48327d4180 not found: ID does not exist" Jun 09 15:15:44.289304 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.289252 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" podStartSLOduration=3.2892365359999998 podStartE2EDuration="3.289236536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:15:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:44.287813824 +0000 UTC m=+802.352388277" watchObservedRunningTime="2026-06-09 15:15:44.289236536 +0000 UTC m=+802.353810989" Jun 09 15:15:44.304460 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.304436 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2"] Jun 09 15:15:44.309352 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.309332 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwjp2"] Jun 09 15:15:44.324433 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.324395 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wxhn" podStartSLOduration=1.697463719 podStartE2EDuration="46.32438208s" totalImagesPullingTime="44.626918361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-06-09 15:15:44.322989933 +0000 UTC m=+802.387564384" watchObservedRunningTime="2026-06-09 15:15:44.32438208 +0000 UTC m=+802.388956530" Jun 09 15:15:44.379944 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.379915 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca84b830-d6e4-4832-972d-705ec3e7e026" path="/var/lib/kubelet/pods/ca84b830-d6e4-4832-972d-705ec3e7e026/volumes" Jun 09 15:15:44.897323 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:44.897294 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:45.410890 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:45.410861 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:45.901529 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:45.901501 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:46.281036 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:46.281008 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:46.281911 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:46.281893 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:15:55.315653 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:55.315602 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:55.426883 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:55.426851 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:55.495282 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:55.495253 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:56.183647 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.183616 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-l944g"] Jun 09 15:15:56.183927 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.183915 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca84b830-d6e4-4832-972d-705ec3e7e026" containerName="manager" Jun 09 15:15:56.183976 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.183930 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca84b830-d6e4-4832-972d-705ec3e7e026" containerName="manager" Jun 09 15:15:56.184011 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.183991 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca84b830-d6e4-4832-972d-705ec3e7e026" containerName="manager" Jun 09 15:15:56.185835 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.185817 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l944g" Jun 09 15:15:56.188679 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.188656 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-w54cr\"" Jun 09 15:15:56.198381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.198142 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-l944g"] Jun 09 15:15:56.224699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.224676 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:56.255019 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.254992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvv54\" (UniqueName: \"kubernetes.io/projected/b7f6d672-6138-4e21-aa03-43c0ac98610c-kube-api-access-rvv54\") pod \"authorino-58cd955675-l944g\" (UID: \"b7f6d672-6138-4e21-aa03-43c0ac98610c\") " pod="kuadrant-system/authorino-58cd955675-l944g" Jun 09 15:15:56.292473 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.292448 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:56.355765 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.355735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvv54\" (UniqueName: \"kubernetes.io/projected/b7f6d672-6138-4e21-aa03-43c0ac98610c-kube-api-access-rvv54\") pod \"authorino-58cd955675-l944g\" (UID: \"b7f6d672-6138-4e21-aa03-43c0ac98610c\") " pod="kuadrant-system/authorino-58cd955675-l944g" Jun 09 15:15:56.365157 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.365132 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvv54\" (UniqueName: \"kubernetes.io/projected/b7f6d672-6138-4e21-aa03-43c0ac98610c-kube-api-access-rvv54\") pod \"authorino-58cd955675-l944g\" (UID: \"b7f6d672-6138-4e21-aa03-43c0ac98610c\") " pod="kuadrant-system/authorino-58cd955675-l944g" Jun 09 15:15:56.501217 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.501181 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l944g" Jun 09 15:15:56.557312 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.557064 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-d57x7"] Jun 09 15:15:56.559899 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.559873 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d57x7" Jun 09 15:15:56.565739 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.565713 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d57x7"] Jun 09 15:15:56.634316 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.634289 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-l944g"] Jun 09 15:15:56.636388 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:15:56.636364 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7f6d672_6138_4e21_aa03_43c0ac98610c.slice/crio-c7ef9cc8e675160393a0af16a206f58b858fa4b70904a0055060ba319ea453a8 WatchSource:0}: Error finding container c7ef9cc8e675160393a0af16a206f58b858fa4b70904a0055060ba319ea453a8: Status 404 returned error can't find the container with id c7ef9cc8e675160393a0af16a206f58b858fa4b70904a0055060ba319ea453a8 Jun 09 15:15:56.658042 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.658014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz6dj\" (UniqueName: \"kubernetes.io/projected/4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba-kube-api-access-zz6dj\") pod \"authorino-75d556bd77-d57x7\" (UID: \"4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba\") " pod="kuadrant-system/authorino-75d556bd77-d57x7" Jun 09 15:15:56.759402 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.759321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz6dj\" (UniqueName: \"kubernetes.io/projected/4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba-kube-api-access-zz6dj\") pod \"authorino-75d556bd77-d57x7\" (UID: \"4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba\") " pod="kuadrant-system/authorino-75d556bd77-d57x7" Jun 09 15:15:56.768192 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.768168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz6dj\" (UniqueName: \"kubernetes.io/projected/4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba-kube-api-access-zz6dj\") pod \"authorino-75d556bd77-d57x7\" (UID: \"4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba\") " pod="kuadrant-system/authorino-75d556bd77-d57x7" Jun 09 15:15:56.871665 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.871633 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d57x7" Jun 09 15:15:56.997232 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:56.997207 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d57x7"] Jun 09 15:15:56.999031 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:15:56.999005 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ce2cd10_77aa_4dd4_b00d_ae5d9ab114ba.slice/crio-58489112b6b9f049ad8686c9af5c28c21bcfb8eb6f4abc4735132a4686d78c27 WatchSource:0}: Error finding container 58489112b6b9f049ad8686c9af5c28c21bcfb8eb6f4abc4735132a4686d78c27: Status 404 returned error can't find the container with id 58489112b6b9f049ad8686c9af5c28c21bcfb8eb6f4abc4735132a4686d78c27 Jun 09 15:15:57.328974 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:57.328936 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d57x7" event={"ID":"4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba","Type":"ContainerStarted","Data":"58489112b6b9f049ad8686c9af5c28c21bcfb8eb6f4abc4735132a4686d78c27"} Jun 09 15:15:57.330881 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:15:57.330853 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l944g" event={"ID":"b7f6d672-6138-4e21-aa03-43c0ac98610c","Type":"ContainerStarted","Data":"c7ef9cc8e675160393a0af16a206f58b858fa4b70904a0055060ba319ea453a8"} Jun 09 15:16:00.348397 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:00.348356 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d57x7" event={"ID":"4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba","Type":"ContainerStarted","Data":"380363da2c73a6a26adcc6cbd778f0b2736b05e58afda65269f9e006fff4ec51"} Jun 09 15:16:00.350923 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:00.350896 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l944g" event={"ID":"b7f6d672-6138-4e21-aa03-43c0ac98610c","Type":"ContainerStarted","Data":"b96e84d7626e7882f5fdeb2ab877ea3edfaf78703528281571c04f8c09741d55"} Jun 09 15:16:00.367411 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:00.367365 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-d57x7" podStartSLOduration=1.15012905 podStartE2EDuration="4.367349773s" totalImagesPullingTime="3.217220723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:16:00.364423745 +0000 UTC m=+818.428998198" watchObservedRunningTime="2026-06-09 15:16:00.367349773 +0000 UTC m=+818.431924224" Jun 09 15:16:00.396932 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:00.396877 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-l944g" podStartSLOduration=0.807057904 podStartE2EDuration="4.39685927s" totalImagesPullingTime="3.589801366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:16:00.395814339 +0000 UTC m=+818.460388790" watchObservedRunningTime="2026-06-09 15:16:00.39685927 +0000 UTC m=+818.461433721" Jun 09 15:16:00.450897 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:00.450866 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-l944g"] Jun 09 15:16:02.365174 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:02.365120 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-l944g" podUID="b7f6d672-6138-4e21-aa03-43c0ac98610c" containerName="authorino" containerID="cri-o://b96e84d7626e7882f5fdeb2ab877ea3edfaf78703528281571c04f8c09741d55" gracePeriod=30 Jun 09 15:16:02.656457 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:02.656397 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l944g" Jun 09 15:16:02.711450 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:02.711427 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvv54\" (UniqueName: \"kubernetes.io/projected/b7f6d672-6138-4e21-aa03-43c0ac98610c-kube-api-access-rvv54\") pod \"b7f6d672-6138-4e21-aa03-43c0ac98610c\" (UID: \"b7f6d672-6138-4e21-aa03-43c0ac98610c\") " Jun 09 15:16:02.713432 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:02.713401 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7f6d672-6138-4e21-aa03-43c0ac98610c-kube-api-access-rvv54" (OuterVolumeSpecName: "kube-api-access-rvv54") pod "b7f6d672-6138-4e21-aa03-43c0ac98610c" (UID: "b7f6d672-6138-4e21-aa03-43c0ac98610c"). InnerVolumeSpecName "kube-api-access-rvv54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:16:02.812406 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:02.812378 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvv54\" (UniqueName: \"kubernetes.io/projected/b7f6d672-6138-4e21-aa03-43c0ac98610c-kube-api-access-rvv54\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:16:03.369970 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:03.369931 2577 generic.go:356] "Generic (PLEG): container finished" podID="b7f6d672-6138-4e21-aa03-43c0ac98610c" containerID="b96e84d7626e7882f5fdeb2ab877ea3edfaf78703528281571c04f8c09741d55" exitCode=0 Jun 09 15:16:03.369970 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:03.369973 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l944g" Jun 09 15:16:03.370441 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:03.369987 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l944g" event={"ID":"b7f6d672-6138-4e21-aa03-43c0ac98610c","Type":"ContainerDied","Data":"b96e84d7626e7882f5fdeb2ab877ea3edfaf78703528281571c04f8c09741d55"} Jun 09 15:16:03.370441 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:03.370016 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l944g" event={"ID":"b7f6d672-6138-4e21-aa03-43c0ac98610c","Type":"ContainerDied","Data":"c7ef9cc8e675160393a0af16a206f58b858fa4b70904a0055060ba319ea453a8"} Jun 09 15:16:03.370441 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:03.370031 2577 scope.go:117] "RemoveContainer" containerID="b96e84d7626e7882f5fdeb2ab877ea3edfaf78703528281571c04f8c09741d55" Jun 09 15:16:03.378379 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:03.378357 2577 scope.go:117] "RemoveContainer" containerID="b96e84d7626e7882f5fdeb2ab877ea3edfaf78703528281571c04f8c09741d55" Jun 09 15:16:03.378661 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:16:03.378638 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b96e84d7626e7882f5fdeb2ab877ea3edfaf78703528281571c04f8c09741d55\": container with ID starting with b96e84d7626e7882f5fdeb2ab877ea3edfaf78703528281571c04f8c09741d55 not found: ID does not exist" containerID="b96e84d7626e7882f5fdeb2ab877ea3edfaf78703528281571c04f8c09741d55" Jun 09 15:16:03.378746 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:03.378671 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96e84d7626e7882f5fdeb2ab877ea3edfaf78703528281571c04f8c09741d55"} err="failed to get container status \"b96e84d7626e7882f5fdeb2ab877ea3edfaf78703528281571c04f8c09741d55\": rpc error: code = NotFound desc = could not find container \"b96e84d7626e7882f5fdeb2ab877ea3edfaf78703528281571c04f8c09741d55\": container with ID starting with b96e84d7626e7882f5fdeb2ab877ea3edfaf78703528281571c04f8c09741d55 not found: ID does not exist" Jun 09 15:16:03.390960 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:03.390937 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-l944g"] Jun 09 15:16:03.398373 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:03.398352 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-l944g"] Jun 09 15:16:04.377754 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:04.377725 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7f6d672-6138-4e21-aa03-43c0ac98610c" path="/var/lib/kubelet/pods/b7f6d672-6138-4e21-aa03-43c0ac98610c/volumes" Jun 09 15:16:12.241444 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:12.241403 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:16:24.528813 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:24.528774 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:16:24.616400 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:24.616367 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:16:24.794517 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:24.794422 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:16:31.836149 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:31.836114 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:16:31.901457 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:31.901424 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:16:55.991191 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:55.991161 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:16:56.290358 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.290274 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:16:56.290585 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.290574 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7f6d672-6138-4e21-aa03-43c0ac98610c" containerName="authorino" Jun 09 15:16:56.290667 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.290587 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7f6d672-6138-4e21-aa03-43c0ac98610c" containerName="authorino" Jun 09 15:16:56.290667 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.290665 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7f6d672-6138-4e21-aa03-43c0ac98610c" containerName="authorino" Jun 09 15:16:56.293129 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.293111 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:16:56.295174 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.295156 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 15:16:56.295296 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.295281 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lc8sf\"" Jun 09 15:16:56.295873 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.295856 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 15:16:56.295926 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.295883 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 15:16:56.306778 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.306759 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:16:56.353355 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.353328 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmhtf\" (UniqueName: \"kubernetes.io/projected/97e361d8-2e44-4ccc-b3f1-8a277a769193-kube-api-access-pmhtf\") pod \"maas-keycloak-0\" (UID: \"97e361d8-2e44-4ccc-b3f1-8a277a769193\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:16:56.454659 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.454588 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmhtf\" (UniqueName: \"kubernetes.io/projected/97e361d8-2e44-4ccc-b3f1-8a277a769193-kube-api-access-pmhtf\") pod \"maas-keycloak-0\" (UID: \"97e361d8-2e44-4ccc-b3f1-8a277a769193\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:16:56.463397 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.463362 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmhtf\" (UniqueName: \"kubernetes.io/projected/97e361d8-2e44-4ccc-b3f1-8a277a769193-kube-api-access-pmhtf\") pod \"maas-keycloak-0\" (UID: \"97e361d8-2e44-4ccc-b3f1-8a277a769193\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:16:56.602676 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.602590 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:16:56.732502 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:56.732476 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:16:56.734829 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:16:56.734794 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97e361d8_2e44_4ccc_b3f1_8a277a769193.slice/crio-99a604644375cc1cb1a0b76c567d2e9ec92100cf5b43af2d43f2d078fcc3aef6 WatchSource:0}: Error finding container 99a604644375cc1cb1a0b76c567d2e9ec92100cf5b43af2d43f2d078fcc3aef6: Status 404 returned error can't find the container with id 99a604644375cc1cb1a0b76c567d2e9ec92100cf5b43af2d43f2d078fcc3aef6 Jun 09 15:16:57.193058 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:57.193019 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:16:57.598495 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:16:57.598456 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"97e361d8-2e44-4ccc-b3f1-8a277a769193","Type":"ContainerStarted","Data":"99a604644375cc1cb1a0b76c567d2e9ec92100cf5b43af2d43f2d078fcc3aef6"} Jun 09 15:17:02.628130 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:02.628099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"97e361d8-2e44-4ccc-b3f1-8a277a769193","Type":"ContainerStarted","Data":"6407c8b8cb8f09d3035ce361f2ed3ebf6c5724d7ac4a62f61e0d94ff260f5d2a"} Jun 09 15:17:02.648833 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:02.648768 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.921588938 podStartE2EDuration="6.648739949s" totalImagesPullingTime="5.727151011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:17:02.64614446 +0000 UTC m=+880.710718911" watchObservedRunningTime="2026-06-09 15:17:02.648739949 +0000 UTC m=+880.713314400" Jun 09 15:17:03.603011 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:03.602977 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 15:17:03.604619 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:03.604573 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 09 15:17:04.604076 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:04.604026 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 09 15:17:05.603288 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:05.603221 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 09 15:17:06.603193 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:06.603154 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 15:17:06.603809 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:06.603484 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 09 15:17:07.603760 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:07.603711 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 09 15:17:08.604062 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:08.604014 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 09 15:17:09.602998 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:09.602944 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 09 15:17:10.603679 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:10.603624 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 09 15:17:11.603080 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:11.603027 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 09 15:17:12.603664 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:12.603595 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 09 15:17:13.603574 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:13.603521 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 09 15:17:14.603416 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:14.603370 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 09 15:17:15.706418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:15.706384 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 15:17:15.724627 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:15.724539 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:17:25.713985 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:25.713948 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 15:17:26.429094 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:26.429040 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:17:26.719751 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:26.719712 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9dlxr"] Jun 09 15:17:26.722040 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:26.722018 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9dlxr" Jun 09 15:17:26.733680 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:26.733658 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9dlxr"] Jun 09 15:17:26.752280 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:26.752260 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:17:26.855762 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:26.855734 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj4tg\" (UniqueName: \"kubernetes.io/projected/7fd12e7f-4538-45e6-a8e3-d3a6664b1c96-kube-api-access-wj4tg\") pod \"authorino-5d4b67c446-9dlxr\" (UID: \"7fd12e7f-4538-45e6-a8e3-d3a6664b1c96\") " pod="kuadrant-system/authorino-5d4b67c446-9dlxr" Jun 09 15:17:26.949983 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:26.949952 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9dlxr"] Jun 09 15:17:26.950216 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:17:26.950197 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wj4tg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-9dlxr" podUID="7fd12e7f-4538-45e6-a8e3-d3a6664b1c96" Jun 09 15:17:26.956550 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:26.956520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj4tg\" (UniqueName: \"kubernetes.io/projected/7fd12e7f-4538-45e6-a8e3-d3a6664b1c96-kube-api-access-wj4tg\") pod \"authorino-5d4b67c446-9dlxr\" (UID: \"7fd12e7f-4538-45e6-a8e3-d3a6664b1c96\") " pod="kuadrant-system/authorino-5d4b67c446-9dlxr" Jun 09 15:17:26.970806 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:26.970753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj4tg\" (UniqueName: \"kubernetes.io/projected/7fd12e7f-4538-45e6-a8e3-d3a6664b1c96-kube-api-access-wj4tg\") pod \"authorino-5d4b67c446-9dlxr\" (UID: \"7fd12e7f-4538-45e6-a8e3-d3a6664b1c96\") " pod="kuadrant-system/authorino-5d4b67c446-9dlxr" Jun 09 15:17:26.977176 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:26.977151 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69bb57548d-v9pdw"] Jun 09 15:17:26.979481 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:26.979463 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69bb57548d-v9pdw" Jun 09 15:17:26.991941 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:26.991922 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69bb57548d-v9pdw"] Jun 09 15:17:27.057685 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.057645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68dmm\" (UniqueName: \"kubernetes.io/projected/0ad81a40-2be9-4e2f-873e-73faf03515b3-kube-api-access-68dmm\") pod \"authorino-69bb57548d-v9pdw\" (UID: \"0ad81a40-2be9-4e2f-873e-73faf03515b3\") " pod="kuadrant-system/authorino-69bb57548d-v9pdw" Jun 09 15:17:27.071021 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.070989 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69bb57548d-v9pdw"] Jun 09 15:17:27.071219 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:17:27.071201 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-68dmm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-69bb57548d-v9pdw" podUID="0ad81a40-2be9-4e2f-873e-73faf03515b3" Jun 09 15:17:27.098224 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.098189 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f644b456d-cnvhj"] Jun 09 15:17:27.100465 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.100446 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f644b456d-cnvhj" Jun 09 15:17:27.104075 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.104057 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 15:17:27.113548 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.113530 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f644b456d-cnvhj"] Jun 09 15:17:27.158831 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.158799 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68dmm\" (UniqueName: \"kubernetes.io/projected/0ad81a40-2be9-4e2f-873e-73faf03515b3-kube-api-access-68dmm\") pod \"authorino-69bb57548d-v9pdw\" (UID: \"0ad81a40-2be9-4e2f-873e-73faf03515b3\") " pod="kuadrant-system/authorino-69bb57548d-v9pdw" Jun 09 15:17:27.158975 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.158907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc5bk\" (UniqueName: \"kubernetes.io/projected/d3492d0f-b330-4695-813c-972f25056988-kube-api-access-qc5bk\") pod \"authorino-6f644b456d-cnvhj\" (UID: \"d3492d0f-b330-4695-813c-972f25056988\") " pod="kuadrant-system/authorino-6f644b456d-cnvhj" Jun 09 15:17:27.158975 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.158951 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3492d0f-b330-4695-813c-972f25056988-tls-cert\") pod \"authorino-6f644b456d-cnvhj\" (UID: \"d3492d0f-b330-4695-813c-972f25056988\") " pod="kuadrant-system/authorino-6f644b456d-cnvhj" Jun 09 15:17:27.167650 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.167625 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68dmm\" (UniqueName: \"kubernetes.io/projected/0ad81a40-2be9-4e2f-873e-73faf03515b3-kube-api-access-68dmm\") pod \"authorino-69bb57548d-v9pdw\" (UID: \"0ad81a40-2be9-4e2f-873e-73faf03515b3\") " pod="kuadrant-system/authorino-69bb57548d-v9pdw" Jun 09 15:17:27.259726 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.259666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc5bk\" (UniqueName: \"kubernetes.io/projected/d3492d0f-b330-4695-813c-972f25056988-kube-api-access-qc5bk\") pod \"authorino-6f644b456d-cnvhj\" (UID: \"d3492d0f-b330-4695-813c-972f25056988\") " pod="kuadrant-system/authorino-6f644b456d-cnvhj" Jun 09 15:17:27.259726 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.259704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3492d0f-b330-4695-813c-972f25056988-tls-cert\") pod \"authorino-6f644b456d-cnvhj\" (UID: \"d3492d0f-b330-4695-813c-972f25056988\") " pod="kuadrant-system/authorino-6f644b456d-cnvhj" Jun 09 15:17:27.261979 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.261961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3492d0f-b330-4695-813c-972f25056988-tls-cert\") pod \"authorino-6f644b456d-cnvhj\" (UID: \"d3492d0f-b330-4695-813c-972f25056988\") " pod="kuadrant-system/authorino-6f644b456d-cnvhj" Jun 09 15:17:27.267913 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.267884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc5bk\" (UniqueName: \"kubernetes.io/projected/d3492d0f-b330-4695-813c-972f25056988-kube-api-access-qc5bk\") pod \"authorino-6f644b456d-cnvhj\" (UID: \"d3492d0f-b330-4695-813c-972f25056988\") " pod="kuadrant-system/authorino-6f644b456d-cnvhj" Jun 09 15:17:27.410897 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.410873 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f644b456d-cnvhj" Jun 09 15:17:27.535664 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.535572 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f644b456d-cnvhj"] Jun 09 15:17:27.538340 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:17:27.538313 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3492d0f_b330_4695_813c_972f25056988.slice/crio-36b3adf1345c059ef39aaed9eab05ec6df5ab0f534fb83efc4ad785e91f04d95 WatchSource:0}: Error finding container 36b3adf1345c059ef39aaed9eab05ec6df5ab0f534fb83efc4ad785e91f04d95: Status 404 returned error can't find the container with id 36b3adf1345c059ef39aaed9eab05ec6df5ab0f534fb83efc4ad785e91f04d95 Jun 09 15:17:27.539558 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.539542 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:17:27.769471 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.769430 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f644b456d-cnvhj" event={"ID":"d3492d0f-b330-4695-813c-972f25056988","Type":"ContainerStarted","Data":"36b3adf1345c059ef39aaed9eab05ec6df5ab0f534fb83efc4ad785e91f04d95"} Jun 09 15:17:27.769471 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.769457 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69bb57548d-v9pdw" Jun 09 15:17:27.769939 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.769460 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9dlxr" Jun 09 15:17:27.776680 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.776662 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69bb57548d-v9pdw" Jun 09 15:17:27.778696 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.778681 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9dlxr" Jun 09 15:17:27.865522 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.865442 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj4tg\" (UniqueName: \"kubernetes.io/projected/7fd12e7f-4538-45e6-a8e3-d3a6664b1c96-kube-api-access-wj4tg\") pod \"7fd12e7f-4538-45e6-a8e3-d3a6664b1c96\" (UID: \"7fd12e7f-4538-45e6-a8e3-d3a6664b1c96\") " Jun 09 15:17:27.865704 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.865536 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68dmm\" (UniqueName: \"kubernetes.io/projected/0ad81a40-2be9-4e2f-873e-73faf03515b3-kube-api-access-68dmm\") pod \"0ad81a40-2be9-4e2f-873e-73faf03515b3\" (UID: \"0ad81a40-2be9-4e2f-873e-73faf03515b3\") " Jun 09 15:17:27.867510 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.867485 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fd12e7f-4538-45e6-a8e3-d3a6664b1c96-kube-api-access-wj4tg" (OuterVolumeSpecName: "kube-api-access-wj4tg") pod "7fd12e7f-4538-45e6-a8e3-d3a6664b1c96" (UID: "7fd12e7f-4538-45e6-a8e3-d3a6664b1c96"). InnerVolumeSpecName "kube-api-access-wj4tg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:17:27.867510 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.867505 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ad81a40-2be9-4e2f-873e-73faf03515b3-kube-api-access-68dmm" (OuterVolumeSpecName: "kube-api-access-68dmm") pod "0ad81a40-2be9-4e2f-873e-73faf03515b3" (UID: "0ad81a40-2be9-4e2f-873e-73faf03515b3"). InnerVolumeSpecName "kube-api-access-68dmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:17:27.966647 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.966619 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj4tg\" (UniqueName: \"kubernetes.io/projected/7fd12e7f-4538-45e6-a8e3-d3a6664b1c96-kube-api-access-wj4tg\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:17:27.966647 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:27.966645 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68dmm\" (UniqueName: \"kubernetes.io/projected/0ad81a40-2be9-4e2f-873e-73faf03515b3-kube-api-access-68dmm\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:17:28.775443 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:28.775407 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f644b456d-cnvhj" event={"ID":"d3492d0f-b330-4695-813c-972f25056988","Type":"ContainerStarted","Data":"3da9a0cf50ec8b93dc0d8e8be154bdb96593323d5d3545f6d0ba2017574efce3"} Jun 09 15:17:28.775844 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:28.775454 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69bb57548d-v9pdw" Jun 09 15:17:28.775844 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:28.775548 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9dlxr" Jun 09 15:17:28.792810 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:28.792770 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f644b456d-cnvhj" podStartSLOduration=1.4220596460000001 podStartE2EDuration="1.792748943s" totalImagesPullingTime="370.689297ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:17:28.791800927 +0000 UTC m=+906.856375378" watchObservedRunningTime="2026-06-09 15:17:28.792748943 +0000 UTC m=+906.857323393" Jun 09 15:17:28.819361 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:28.819336 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9dlxr"] Jun 09 15:17:28.832799 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:28.832746 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d57x7"] Jun 09 15:17:28.833253 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:28.833190 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-d57x7" podUID="4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba" containerName="authorino" containerID="cri-o://380363da2c73a6a26adcc6cbd778f0b2736b05e58afda65269f9e006fff4ec51" gracePeriod=30 Jun 09 15:17:28.835093 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:28.835063 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9dlxr"] Jun 09 15:17:28.860144 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:28.860116 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69bb57548d-v9pdw"] Jun 09 15:17:28.863272 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:28.863251 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-69bb57548d-v9pdw"] Jun 09 15:17:29.069109 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:29.069082 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d57x7" Jun 09 15:17:29.175917 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:29.175884 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz6dj\" (UniqueName: \"kubernetes.io/projected/4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba-kube-api-access-zz6dj\") pod \"4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba\" (UID: \"4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba\") " Jun 09 15:17:29.177866 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:29.177841 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba-kube-api-access-zz6dj" (OuterVolumeSpecName: "kube-api-access-zz6dj") pod "4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba" (UID: "4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba"). InnerVolumeSpecName "kube-api-access-zz6dj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:17:29.277247 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:29.277217 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz6dj\" (UniqueName: \"kubernetes.io/projected/4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba-kube-api-access-zz6dj\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:17:29.781530 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:29.781495 2577 generic.go:356] "Generic (PLEG): container finished" podID="4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba" containerID="380363da2c73a6a26adcc6cbd778f0b2736b05e58afda65269f9e006fff4ec51" exitCode=0 Jun 09 15:17:29.782048 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:29.781540 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d57x7" Jun 09 15:17:29.782048 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:29.781576 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d57x7" event={"ID":"4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba","Type":"ContainerDied","Data":"380363da2c73a6a26adcc6cbd778f0b2736b05e58afda65269f9e006fff4ec51"} Jun 09 15:17:29.782048 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:29.781644 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d57x7" event={"ID":"4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba","Type":"ContainerDied","Data":"58489112b6b9f049ad8686c9af5c28c21bcfb8eb6f4abc4735132a4686d78c27"} Jun 09 15:17:29.782048 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:29.781666 2577 scope.go:117] "RemoveContainer" containerID="380363da2c73a6a26adcc6cbd778f0b2736b05e58afda65269f9e006fff4ec51" Jun 09 15:17:29.790775 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:29.790757 2577 scope.go:117] "RemoveContainer" containerID="380363da2c73a6a26adcc6cbd778f0b2736b05e58afda65269f9e006fff4ec51" Jun 09 15:17:29.791037 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:17:29.791020 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"380363da2c73a6a26adcc6cbd778f0b2736b05e58afda65269f9e006fff4ec51\": container with ID starting with 380363da2c73a6a26adcc6cbd778f0b2736b05e58afda65269f9e006fff4ec51 not found: ID does not exist" containerID="380363da2c73a6a26adcc6cbd778f0b2736b05e58afda65269f9e006fff4ec51" Jun 09 15:17:29.791079 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:29.791046 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380363da2c73a6a26adcc6cbd778f0b2736b05e58afda65269f9e006fff4ec51"} err="failed to get container status \"380363da2c73a6a26adcc6cbd778f0b2736b05e58afda65269f9e006fff4ec51\": rpc error: code = NotFound desc = could not find container \"380363da2c73a6a26adcc6cbd778f0b2736b05e58afda65269f9e006fff4ec51\": container with ID starting with 380363da2c73a6a26adcc6cbd778f0b2736b05e58afda65269f9e006fff4ec51 not found: ID does not exist" Jun 09 15:17:29.802480 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:29.802460 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d57x7"] Jun 09 15:17:29.806406 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:29.806387 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d57x7"] Jun 09 15:17:30.378140 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:30.378109 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ad81a40-2be9-4e2f-873e-73faf03515b3" path="/var/lib/kubelet/pods/0ad81a40-2be9-4e2f-873e-73faf03515b3/volumes" Jun 09 15:17:30.378337 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:30.378326 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba" path="/var/lib/kubelet/pods/4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba/volumes" Jun 09 15:17:30.378625 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:30.378597 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fd12e7f-4538-45e6-a8e3-d3a6664b1c96" path="/var/lib/kubelet/pods/7fd12e7f-4538-45e6-a8e3-d3a6664b1c96/volumes" Jun 09 15:17:32.584068 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.584037 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:17:32.614078 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.614049 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74ff575d4d-jkx75"] Jun 09 15:17:32.614369 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.614357 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba" containerName="authorino" Jun 09 15:17:32.614418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.614370 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba" containerName="authorino" Jun 09 15:17:32.614456 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.614422 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ce2cd10-77aa-4dd4-b00d-ae5d9ab114ba" containerName="authorino" Jun 09 15:17:32.618663 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.618645 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74ff575d4d-jkx75" Jun 09 15:17:32.620942 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.620923 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 15:17:32.620942 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.620941 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dxvpd\"" Jun 09 15:17:32.621632 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.621595 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 15:17:32.633867 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.633847 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74ff575d4d-jkx75"] Jun 09 15:17:32.707643 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.707601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tg45\" (UniqueName: \"kubernetes.io/projected/e626ca6c-2ad9-47fe-837b-36b1f65d27e0-kube-api-access-4tg45\") pod \"maas-controller-74ff575d4d-jkx75\" (UID: \"e626ca6c-2ad9-47fe-837b-36b1f65d27e0\") " pod="opendatahub/maas-controller-74ff575d4d-jkx75" Jun 09 15:17:32.707787 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.707678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e626ca6c-2ad9-47fe-837b-36b1f65d27e0-webhook-cert\") pod \"maas-controller-74ff575d4d-jkx75\" (UID: \"e626ca6c-2ad9-47fe-837b-36b1f65d27e0\") " pod="opendatahub/maas-controller-74ff575d4d-jkx75" Jun 09 15:17:32.720046 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.720017 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:17:32.808751 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.808720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e626ca6c-2ad9-47fe-837b-36b1f65d27e0-webhook-cert\") pod \"maas-controller-74ff575d4d-jkx75\" (UID: \"e626ca6c-2ad9-47fe-837b-36b1f65d27e0\") " pod="opendatahub/maas-controller-74ff575d4d-jkx75" Jun 09 15:17:32.808904 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.808804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tg45\" (UniqueName: \"kubernetes.io/projected/e626ca6c-2ad9-47fe-837b-36b1f65d27e0-kube-api-access-4tg45\") pod \"maas-controller-74ff575d4d-jkx75\" (UID: \"e626ca6c-2ad9-47fe-837b-36b1f65d27e0\") " pod="opendatahub/maas-controller-74ff575d4d-jkx75" Jun 09 15:17:32.811099 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.811071 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e626ca6c-2ad9-47fe-837b-36b1f65d27e0-webhook-cert\") pod \"maas-controller-74ff575d4d-jkx75\" (UID: \"e626ca6c-2ad9-47fe-837b-36b1f65d27e0\") " pod="opendatahub/maas-controller-74ff575d4d-jkx75" Jun 09 15:17:32.815627 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.815590 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c498967fc-6hs2x"] Jun 09 15:17:32.818745 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.818725 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c498967fc-6hs2x" Jun 09 15:17:32.821386 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.821356 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tg45\" (UniqueName: \"kubernetes.io/projected/e626ca6c-2ad9-47fe-837b-36b1f65d27e0-kube-api-access-4tg45\") pod \"maas-controller-74ff575d4d-jkx75\" (UID: \"e626ca6c-2ad9-47fe-837b-36b1f65d27e0\") " pod="opendatahub/maas-controller-74ff575d4d-jkx75" Jun 09 15:17:32.830747 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.830718 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:17:32.831523 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.831503 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c498967fc-6hs2x"] Jun 09 15:17:32.909613 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.909530 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d67d4b2e-6fea-49e0-b395-47744d02cbc7-webhook-cert\") pod \"maas-controller-c498967fc-6hs2x\" (UID: \"d67d4b2e-6fea-49e0-b395-47744d02cbc7\") " pod="opendatahub/maas-controller-c498967fc-6hs2x" Jun 09 15:17:32.909613 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.909565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j7dh\" (UniqueName: \"kubernetes.io/projected/d67d4b2e-6fea-49e0-b395-47744d02cbc7-kube-api-access-9j7dh\") pod \"maas-controller-c498967fc-6hs2x\" (UID: \"d67d4b2e-6fea-49e0-b395-47744d02cbc7\") " pod="opendatahub/maas-controller-c498967fc-6hs2x" Jun 09 15:17:32.929056 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:32.929024 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74ff575d4d-jkx75" Jun 09 15:17:33.010147 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:33.010101 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d67d4b2e-6fea-49e0-b395-47744d02cbc7-webhook-cert\") pod \"maas-controller-c498967fc-6hs2x\" (UID: \"d67d4b2e-6fea-49e0-b395-47744d02cbc7\") " pod="opendatahub/maas-controller-c498967fc-6hs2x" Jun 09 15:17:33.010269 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:33.010153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j7dh\" (UniqueName: \"kubernetes.io/projected/d67d4b2e-6fea-49e0-b395-47744d02cbc7-kube-api-access-9j7dh\") pod \"maas-controller-c498967fc-6hs2x\" (UID: \"d67d4b2e-6fea-49e0-b395-47744d02cbc7\") " pod="opendatahub/maas-controller-c498967fc-6hs2x" Jun 09 15:17:33.013648 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:33.013623 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d67d4b2e-6fea-49e0-b395-47744d02cbc7-webhook-cert\") pod \"maas-controller-c498967fc-6hs2x\" (UID: \"d67d4b2e-6fea-49e0-b395-47744d02cbc7\") " pod="opendatahub/maas-controller-c498967fc-6hs2x" Jun 09 15:17:33.019939 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:33.019913 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j7dh\" (UniqueName: \"kubernetes.io/projected/d67d4b2e-6fea-49e0-b395-47744d02cbc7-kube-api-access-9j7dh\") pod \"maas-controller-c498967fc-6hs2x\" (UID: \"d67d4b2e-6fea-49e0-b395-47744d02cbc7\") " pod="opendatahub/maas-controller-c498967fc-6hs2x" Jun 09 15:17:33.060291 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:33.060268 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74ff575d4d-jkx75"] Jun 09 15:17:33.062573 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:17:33.062547 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode626ca6c_2ad9_47fe_837b_36b1f65d27e0.slice/crio-2d011f850d6d9c771943b16009facf8b2c07c60cb5a118d992bebbf25f9db20c WatchSource:0}: Error finding container 2d011f850d6d9c771943b16009facf8b2c07c60cb5a118d992bebbf25f9db20c: Status 404 returned error can't find the container with id 2d011f850d6d9c771943b16009facf8b2c07c60cb5a118d992bebbf25f9db20c Jun 09 15:17:33.138080 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:33.138053 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c498967fc-6hs2x" Jun 09 15:17:33.266952 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:33.266933 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c498967fc-6hs2x"] Jun 09 15:17:33.269144 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:17:33.269119 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67d4b2e_6fea_49e0_b395_47744d02cbc7.slice/crio-bb734a18a96753f71318617e115d30a6a0de4c6513164a7b8b421a2fae77cdb1 WatchSource:0}: Error finding container bb734a18a96753f71318617e115d30a6a0de4c6513164a7b8b421a2fae77cdb1: Status 404 returned error can't find the container with id bb734a18a96753f71318617e115d30a6a0de4c6513164a7b8b421a2fae77cdb1 Jun 09 15:17:33.804899 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:33.804863 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74ff575d4d-jkx75" event={"ID":"e626ca6c-2ad9-47fe-837b-36b1f65d27e0","Type":"ContainerStarted","Data":"2d011f850d6d9c771943b16009facf8b2c07c60cb5a118d992bebbf25f9db20c"} Jun 09 15:17:33.807309 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:33.807279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c498967fc-6hs2x" event={"ID":"d67d4b2e-6fea-49e0-b395-47744d02cbc7","Type":"ContainerStarted","Data":"bb734a18a96753f71318617e115d30a6a0de4c6513164a7b8b421a2fae77cdb1"} Jun 09 15:17:36.064263 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:36.064234 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:17:36.159204 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:36.159131 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:17:36.822414 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:36.822371 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c498967fc-6hs2x" event={"ID":"d67d4b2e-6fea-49e0-b395-47744d02cbc7","Type":"ContainerStarted","Data":"2c0b33c3958f8e9da8b2f747821d2c633643154450cf651b57ad98fe803e53aa"} Jun 09 15:17:36.822636 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:36.822455 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c498967fc-6hs2x" Jun 09 15:17:36.823772 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:36.823745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74ff575d4d-jkx75" event={"ID":"e626ca6c-2ad9-47fe-837b-36b1f65d27e0","Type":"ContainerStarted","Data":"3fa6c935ca4d8f42906a8e192d1033f70caab809f3ca8c8a9217ec68a88f150b"} Jun 09 15:17:36.823883 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:36.823788 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74ff575d4d-jkx75" Jun 09 15:17:36.860193 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:36.860137 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74ff575d4d-jkx75" podStartSLOduration=2.049018572 podStartE2EDuration="4.860119687s" totalImagesPullingTime="2.811101115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:17:36.858898263 +0000 UTC m=+914.923472713" watchObservedRunningTime="2026-06-09 15:17:36.860119687 +0000 UTC m=+914.924694137" Jun 09 15:17:36.860858 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:36.860831 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c498967fc-6hs2x" podStartSLOduration=2.246831208 podStartE2EDuration="4.860823427s" totalImagesPullingTime="2.613992219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:17:36.841244354 +0000 UTC m=+914.905818806" watchObservedRunningTime="2026-06-09 15:17:36.860823427 +0000 UTC m=+914.925397893" Jun 09 15:17:47.833542 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:47.833507 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c498967fc-6hs2x" Jun 09 15:17:47.833934 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:47.833586 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74ff575d4d-jkx75" Jun 09 15:17:47.894670 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:47.894639 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74ff575d4d-jkx75"] Jun 09 15:17:47.894900 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:47.894859 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-74ff575d4d-jkx75" podUID="e626ca6c-2ad9-47fe-837b-36b1f65d27e0" containerName="manager" containerID="cri-o://3fa6c935ca4d8f42906a8e192d1033f70caab809f3ca8c8a9217ec68a88f150b" gracePeriod=30 Jun 09 15:17:48.136939 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.136913 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74ff575d4d-jkx75" Jun 09 15:17:48.239724 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.239690 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tg45\" (UniqueName: \"kubernetes.io/projected/e626ca6c-2ad9-47fe-837b-36b1f65d27e0-kube-api-access-4tg45\") pod \"e626ca6c-2ad9-47fe-837b-36b1f65d27e0\" (UID: \"e626ca6c-2ad9-47fe-837b-36b1f65d27e0\") " Jun 09 15:17:48.239912 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.239749 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e626ca6c-2ad9-47fe-837b-36b1f65d27e0-webhook-cert\") pod \"e626ca6c-2ad9-47fe-837b-36b1f65d27e0\" (UID: \"e626ca6c-2ad9-47fe-837b-36b1f65d27e0\") " Jun 09 15:17:48.241883 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.241857 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e626ca6c-2ad9-47fe-837b-36b1f65d27e0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e626ca6c-2ad9-47fe-837b-36b1f65d27e0" (UID: "e626ca6c-2ad9-47fe-837b-36b1f65d27e0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:17:48.241968 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.241888 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e626ca6c-2ad9-47fe-837b-36b1f65d27e0-kube-api-access-4tg45" (OuterVolumeSpecName: "kube-api-access-4tg45") pod "e626ca6c-2ad9-47fe-837b-36b1f65d27e0" (UID: "e626ca6c-2ad9-47fe-837b-36b1f65d27e0"). InnerVolumeSpecName "kube-api-access-4tg45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:17:48.341240 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.341198 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tg45\" (UniqueName: \"kubernetes.io/projected/e626ca6c-2ad9-47fe-837b-36b1f65d27e0-kube-api-access-4tg45\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:17:48.341240 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.341233 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e626ca6c-2ad9-47fe-837b-36b1f65d27e0-webhook-cert\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:17:48.879361 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.879328 2577 generic.go:356] "Generic (PLEG): container finished" podID="e626ca6c-2ad9-47fe-837b-36b1f65d27e0" containerID="3fa6c935ca4d8f42906a8e192d1033f70caab809f3ca8c8a9217ec68a88f150b" exitCode=0 Jun 09 15:17:48.879861 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.879363 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74ff575d4d-jkx75" event={"ID":"e626ca6c-2ad9-47fe-837b-36b1f65d27e0","Type":"ContainerDied","Data":"3fa6c935ca4d8f42906a8e192d1033f70caab809f3ca8c8a9217ec68a88f150b"} Jun 09 15:17:48.879861 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.879386 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74ff575d4d-jkx75" Jun 09 15:17:48.879861 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.879427 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74ff575d4d-jkx75" event={"ID":"e626ca6c-2ad9-47fe-837b-36b1f65d27e0","Type":"ContainerDied","Data":"2d011f850d6d9c771943b16009facf8b2c07c60cb5a118d992bebbf25f9db20c"} Jun 09 15:17:48.879861 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.879450 2577 scope.go:117] "RemoveContainer" containerID="3fa6c935ca4d8f42906a8e192d1033f70caab809f3ca8c8a9217ec68a88f150b" Jun 09 15:17:48.887552 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.887538 2577 scope.go:117] "RemoveContainer" containerID="3fa6c935ca4d8f42906a8e192d1033f70caab809f3ca8c8a9217ec68a88f150b" Jun 09 15:17:48.887833 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:17:48.887814 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa6c935ca4d8f42906a8e192d1033f70caab809f3ca8c8a9217ec68a88f150b\": container with ID starting with 3fa6c935ca4d8f42906a8e192d1033f70caab809f3ca8c8a9217ec68a88f150b not found: ID does not exist" containerID="3fa6c935ca4d8f42906a8e192d1033f70caab809f3ca8c8a9217ec68a88f150b" Jun 09 15:17:48.887895 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.887840 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa6c935ca4d8f42906a8e192d1033f70caab809f3ca8c8a9217ec68a88f150b"} err="failed to get container status \"3fa6c935ca4d8f42906a8e192d1033f70caab809f3ca8c8a9217ec68a88f150b\": rpc error: code = NotFound desc = could not find container \"3fa6c935ca4d8f42906a8e192d1033f70caab809f3ca8c8a9217ec68a88f150b\": container with ID starting with 3fa6c935ca4d8f42906a8e192d1033f70caab809f3ca8c8a9217ec68a88f150b not found: ID does not exist" Jun 09 15:17:48.897641 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.897622 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74ff575d4d-jkx75"] Jun 09 15:17:48.904186 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:48.904165 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74ff575d4d-jkx75"] Jun 09 15:17:50.377951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:50.377919 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e626ca6c-2ad9-47fe-837b-36b1f65d27e0" path="/var/lib/kubelet/pods/e626ca6c-2ad9-47fe-837b-36b1f65d27e0/volumes" Jun 09 15:17:58.762949 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:58.762914 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:17:58.865564 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:17:58.865527 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:05.950254 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:05.950220 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:07.102699 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.102661 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:07.127265 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.127233 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6d74d9b96d-hwcn9"] Jun 09 15:18:07.127595 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.127582 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e626ca6c-2ad9-47fe-837b-36b1f65d27e0" containerName="manager" Jun 09 15:18:07.127595 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.127596 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e626ca6c-2ad9-47fe-837b-36b1f65d27e0" containerName="manager" Jun 09 15:18:07.127702 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.127679 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e626ca6c-2ad9-47fe-837b-36b1f65d27e0" containerName="manager" Jun 09 15:18:07.134582 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.134562 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6d74d9b96d-hwcn9" Jun 09 15:18:07.136813 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.136796 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 09 15:18:07.136951 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.136932 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sk28p\"" Jun 09 15:18:07.143803 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.143782 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6d74d9b96d-hwcn9"] Jun 09 15:18:07.194482 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.194446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e392807-f685-4b2f-b1fc-883ee9b0c2f8-maas-api-tls\") pod \"maas-api-6d74d9b96d-hwcn9\" (UID: \"0e392807-f685-4b2f-b1fc-883ee9b0c2f8\") " pod="opendatahub/maas-api-6d74d9b96d-hwcn9" Jun 09 15:18:07.194691 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.194489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6scvv\" (UniqueName: \"kubernetes.io/projected/0e392807-f685-4b2f-b1fc-883ee9b0c2f8-kube-api-access-6scvv\") pod \"maas-api-6d74d9b96d-hwcn9\" (UID: \"0e392807-f685-4b2f-b1fc-883ee9b0c2f8\") " pod="opendatahub/maas-api-6d74d9b96d-hwcn9" Jun 09 15:18:07.295702 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.295672 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e392807-f685-4b2f-b1fc-883ee9b0c2f8-maas-api-tls\") pod \"maas-api-6d74d9b96d-hwcn9\" (UID: \"0e392807-f685-4b2f-b1fc-883ee9b0c2f8\") " pod="opendatahub/maas-api-6d74d9b96d-hwcn9" Jun 09 15:18:07.295866 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.295708 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6scvv\" (UniqueName: \"kubernetes.io/projected/0e392807-f685-4b2f-b1fc-883ee9b0c2f8-kube-api-access-6scvv\") pod \"maas-api-6d74d9b96d-hwcn9\" (UID: \"0e392807-f685-4b2f-b1fc-883ee9b0c2f8\") " pod="opendatahub/maas-api-6d74d9b96d-hwcn9" Jun 09 15:18:07.295866 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:18:07.295821 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 09 15:18:07.295936 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:18:07.295912 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e392807-f685-4b2f-b1fc-883ee9b0c2f8-maas-api-tls podName:0e392807-f685-4b2f-b1fc-883ee9b0c2f8 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:07.795896201 +0000 UTC m=+945.860470631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0e392807-f685-4b2f-b1fc-883ee9b0c2f8-maas-api-tls") pod "maas-api-6d74d9b96d-hwcn9" (UID: "0e392807-f685-4b2f-b1fc-883ee9b0c2f8") : secret "maas-api-serving-cert" not found Jun 09 15:18:07.306594 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.306560 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6scvv\" (UniqueName: \"kubernetes.io/projected/0e392807-f685-4b2f-b1fc-883ee9b0c2f8-kube-api-access-6scvv\") pod \"maas-api-6d74d9b96d-hwcn9\" (UID: \"0e392807-f685-4b2f-b1fc-883ee9b0c2f8\") " pod="opendatahub/maas-api-6d74d9b96d-hwcn9" Jun 09 15:18:07.413863 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.413788 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:07.562780 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.562747 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:07.662471 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.662434 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:07.663644 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.663593 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-zqrd7"] Jun 09 15:18:07.667241 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.667189 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-zqrd7" Jun 09 15:18:07.669426 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.669404 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-76qjw\"" Jun 09 15:18:07.669426 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.669416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 15:18:07.676474 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.676451 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-zqrd7"] Jun 09 15:18:07.690769 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.690747 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-wz8ht"] Jun 09 15:18:07.694236 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.694220 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:18:07.699093 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.699062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2p2k\" (UniqueName: \"kubernetes.io/projected/224cd4f5-3eea-4cf4-9f66-446b1fc17091-kube-api-access-v2p2k\") pod \"payload-pre-processing-67d7689b65-zqrd7\" (UID: \"224cd4f5-3eea-4cf4-9f66-446b1fc17091\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-zqrd7" Jun 09 15:18:07.706372 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.706352 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-wz8ht"] Jun 09 15:18:07.800332 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.800302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e392807-f685-4b2f-b1fc-883ee9b0c2f8-maas-api-tls\") pod \"maas-api-6d74d9b96d-hwcn9\" (UID: \"0e392807-f685-4b2f-b1fc-883ee9b0c2f8\") " pod="opendatahub/maas-api-6d74d9b96d-hwcn9" Jun 09 15:18:07.800510 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.800342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2p2k\" (UniqueName: \"kubernetes.io/projected/224cd4f5-3eea-4cf4-9f66-446b1fc17091-kube-api-access-v2p2k\") pod \"payload-pre-processing-67d7689b65-zqrd7\" (UID: \"224cd4f5-3eea-4cf4-9f66-446b1fc17091\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-zqrd7" Jun 09 15:18:07.800510 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.800395 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz2sn\" (UniqueName: \"kubernetes.io/projected/d08bf935-509f-4b03-ae00-822e0da95015-kube-api-access-jz2sn\") pod \"payload-processing-7c6c859784-wz8ht\" (UID: \"d08bf935-509f-4b03-ae00-822e0da95015\") " pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:18:07.802798 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.802777 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e392807-f685-4b2f-b1fc-883ee9b0c2f8-maas-api-tls\") pod \"maas-api-6d74d9b96d-hwcn9\" (UID: \"0e392807-f685-4b2f-b1fc-883ee9b0c2f8\") " pod="opendatahub/maas-api-6d74d9b96d-hwcn9" Jun 09 15:18:07.811591 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.811570 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2p2k\" (UniqueName: \"kubernetes.io/projected/224cd4f5-3eea-4cf4-9f66-446b1fc17091-kube-api-access-v2p2k\") pod \"payload-pre-processing-67d7689b65-zqrd7\" (UID: \"224cd4f5-3eea-4cf4-9f66-446b1fc17091\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-zqrd7" Jun 09 15:18:07.901007 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.900971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz2sn\" (UniqueName: \"kubernetes.io/projected/d08bf935-509f-4b03-ae00-822e0da95015-kube-api-access-jz2sn\") pod \"payload-processing-7c6c859784-wz8ht\" (UID: \"d08bf935-509f-4b03-ae00-822e0da95015\") " pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:18:07.909875 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.909843 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz2sn\" (UniqueName: \"kubernetes.io/projected/d08bf935-509f-4b03-ae00-822e0da95015-kube-api-access-jz2sn\") pod \"payload-processing-7c6c859784-wz8ht\" (UID: \"d08bf935-509f-4b03-ae00-822e0da95015\") " pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:18:07.978354 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:07.978326 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-zqrd7" Jun 09 15:18:08.003862 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:08.003834 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:18:08.046114 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:08.046063 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6d74d9b96d-hwcn9" Jun 09 15:18:08.129387 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:08.129306 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-zqrd7"] Jun 09 15:18:08.133677 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:18:08.133646 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224cd4f5_3eea_4cf4_9f66_446b1fc17091.slice/crio-f229d4c960b2ecf008e3b91bf67969e79462c8f61b301d0e6b54812b8c7c5504 WatchSource:0}: Error finding container f229d4c960b2ecf008e3b91bf67969e79462c8f61b301d0e6b54812b8c7c5504: Status 404 returned error can't find the container with id f229d4c960b2ecf008e3b91bf67969e79462c8f61b301d0e6b54812b8c7c5504 Jun 09 15:18:08.155325 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:08.155299 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-wz8ht"] Jun 09 15:18:08.157316 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:18:08.157260 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08bf935_509f_4b03_ae00_822e0da95015.slice/crio-46c9e6be21a66065a2fe379829f4b6b3866e1924a81b13b524ffb8ee5208912a WatchSource:0}: Error finding container 46c9e6be21a66065a2fe379829f4b6b3866e1924a81b13b524ffb8ee5208912a: Status 404 returned error can't find the container with id 46c9e6be21a66065a2fe379829f4b6b3866e1924a81b13b524ffb8ee5208912a Jun 09 15:18:08.209471 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:08.209447 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6d74d9b96d-hwcn9"] Jun 09 15:18:08.211477 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:18:08.211449 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e392807_f685_4b2f_b1fc_883ee9b0c2f8.slice/crio-2d815d32955b9f701d3a462da66341c2c96270da885b43fbe2fb8abe4595217d WatchSource:0}: Error finding container 2d815d32955b9f701d3a462da66341c2c96270da885b43fbe2fb8abe4595217d: Status 404 returned error can't find the container with id 2d815d32955b9f701d3a462da66341c2c96270da885b43fbe2fb8abe4595217d Jun 09 15:18:08.975420 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:08.975341 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-zqrd7" event={"ID":"224cd4f5-3eea-4cf4-9f66-446b1fc17091","Type":"ContainerStarted","Data":"f229d4c960b2ecf008e3b91bf67969e79462c8f61b301d0e6b54812b8c7c5504"} Jun 09 15:18:08.976883 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:08.976851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" event={"ID":"d08bf935-509f-4b03-ae00-822e0da95015","Type":"ContainerStarted","Data":"46c9e6be21a66065a2fe379829f4b6b3866e1924a81b13b524ffb8ee5208912a"} Jun 09 15:18:08.978692 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:08.978664 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6d74d9b96d-hwcn9" event={"ID":"0e392807-f685-4b2f-b1fc-883ee9b0c2f8","Type":"ContainerStarted","Data":"2d815d32955b9f701d3a462da66341c2c96270da885b43fbe2fb8abe4595217d"} Jun 09 15:18:09.985550 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:09.985509 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-zqrd7" event={"ID":"224cd4f5-3eea-4cf4-9f66-446b1fc17091","Type":"ContainerStarted","Data":"c8783e425fef47c8923ac359a47676f29cd511e3537941ac57020945e79d7d40"} Jun 09 15:18:09.986018 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:09.985622 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-zqrd7" Jun 09 15:18:09.987036 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:09.987013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" event={"ID":"d08bf935-509f-4b03-ae00-822e0da95015","Type":"ContainerStarted","Data":"7cd3402dea1c79801c45fce23b5424351267bb7f2296e2d9c796da34623279ea"} Jun 09 15:18:09.987172 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:09.987130 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:18:10.002730 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:10.002688 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-zqrd7" podStartSLOduration=1.3602410059999999 podStartE2EDuration="3.002671849s" totalImagesPullingTime="1.642430843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:10.001095655 +0000 UTC m=+948.065670122" watchObservedRunningTime="2026-06-09 15:18:10.002671849 +0000 UTC m=+948.067246300" Jun 09 15:18:10.018169 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:10.018095 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" podStartSLOduration=1.40036655 podStartE2EDuration="3.018083289s" totalImagesPullingTime="1.617716739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:10.016511089 +0000 UTC m=+948.081085615" watchObservedRunningTime="2026-06-09 15:18:10.018083289 +0000 UTC m=+948.082657731" Jun 09 15:18:10.992559 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:10.992467 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6d74d9b96d-hwcn9" event={"ID":"0e392807-f685-4b2f-b1fc-883ee9b0c2f8","Type":"ContainerStarted","Data":"799511f113d532e6ca479e64ab13c3a1082baf6d52df5d82c684157eabfa5423"} Jun 09 15:18:11.012626 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:11.012564 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6d74d9b96d-hwcn9" podStartSLOduration=1.467756146 podStartE2EDuration="4.012548862s" totalImagesPullingTime="2.544792716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:11.010225919 +0000 UTC m=+949.074800373" watchObservedRunningTime="2026-06-09 15:18:11.012548862 +0000 UTC m=+949.077123312" Jun 09 15:18:11.997138 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:11.997106 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6d74d9b96d-hwcn9" Jun 09 15:18:16.018477 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:16.018437 2577 generic.go:356] "Generic (PLEG): container finished" podID="7d1a401c-03ab-4b5a-a520-400a445540f9" containerID="4a47130b9790b6ad3504be5f82a1493524864527b31797a5b6acfb1fa7766f57" exitCode=0 Jun 09 15:18:16.018891 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:16.018517 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" event={"ID":"7d1a401c-03ab-4b5a-a520-400a445540f9","Type":"ContainerDied","Data":"4a47130b9790b6ad3504be5f82a1493524864527b31797a5b6acfb1fa7766f57"} Jun 09 15:18:16.019059 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:16.019043 2577 scope.go:117] "RemoveContainer" containerID="4a47130b9790b6ad3504be5f82a1493524864527b31797a5b6acfb1fa7766f57" Jun 09 15:18:16.020189 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:16.020153 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:18:16.020270 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:16.020248 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:18:16.020315 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:16.020294 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 15:18:16.281818 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:16.281739 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:18:17.025266 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:17.025233 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" event={"ID":"7d1a401c-03ab-4b5a-a520-400a445540f9","Type":"ContainerStarted","Data":"5bcfc85bc83c79827354992493b88d8c5739acb7403c5fd64730f07b1ac4aef7"} Jun 09 15:18:17.897421 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:17.897384 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:18:17.898520 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:17.898494 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-mc5bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jun 09 15:18:17.898583 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:17.898550 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" podUID="7d1a401c-03ab-4b5a-a520-400a445540f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jun 09 15:18:18.007183 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:18.007148 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6d74d9b96d-hwcn9" Jun 09 15:18:18.897199 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:18.897157 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-mc5bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jun 09 15:18:18.897704 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:18.897237 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" podUID="7d1a401c-03ab-4b5a-a520-400a445540f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jun 09 15:18:19.876644 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:19.876597 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:18:19.876854 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:19.876827 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" containerID="cri-o://6407c8b8cb8f09d3035ce361f2ed3ebf6c5724d7ac4a62f61e0d94ff260f5d2a" gracePeriod=30 Jun 09 15:18:19.896893 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:19.896840 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-mc5bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jun 09 15:18:19.897055 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:19.896916 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" podUID="7d1a401c-03ab-4b5a-a520-400a445540f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jun 09 15:18:20.897512 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:20.897477 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-mc5bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jun 09 15:18:20.898033 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:20.897532 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" podUID="7d1a401c-03ab-4b5a-a520-400a445540f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jun 09 15:18:20.994799 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:20.994752 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-67d7689b65-zqrd7" podUID="224cd4f5-3eea-4cf4-9f66-446b1fc17091" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.40:9004: connect: connection refused" Jun 09 15:18:20.995221 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:20.995199 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:18:21.525811 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:21.525788 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:21.626967 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:21.626886 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmhtf\" (UniqueName: \"kubernetes.io/projected/97e361d8-2e44-4ccc-b3f1-8a277a769193-kube-api-access-pmhtf\") pod \"97e361d8-2e44-4ccc-b3f1-8a277a769193\" (UID: \"97e361d8-2e44-4ccc-b3f1-8a277a769193\") " Jun 09 15:18:21.628993 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:21.628956 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97e361d8-2e44-4ccc-b3f1-8a277a769193-kube-api-access-pmhtf" (OuterVolumeSpecName: "kube-api-access-pmhtf") pod "97e361d8-2e44-4ccc-b3f1-8a277a769193" (UID: "97e361d8-2e44-4ccc-b3f1-8a277a769193"). InnerVolumeSpecName "kube-api-access-pmhtf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:18:21.727657 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:21.727623 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmhtf\" (UniqueName: \"kubernetes.io/projected/97e361d8-2e44-4ccc-b3f1-8a277a769193-kube-api-access-pmhtf\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:18:21.900988 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:21.900911 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:18:21.901331 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:21.901319 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:18:21.902092 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:21.902072 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mc5bd" Jun 09 15:18:22.054916 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.054883 2577 generic.go:356] "Generic (PLEG): container finished" podID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerID="6407c8b8cb8f09d3035ce361f2ed3ebf6c5724d7ac4a62f61e0d94ff260f5d2a" exitCode=143 Jun 09 15:18:22.055086 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.054923 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:22.055086 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.054984 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"97e361d8-2e44-4ccc-b3f1-8a277a769193","Type":"ContainerDied","Data":"6407c8b8cb8f09d3035ce361f2ed3ebf6c5724d7ac4a62f61e0d94ff260f5d2a"} Jun 09 15:18:22.055086 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.055039 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"97e361d8-2e44-4ccc-b3f1-8a277a769193","Type":"ContainerDied","Data":"99a604644375cc1cb1a0b76c567d2e9ec92100cf5b43af2d43f2d078fcc3aef6"} Jun 09 15:18:22.055086 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.055069 2577 scope.go:117] "RemoveContainer" containerID="6407c8b8cb8f09d3035ce361f2ed3ebf6c5724d7ac4a62f61e0d94ff260f5d2a" Jun 09 15:18:22.064560 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.064536 2577 scope.go:117] "RemoveContainer" containerID="6407c8b8cb8f09d3035ce361f2ed3ebf6c5724d7ac4a62f61e0d94ff260f5d2a" Jun 09 15:18:22.065756 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:18:22.064901 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6407c8b8cb8f09d3035ce361f2ed3ebf6c5724d7ac4a62f61e0d94ff260f5d2a\": container with ID starting with 6407c8b8cb8f09d3035ce361f2ed3ebf6c5724d7ac4a62f61e0d94ff260f5d2a not found: ID does not exist" containerID="6407c8b8cb8f09d3035ce361f2ed3ebf6c5724d7ac4a62f61e0d94ff260f5d2a" Jun 09 15:18:22.065756 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.064944 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6407c8b8cb8f09d3035ce361f2ed3ebf6c5724d7ac4a62f61e0d94ff260f5d2a"} err="failed to get container status \"6407c8b8cb8f09d3035ce361f2ed3ebf6c5724d7ac4a62f61e0d94ff260f5d2a\": rpc error: code = NotFound desc = could not find container \"6407c8b8cb8f09d3035ce361f2ed3ebf6c5724d7ac4a62f61e0d94ff260f5d2a\": container with ID starting with 6407c8b8cb8f09d3035ce361f2ed3ebf6c5724d7ac4a62f61e0d94ff260f5d2a not found: ID does not exist" Jun 09 15:18:22.077828 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.077802 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:18:22.082556 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.082534 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:18:22.111283 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.111261 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:18:22.111589 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.111576 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" Jun 09 15:18:22.111671 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.111591 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" Jun 09 15:18:22.111713 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.111670 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" containerName="keycloak" Jun 09 15:18:22.114205 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.114192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:22.116486 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.116463 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 15:18:22.116486 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.116477 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 15:18:22.116665 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.116573 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 15:18:22.116822 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.116807 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 15:18:22.116945 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.116919 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lc8sf\"" Jun 09 15:18:22.124040 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.124017 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:18:22.232070 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.232039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/64f8a803-a839-487b-98fc-956a241ff9f2-test-realms\") pod \"maas-keycloak-0\" (UID: \"64f8a803-a839-487b-98fc-956a241ff9f2\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:22.232234 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.232085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g44n7\" (UniqueName: \"kubernetes.io/projected/64f8a803-a839-487b-98fc-956a241ff9f2-kube-api-access-g44n7\") pod \"maas-keycloak-0\" (UID: \"64f8a803-a839-487b-98fc-956a241ff9f2\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:22.332601 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.332569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/64f8a803-a839-487b-98fc-956a241ff9f2-test-realms\") pod \"maas-keycloak-0\" (UID: \"64f8a803-a839-487b-98fc-956a241ff9f2\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:22.332794 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.332666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g44n7\" (UniqueName: \"kubernetes.io/projected/64f8a803-a839-487b-98fc-956a241ff9f2-kube-api-access-g44n7\") pod \"maas-keycloak-0\" (UID: \"64f8a803-a839-487b-98fc-956a241ff9f2\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:22.335095 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.335075 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 15:18:22.340979 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.340962 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 15:18:22.344096 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.344080 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/64f8a803-a839-487b-98fc-956a241ff9f2-test-realms\") pod \"maas-keycloak-0\" (UID: \"64f8a803-a839-487b-98fc-956a241ff9f2\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:22.351334 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.351316 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 15:18:22.362392 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.362370 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g44n7\" (UniqueName: \"kubernetes.io/projected/64f8a803-a839-487b-98fc-956a241ff9f2-kube-api-access-g44n7\") pod \"maas-keycloak-0\" (UID: \"64f8a803-a839-487b-98fc-956a241ff9f2\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:22.377921 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.377897 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97e361d8-2e44-4ccc-b3f1-8a277a769193" path="/var/lib/kubelet/pods/97e361d8-2e44-4ccc-b3f1-8a277a769193/volumes" Jun 09 15:18:22.426141 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.426115 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lc8sf\"" Jun 09 15:18:22.433818 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.433799 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:22.561929 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.561903 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:18:22.563755 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:18:22.563726 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f8a803_a839_487b_98fc_956a241ff9f2.slice/crio-70745ba650c7dfe2039b058257141315759aaa0aaa4b4fb12ec75e05f57e28f1 WatchSource:0}: Error finding container 70745ba650c7dfe2039b058257141315759aaa0aaa4b4fb12ec75e05f57e28f1: Status 404 returned error can't find the container with id 70745ba650c7dfe2039b058257141315759aaa0aaa4b4fb12ec75e05f57e28f1 Jun 09 15:18:22.936645 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:22.936626 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 15:18:23.061222 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:23.061183 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"64f8a803-a839-487b-98fc-956a241ff9f2","Type":"ContainerStarted","Data":"e086c6841037008b22fc40c4b9478c4e53cf9f6daf0e7b36bf6909e967ebc2dc"} Jun 09 15:18:23.061397 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:23.061242 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"64f8a803-a839-487b-98fc-956a241ff9f2","Type":"ContainerStarted","Data":"70745ba650c7dfe2039b058257141315759aaa0aaa4b4fb12ec75e05f57e28f1"} Jun 09 15:18:23.084111 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:23.084054 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.715315181 podStartE2EDuration="1.08403235s" totalImagesPullingTime="368.717169ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:23.083500425 +0000 UTC m=+961.148074875" watchObservedRunningTime="2026-06-09 15:18:23.08403235 +0000 UTC m=+961.148606803" Jun 09 15:18:23.434114 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:23.434067 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:23.435839 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:23.435800 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:18:24.435244 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:24.435193 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:18:25.435402 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:25.435345 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:18:26.435047 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:26.434991 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:18:27.435011 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:27.434975 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:18:28.435039 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:28.434991 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:18:29.435177 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:29.435124 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:18:30.435235 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:30.435186 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:18:30.993867 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:30.993833 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-zqrd7" Jun 09 15:18:31.434496 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:31.434398 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:18:32.434536 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:32.434495 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:32.435044 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:32.434897 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:18:33.435210 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:33.435153 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:18:34.434936 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:34.434895 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:18:35.435025 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:35.434979 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:18:36.528428 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:36.528085 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:36.543792 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:36.543749 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="64f8a803-a839-487b-98fc-956a241ff9f2" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:18:46.534830 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:46.534738 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 15:18:57.288725 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.288690 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-666ddd7b78-zznww"] Jun 09 15:18:57.292418 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.292397 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-666ddd7b78-zznww" Jun 09 15:18:57.294870 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.294850 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 15:18:57.300409 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.300385 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-666ddd7b78-zznww"] Jun 09 15:18:57.362310 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.362277 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-tls-cert\") pod \"authorino-666ddd7b78-zznww\" (UID: \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\") " pod="kuadrant-system/authorino-666ddd7b78-zznww" Jun 09 15:18:57.362310 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.362315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-oidc-ca\") pod \"authorino-666ddd7b78-zznww\" (UID: \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\") " pod="kuadrant-system/authorino-666ddd7b78-zznww" Jun 09 15:18:57.362527 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.362343 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktqhq\" (UniqueName: \"kubernetes.io/projected/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-kube-api-access-ktqhq\") pod \"authorino-666ddd7b78-zznww\" (UID: \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\") " pod="kuadrant-system/authorino-666ddd7b78-zznww" Jun 09 15:18:57.463127 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.463097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-tls-cert\") pod \"authorino-666ddd7b78-zznww\" (UID: \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\") " pod="kuadrant-system/authorino-666ddd7b78-zznww" Jun 09 15:18:57.463305 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.463161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-oidc-ca\") pod \"authorino-666ddd7b78-zznww\" (UID: \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\") " pod="kuadrant-system/authorino-666ddd7b78-zznww" Jun 09 15:18:57.463305 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.463202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktqhq\" (UniqueName: \"kubernetes.io/projected/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-kube-api-access-ktqhq\") pod \"authorino-666ddd7b78-zznww\" (UID: \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\") " pod="kuadrant-system/authorino-666ddd7b78-zznww" Jun 09 15:18:57.463859 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.463836 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-oidc-ca\") pod \"authorino-666ddd7b78-zznww\" (UID: \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\") " pod="kuadrant-system/authorino-666ddd7b78-zznww" Jun 09 15:18:57.465529 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.465510 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-tls-cert\") pod \"authorino-666ddd7b78-zznww\" (UID: \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\") " pod="kuadrant-system/authorino-666ddd7b78-zznww" Jun 09 15:18:57.471731 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.471712 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktqhq\" (UniqueName: \"kubernetes.io/projected/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-kube-api-access-ktqhq\") pod \"authorino-666ddd7b78-zznww\" (UID: \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\") " pod="kuadrant-system/authorino-666ddd7b78-zznww" Jun 09 15:18:57.602835 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.602770 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-666ddd7b78-zznww" Jun 09 15:18:57.731308 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:57.731276 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-666ddd7b78-zznww"] Jun 09 15:18:57.734167 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:18:57.734141 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5ac2e88_450f_4b92_89cf_c7ff1fb9ef11.slice/crio-699793bbd0b6b6da04fda3f8b4855a4eafbe1a2feeec8ff23e1b4ac0ca4b8463 WatchSource:0}: Error finding container 699793bbd0b6b6da04fda3f8b4855a4eafbe1a2feeec8ff23e1b4ac0ca4b8463: Status 404 returned error can't find the container with id 699793bbd0b6b6da04fda3f8b4855a4eafbe1a2feeec8ff23e1b4ac0ca4b8463 Jun 09 15:18:58.255779 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.255748 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-666ddd7b78-zznww" event={"ID":"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11","Type":"ContainerStarted","Data":"771ba44f95622555e3b3f61a233a2a17524121d99df0d8aa3ab13357a89ecfec"} Jun 09 15:18:58.255779 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.255788 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-666ddd7b78-zznww" event={"ID":"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11","Type":"ContainerStarted","Data":"699793bbd0b6b6da04fda3f8b4855a4eafbe1a2feeec8ff23e1b4ac0ca4b8463"} Jun 09 15:18:58.272202 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.272153 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-666ddd7b78-zznww" podStartSLOduration=0.90953492 podStartE2EDuration="1.272139223s" totalImagesPullingTime="362.604303ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:58.270990097 +0000 UTC m=+996.335564549" watchObservedRunningTime="2026-06-09 15:18:58.272139223 +0000 UTC m=+996.336713685" Jun 09 15:18:58.299190 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.299163 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f644b456d-cnvhj"] Jun 09 15:18:58.299582 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.299319 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6f644b456d-cnvhj" podUID="d3492d0f-b330-4695-813c-972f25056988" containerName="authorino" containerID="cri-o://3da9a0cf50ec8b93dc0d8e8be154bdb96593323d5d3545f6d0ba2017574efce3" gracePeriod=30 Jun 09 15:18:58.571355 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.571329 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f644b456d-cnvhj" Jun 09 15:18:58.676101 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.676020 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc5bk\" (UniqueName: \"kubernetes.io/projected/d3492d0f-b330-4695-813c-972f25056988-kube-api-access-qc5bk\") pod \"d3492d0f-b330-4695-813c-972f25056988\" (UID: \"d3492d0f-b330-4695-813c-972f25056988\") " Jun 09 15:18:58.676101 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.676066 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3492d0f-b330-4695-813c-972f25056988-tls-cert\") pod \"d3492d0f-b330-4695-813c-972f25056988\" (UID: \"d3492d0f-b330-4695-813c-972f25056988\") " Jun 09 15:18:58.678174 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.678146 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3492d0f-b330-4695-813c-972f25056988-kube-api-access-qc5bk" (OuterVolumeSpecName: "kube-api-access-qc5bk") pod "d3492d0f-b330-4695-813c-972f25056988" (UID: "d3492d0f-b330-4695-813c-972f25056988"). InnerVolumeSpecName "kube-api-access-qc5bk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:18:58.689212 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.689178 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3492d0f-b330-4695-813c-972f25056988-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d3492d0f-b330-4695-813c-972f25056988" (UID: "d3492d0f-b330-4695-813c-972f25056988"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:18:58.749903 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.749868 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:58.777458 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.777423 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc5bk\" (UniqueName: \"kubernetes.io/projected/d3492d0f-b330-4695-813c-972f25056988-kube-api-access-qc5bk\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:18:58.777458 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.777449 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3492d0f-b330-4695-813c-972f25056988-tls-cert\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:18:58.846025 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:58.845995 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:59.261597 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:59.261560 2577 generic.go:356] "Generic (PLEG): container finished" podID="d3492d0f-b330-4695-813c-972f25056988" containerID="3da9a0cf50ec8b93dc0d8e8be154bdb96593323d5d3545f6d0ba2017574efce3" exitCode=0 Jun 09 15:18:59.261774 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:59.261627 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f644b456d-cnvhj" Jun 09 15:18:59.261774 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:59.261646 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f644b456d-cnvhj" event={"ID":"d3492d0f-b330-4695-813c-972f25056988","Type":"ContainerDied","Data":"3da9a0cf50ec8b93dc0d8e8be154bdb96593323d5d3545f6d0ba2017574efce3"} Jun 09 15:18:59.261774 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:59.261692 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f644b456d-cnvhj" event={"ID":"d3492d0f-b330-4695-813c-972f25056988","Type":"ContainerDied","Data":"36b3adf1345c059ef39aaed9eab05ec6df5ab0f534fb83efc4ad785e91f04d95"} Jun 09 15:18:59.261774 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:59.261711 2577 scope.go:117] "RemoveContainer" containerID="3da9a0cf50ec8b93dc0d8e8be154bdb96593323d5d3545f6d0ba2017574efce3" Jun 09 15:18:59.270153 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:59.270136 2577 scope.go:117] "RemoveContainer" containerID="3da9a0cf50ec8b93dc0d8e8be154bdb96593323d5d3545f6d0ba2017574efce3" Jun 09 15:18:59.270428 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:18:59.270410 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da9a0cf50ec8b93dc0d8e8be154bdb96593323d5d3545f6d0ba2017574efce3\": container with ID starting with 3da9a0cf50ec8b93dc0d8e8be154bdb96593323d5d3545f6d0ba2017574efce3 not found: ID does not exist" containerID="3da9a0cf50ec8b93dc0d8e8be154bdb96593323d5d3545f6d0ba2017574efce3" Jun 09 15:18:59.270471 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:59.270437 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da9a0cf50ec8b93dc0d8e8be154bdb96593323d5d3545f6d0ba2017574efce3"} err="failed to get container status \"3da9a0cf50ec8b93dc0d8e8be154bdb96593323d5d3545f6d0ba2017574efce3\": rpc error: code = NotFound desc = could not find container \"3da9a0cf50ec8b93dc0d8e8be154bdb96593323d5d3545f6d0ba2017574efce3\": container with ID starting with 3da9a0cf50ec8b93dc0d8e8be154bdb96593323d5d3545f6d0ba2017574efce3 not found: ID does not exist" Jun 09 15:18:59.282898 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:59.282879 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f644b456d-cnvhj"] Jun 09 15:18:59.287388 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:18:59.287371 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f644b456d-cnvhj"] Jun 09 15:19:00.378127 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:00.378095 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3492d0f-b330-4695-813c-972f25056988" path="/var/lib/kubelet/pods/d3492d0f-b330-4695-813c-972f25056988/volumes" Jun 09 15:19:00.922931 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:00.922900 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:01.019991 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:01.019962 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:03.765650 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:03.765595 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:03.866216 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:03.866170 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:12.191981 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.191946 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq"] Jun 09 15:19:12.192374 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.192315 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3492d0f-b330-4695-813c-972f25056988" containerName="authorino" Jun 09 15:19:12.192374 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.192326 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3492d0f-b330-4695-813c-972f25056988" containerName="authorino" Jun 09 15:19:12.192445 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.192398 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3492d0f-b330-4695-813c-972f25056988" containerName="authorino" Jun 09 15:19:12.197155 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.197135 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.201358 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.201331 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 15:19:12.201894 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.201865 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 15:19:12.201970 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.201867 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-75q2q\"" Jun 09 15:19:12.201970 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.201956 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 09 15:19:12.212025 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.212000 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq"] Jun 09 15:19:12.292837 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.292800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63451a84-40b2-4ad2-9626-6597e961681e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.293001 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.292845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63451a84-40b2-4ad2-9626-6597e961681e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.293001 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.292865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mft\" (UniqueName: \"kubernetes.io/projected/63451a84-40b2-4ad2-9626-6597e961681e-kube-api-access-82mft\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.293001 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.292890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63451a84-40b2-4ad2-9626-6597e961681e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.293001 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.292984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63451a84-40b2-4ad2-9626-6597e961681e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.293141 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.293017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63451a84-40b2-4ad2-9626-6597e961681e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.294919 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.294888 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:12.393535 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.393463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63451a84-40b2-4ad2-9626-6597e961681e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.393535 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.393516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63451a84-40b2-4ad2-9626-6597e961681e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.393766 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.393545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63451a84-40b2-4ad2-9626-6597e961681e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.393766 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.393639 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63451a84-40b2-4ad2-9626-6597e961681e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.393766 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.393682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63451a84-40b2-4ad2-9626-6597e961681e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.393766 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.393706 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82mft\" (UniqueName: \"kubernetes.io/projected/63451a84-40b2-4ad2-9626-6597e961681e-kube-api-access-82mft\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.394055 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.394024 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63451a84-40b2-4ad2-9626-6597e961681e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.394177 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.394095 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63451a84-40b2-4ad2-9626-6597e961681e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.394177 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.394093 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63451a84-40b2-4ad2-9626-6597e961681e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.395850 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.395822 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63451a84-40b2-4ad2-9626-6597e961681e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.396133 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.396111 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63451a84-40b2-4ad2-9626-6597e961681e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.400744 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.400718 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82mft\" (UniqueName: \"kubernetes.io/projected/63451a84-40b2-4ad2-9626-6597e961681e-kube-api-access-82mft\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq\" (UID: \"63451a84-40b2-4ad2-9626-6597e961681e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.507400 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.507360 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:12.639518 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:12.639493 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq"] Jun 09 15:19:12.641118 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:19:12.641091 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63451a84_40b2_4ad2_9626_6597e961681e.slice/crio-7c7d4489a5f673d3425fe60bd7a37adbe92aedcaf781cf98e157c0b5636ba7ec WatchSource:0}: Error finding container 7c7d4489a5f673d3425fe60bd7a37adbe92aedcaf781cf98e157c0b5636ba7ec: Status 404 returned error can't find the container with id 7c7d4489a5f673d3425fe60bd7a37adbe92aedcaf781cf98e157c0b5636ba7ec Jun 09 15:19:13.328274 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:13.328238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" event={"ID":"63451a84-40b2-4ad2-9626-6597e961681e","Type":"ContainerStarted","Data":"7c7d4489a5f673d3425fe60bd7a37adbe92aedcaf781cf98e157c0b5636ba7ec"} Jun 09 15:19:17.351602 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:17.351564 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" event={"ID":"63451a84-40b2-4ad2-9626-6597e961681e","Type":"ContainerStarted","Data":"5a58c5ba89e828fe1a977c3c986f35a4b5b26f0710f6c0fa3fedc4458d685b37"} Jun 09 15:19:18.358656 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:18.358587 2577 generic.go:356] "Generic (PLEG): container finished" podID="63451a84-40b2-4ad2-9626-6597e961681e" containerID="5a58c5ba89e828fe1a977c3c986f35a4b5b26f0710f6c0fa3fedc4458d685b37" exitCode=0 Jun 09 15:19:18.359011 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:18.358681 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" event={"ID":"63451a84-40b2-4ad2-9626-6597e961681e","Type":"ContainerDied","Data":"5a58c5ba89e828fe1a977c3c986f35a4b5b26f0710f6c0fa3fedc4458d685b37"} Jun 09 15:19:20.370648 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:20.370588 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" event={"ID":"63451a84-40b2-4ad2-9626-6597e961681e","Type":"ContainerStarted","Data":"14367826e492a8c145e858fb53ff247d041dc192ff0f74d1a549cb8882394030"} Jun 09 15:19:20.391668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:20.391616 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" podStartSLOduration=1.5570423039999999 podStartE2EDuration="8.391588036s" totalImagesPullingTime="5.525099915s" totalInitContainerRuntime="1.309445817s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:19:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:19:20.389444628 +0000 UTC m=+1018.454019095" watchObservedRunningTime="2026-06-09 15:19:20.391588036 +0000 UTC m=+1018.456162486" Jun 09 15:19:22.507701 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:22.507664 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:22.508059 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:22.507721 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:22.520134 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:22.520108 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:23.395850 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:23.395823 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq" Jun 09 15:19:32.386454 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.386426 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln"] Jun 09 15:19:32.403442 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.403417 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln"] Jun 09 15:19:32.403600 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.403516 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.405912 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.405892 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 09 15:19:32.425044 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.425016 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:32.463560 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.463529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01a35e9c-9b5c-4990-a252-fd640cb261ee-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.463735 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.463572 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkzv7\" (UniqueName: \"kubernetes.io/projected/01a35e9c-9b5c-4990-a252-fd640cb261ee-kube-api-access-wkzv7\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.463735 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.463672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01a35e9c-9b5c-4990-a252-fd640cb261ee-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.463735 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.463709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01a35e9c-9b5c-4990-a252-fd640cb261ee-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.463876 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.463757 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01a35e9c-9b5c-4990-a252-fd640cb261ee-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.463876 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.463777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01a35e9c-9b5c-4990-a252-fd640cb261ee-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.564808 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.564772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01a35e9c-9b5c-4990-a252-fd640cb261ee-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.565090 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.564819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01a35e9c-9b5c-4990-a252-fd640cb261ee-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.565090 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.564862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01a35e9c-9b5c-4990-a252-fd640cb261ee-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.565090 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.564906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkzv7\" (UniqueName: \"kubernetes.io/projected/01a35e9c-9b5c-4990-a252-fd640cb261ee-kube-api-access-wkzv7\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.565090 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.564975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01a35e9c-9b5c-4990-a252-fd640cb261ee-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.565090 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.565032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01a35e9c-9b5c-4990-a252-fd640cb261ee-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.565532 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.565219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01a35e9c-9b5c-4990-a252-fd640cb261ee-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.565532 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.565314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01a35e9c-9b5c-4990-a252-fd640cb261ee-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.565532 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.565496 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01a35e9c-9b5c-4990-a252-fd640cb261ee-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.567622 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.567582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01a35e9c-9b5c-4990-a252-fd640cb261ee-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.567831 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.567814 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01a35e9c-9b5c-4990-a252-fd640cb261ee-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.573207 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.573186 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkzv7\" (UniqueName: \"kubernetes.io/projected/01a35e9c-9b5c-4990-a252-fd640cb261ee-kube-api-access-wkzv7\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-f6wln\" (UID: \"01a35e9c-9b5c-4990-a252-fd640cb261ee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.718057 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.718026 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:19:32.848635 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:32.848586 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln"] Jun 09 15:19:32.850806 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:19:32.850773 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a35e9c_9b5c_4990_a252_fd640cb261ee.slice/crio-d31401f0f0ce612f8ed2437f4c6f9344e17820c7281bec376cf171ee816c08c3 WatchSource:0}: Error finding container d31401f0f0ce612f8ed2437f4c6f9344e17820c7281bec376cf171ee816c08c3: Status 404 returned error can't find the container with id d31401f0f0ce612f8ed2437f4c6f9344e17820c7281bec376cf171ee816c08c3 Jun 09 15:19:33.437415 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:33.437374 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" event={"ID":"01a35e9c-9b5c-4990-a252-fd640cb261ee","Type":"ContainerStarted","Data":"4d6e3f96d00e3e2147092df17ca3fdff09e4111640db372af1cdf0ded9a0d32f"} Jun 09 15:19:33.437892 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:33.437431 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" event={"ID":"01a35e9c-9b5c-4990-a252-fd640cb261ee","Type":"ContainerStarted","Data":"d31401f0f0ce612f8ed2437f4c6f9344e17820c7281bec376cf171ee816c08c3"} Jun 09 15:19:47.402518 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.402485 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9"] Jun 09 15:19:47.405064 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.405042 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.407368 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.407348 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 09 15:19:47.415683 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.415656 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9"] Jun 09 15:19:47.489080 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.489040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.489262 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.489114 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.489262 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.489191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.489262 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.489239 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.489431 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.489351 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.489431 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.489397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz6tk\" (UniqueName: \"kubernetes.io/projected/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-kube-api-access-nz6tk\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.489921 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.489885 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:47.590393 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.590364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.590567 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.590404 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.590567 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.590442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.590567 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.590463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.590567 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.590494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.590567 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.590512 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz6tk\" (UniqueName: \"kubernetes.io/projected/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-kube-api-access-nz6tk\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.590866 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.590833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.590942 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.590862 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.590942 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.590921 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.592744 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.592710 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.592977 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.592961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.598407 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.598390 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz6tk\" (UniqueName: \"kubernetes.io/projected/d95e6e4a-955f-45b6-b3e1-d7b02dc91634-kube-api-access-nz6tk\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9\" (UID: \"d95e6e4a-955f-45b6-b3e1-d7b02dc91634\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.717839 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.717800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:47.847621 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:47.847581 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9"] Jun 09 15:19:47.849573 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:19:47.849547 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95e6e4a_955f_45b6_b3e1_d7b02dc91634.slice/crio-d96628663426d00054d658054feeaf04e99985e54d5186b5094429141720daa2 WatchSource:0}: Error finding container d96628663426d00054d658054feeaf04e99985e54d5186b5094429141720daa2: Status 404 returned error can't find the container with id d96628663426d00054d658054feeaf04e99985e54d5186b5094429141720daa2 Jun 09 15:19:48.505814 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:48.505779 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" event={"ID":"d95e6e4a-955f-45b6-b3e1-d7b02dc91634","Type":"ContainerStarted","Data":"2b54b8ba50aaa739d58be251bcee5266032b49568c6a22259b2fbc41cf481b77"} Jun 09 15:19:48.506178 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:48.505839 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" event={"ID":"d95e6e4a-955f-45b6-b3e1-d7b02dc91634","Type":"ContainerStarted","Data":"d96628663426d00054d658054feeaf04e99985e54d5186b5094429141720daa2"} Jun 09 15:19:49.511233 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:49.511197 2577 generic.go:356] "Generic (PLEG): container finished" podID="d95e6e4a-955f-45b6-b3e1-d7b02dc91634" containerID="2b54b8ba50aaa739d58be251bcee5266032b49568c6a22259b2fbc41cf481b77" exitCode=0 Jun 09 15:19:49.511725 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:49.511284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" event={"ID":"d95e6e4a-955f-45b6-b3e1-d7b02dc91634","Type":"ContainerDied","Data":"2b54b8ba50aaa739d58be251bcee5266032b49568c6a22259b2fbc41cf481b77"} Jun 09 15:19:50.517558 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:50.517517 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" event={"ID":"d95e6e4a-955f-45b6-b3e1-d7b02dc91634","Type":"ContainerStarted","Data":"56d78b6c1b39d556d593ab0b8533a31cb821960d18f933b93ec0d9392d21ed72"} Jun 09 15:19:50.537378 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:50.537334 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" podStartSLOduration=1.994504916 podStartE2EDuration="3.537321264s" totalImagesPullingTime="282.302906ms" totalInitContainerRuntime="1.260513442s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:19:50.536028676 +0000 UTC m=+1048.600603127" watchObservedRunningTime="2026-06-09 15:19:50.537321264 +0000 UTC m=+1048.601895714" Jun 09 15:19:57.717941 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:57.717902 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:57.718324 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:57.717969 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:57.730444 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:57.730421 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:19:58.153314 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:58.153241 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:58.567001 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:19:58.566977 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9" Jun 09 15:20:10.613203 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:10.613170 2577 generic.go:356] "Generic (PLEG): container finished" podID="d08bf935-509f-4b03-ae00-822e0da95015" containerID="7cd3402dea1c79801c45fce23b5424351267bb7f2296e2d9c796da34623279ea" exitCode=1 Jun 09 15:20:10.613716 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:10.613245 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" event={"ID":"d08bf935-509f-4b03-ae00-822e0da95015","Type":"ContainerDied","Data":"7cd3402dea1c79801c45fce23b5424351267bb7f2296e2d9c796da34623279ea"} Jun 09 15:20:10.613716 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:10.613686 2577 scope.go:117] "RemoveContainer" containerID="7cd3402dea1c79801c45fce23b5424351267bb7f2296e2d9c796da34623279ea" Jun 09 15:20:10.992886 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:10.992858 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:20:11.620125 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:11.620089 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" event={"ID":"d08bf935-509f-4b03-ae00-822e0da95015","Type":"ContainerStarted","Data":"41c4eea9fc54099afaaa109d4f3a27b7707f44506e18a5579fbd2995c0387527"} Jun 09 15:20:11.620599 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:11.620185 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:20:17.712359 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.712322 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx"] Jun 09 15:20:17.714945 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.714930 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.717964 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.717934 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 15:20:17.728113 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.728090 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx"] Jun 09 15:20:17.790029 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.790003 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:17.861459 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.861423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec83fa25-6c20-43c5-888d-f453a15a5af7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.861628 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.861467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec83fa25-6c20-43c5-888d-f453a15a5af7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.861628 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.861494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpc8k\" (UniqueName: \"kubernetes.io/projected/ec83fa25-6c20-43c5-888d-f453a15a5af7-kube-api-access-vpc8k\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.861628 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.861579 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec83fa25-6c20-43c5-888d-f453a15a5af7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.861628 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.861623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec83fa25-6c20-43c5-888d-f453a15a5af7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.861788 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.861708 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec83fa25-6c20-43c5-888d-f453a15a5af7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.962498 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.962406 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec83fa25-6c20-43c5-888d-f453a15a5af7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.962498 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.962444 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpc8k\" (UniqueName: \"kubernetes.io/projected/ec83fa25-6c20-43c5-888d-f453a15a5af7-kube-api-access-vpc8k\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.962770 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.962506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec83fa25-6c20-43c5-888d-f453a15a5af7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.962770 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.962531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec83fa25-6c20-43c5-888d-f453a15a5af7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.962770 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.962585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec83fa25-6c20-43c5-888d-f453a15a5af7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.962770 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.962702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec83fa25-6c20-43c5-888d-f453a15a5af7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.963012 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.962975 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec83fa25-6c20-43c5-888d-f453a15a5af7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.963143 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.963044 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec83fa25-6c20-43c5-888d-f453a15a5af7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.963143 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.963096 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec83fa25-6c20-43c5-888d-f453a15a5af7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.964832 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.964813 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec83fa25-6c20-43c5-888d-f453a15a5af7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.965102 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.965084 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec83fa25-6c20-43c5-888d-f453a15a5af7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:17.970786 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:17.970763 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpc8k\" (UniqueName: \"kubernetes.io/projected/ec83fa25-6c20-43c5-888d-f453a15a5af7-kube-api-access-vpc8k\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx\" (UID: \"ec83fa25-6c20-43c5-888d-f453a15a5af7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:18.027366 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:18.027338 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:20:18.373851 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:18.366333 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx"] Jun 09 15:20:18.655256 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:18.655167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" event={"ID":"ec83fa25-6c20-43c5-888d-f453a15a5af7","Type":"ContainerStarted","Data":"29f33374dbe7f7ca4678dc9147ae42cb42270192ff5b4674d88d7d26c6297100"} Jun 09 15:20:18.655256 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:18.655228 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" event={"ID":"ec83fa25-6c20-43c5-888d-f453a15a5af7","Type":"ContainerStarted","Data":"cd4f020b16893bb2eaf668c99e52898523b1fadec388ce7894f772626cb13f86"} Jun 09 15:20:22.625785 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:22.625752 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:20:25.689928 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:25.689891 2577 generic.go:356] "Generic (PLEG): container finished" podID="01a35e9c-9b5c-4990-a252-fd640cb261ee" containerID="4d6e3f96d00e3e2147092df17ca3fdff09e4111640db372af1cdf0ded9a0d32f" exitCode=0 Jun 09 15:20:25.690297 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:25.689938 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" event={"ID":"01a35e9c-9b5c-4990-a252-fd640cb261ee","Type":"ContainerDied","Data":"4d6e3f96d00e3e2147092df17ca3fdff09e4111640db372af1cdf0ded9a0d32f"} Jun 09 15:20:26.696242 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:26.696207 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" event={"ID":"01a35e9c-9b5c-4990-a252-fd640cb261ee","Type":"ContainerStarted","Data":"5213cdf229df955dff991fab294c5d0b2c0f937fb9ade2dbdb735c895d102e28"} Jun 09 15:20:26.720487 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:26.720435 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" podStartSLOduration=1.93981499 podStartE2EDuration="54.72042093s" totalImagesPullingTime="187.003267ms" totalInitContainerRuntime="52.593602673s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:20:26.717489469 +0000 UTC m=+1084.782063919" watchObservedRunningTime="2026-06-09 15:20:26.72042093 +0000 UTC m=+1084.784995381" Jun 09 15:20:27.501939 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.501909 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645"] Jun 09 15:20:27.508664 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.505704 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.508664 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.508622 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 15:20:27.517572 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.517546 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645"] Jun 09 15:20:27.531218 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.531192 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:27.547301 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.547277 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/145565e9-67b7-4f45-a7ab-dbf986f46b74-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.547391 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.547313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/145565e9-67b7-4f45-a7ab-dbf986f46b74-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.547440 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.547404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/145565e9-67b7-4f45-a7ab-dbf986f46b74-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.547702 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.547441 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/145565e9-67b7-4f45-a7ab-dbf986f46b74-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.547702 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.547464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cljpp\" (UniqueName: \"kubernetes.io/projected/145565e9-67b7-4f45-a7ab-dbf986f46b74-kube-api-access-cljpp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.547702 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.547484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/145565e9-67b7-4f45-a7ab-dbf986f46b74-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.648533 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.648503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/145565e9-67b7-4f45-a7ab-dbf986f46b74-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.648533 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.648537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cljpp\" (UniqueName: \"kubernetes.io/projected/145565e9-67b7-4f45-a7ab-dbf986f46b74-kube-api-access-cljpp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.648769 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.648558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/145565e9-67b7-4f45-a7ab-dbf986f46b74-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.648769 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.648633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/145565e9-67b7-4f45-a7ab-dbf986f46b74-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.648769 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.648673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/145565e9-67b7-4f45-a7ab-dbf986f46b74-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.648769 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.648768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/145565e9-67b7-4f45-a7ab-dbf986f46b74-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.649080 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.649056 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/145565e9-67b7-4f45-a7ab-dbf986f46b74-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.649136 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.649095 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/145565e9-67b7-4f45-a7ab-dbf986f46b74-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.649136 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.649121 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/145565e9-67b7-4f45-a7ab-dbf986f46b74-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.651012 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.650987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/145565e9-67b7-4f45-a7ab-dbf986f46b74-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.651187 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.651170 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/145565e9-67b7-4f45-a7ab-dbf986f46b74-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.656948 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.656926 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cljpp\" (UniqueName: \"kubernetes.io/projected/145565e9-67b7-4f45-a7ab-dbf986f46b74-kube-api-access-cljpp\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-t7645\" (UID: \"145565e9-67b7-4f45-a7ab-dbf986f46b74\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.819021 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.818930 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:27.950693 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:27.950668 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645"] Jun 09 15:20:27.952422 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:20:27.952397 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod145565e9_67b7_4f45_a7ab_dbf986f46b74.slice/crio-c94823a3215519f3735e67e9aebab4790e2193ad5111d6c023339fd7538f747a WatchSource:0}: Error finding container c94823a3215519f3735e67e9aebab4790e2193ad5111d6c023339fd7538f747a: Status 404 returned error can't find the container with id c94823a3215519f3735e67e9aebab4790e2193ad5111d6c023339fd7538f747a Jun 09 15:20:28.707554 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:28.707522 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" event={"ID":"145565e9-67b7-4f45-a7ab-dbf986f46b74","Type":"ContainerStarted","Data":"151745564c9bd632b7cba45ab3dcc22c5a4a452c706c5fba3e5c6cead365d3a0"} Jun 09 15:20:28.707741 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:28.707573 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" event={"ID":"145565e9-67b7-4f45-a7ab-dbf986f46b74","Type":"ContainerStarted","Data":"c94823a3215519f3735e67e9aebab4790e2193ad5111d6c023339fd7538f747a"} Jun 09 15:20:29.713591 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:29.713559 2577 generic.go:356] "Generic (PLEG): container finished" podID="145565e9-67b7-4f45-a7ab-dbf986f46b74" containerID="151745564c9bd632b7cba45ab3dcc22c5a4a452c706c5fba3e5c6cead365d3a0" exitCode=0 Jun 09 15:20:29.713973 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:29.713641 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" event={"ID":"145565e9-67b7-4f45-a7ab-dbf986f46b74","Type":"ContainerDied","Data":"151745564c9bd632b7cba45ab3dcc22c5a4a452c706c5fba3e5c6cead365d3a0"} Jun 09 15:20:30.720795 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:30.720759 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" event={"ID":"145565e9-67b7-4f45-a7ab-dbf986f46b74","Type":"ContainerStarted","Data":"7e1cd30f8becb80517b1925fb8a68f91ce2d7d0b4091312cca05d22fab70dfc8"} Jun 09 15:20:30.744201 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:30.744153 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" podStartSLOduration=2.193747583 podStartE2EDuration="3.744137231s" totalImagesPullingTime="278.694343ms" totalInitContainerRuntime="1.271695305s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:20:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:20:30.741011954 +0000 UTC m=+1088.805586415" watchObservedRunningTime="2026-06-09 15:20:30.744137231 +0000 UTC m=+1088.808711682" Jun 09 15:20:32.718687 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:32.718660 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:20:32.719167 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:32.718747 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:20:32.731132 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:32.731104 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:20:32.742180 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:32.742160 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-f6wln" Jun 09 15:20:34.168567 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:34.168533 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:37.819462 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:37.819435 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:37.819889 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:37.819486 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:37.836370 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:37.836344 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:38.768937 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:38.768907 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-t7645" Jun 09 15:20:45.063539 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:20:45.063506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:21:05.819223 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:05.819186 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:21:15.935110 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:15.935079 2577 generic.go:356] "Generic (PLEG): container finished" podID="ec83fa25-6c20-43c5-888d-f453a15a5af7" containerID="29f33374dbe7f7ca4678dc9147ae42cb42270192ff5b4674d88d7d26c6297100" exitCode=0 Jun 09 15:21:15.935484 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:15.935154 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" event={"ID":"ec83fa25-6c20-43c5-888d-f453a15a5af7","Type":"ContainerDied","Data":"29f33374dbe7f7ca4678dc9147ae42cb42270192ff5b4674d88d7d26c6297100"} Jun 09 15:21:16.941796 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:16.941765 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" event={"ID":"ec83fa25-6c20-43c5-888d-f453a15a5af7","Type":"ContainerStarted","Data":"9c90a50bbafc5d1a1d56db92c3989061ff9f0038eefb4ccc1a71d764e87f15e1"} Jun 09 15:21:16.964350 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:16.964305 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" podStartSLOduration=2.219985982 podStartE2EDuration="59.964291253s" totalImagesPullingTime="251.023404ms" totalInitContainerRuntime="57.493281867s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:21:16.962297507 +0000 UTC m=+1135.026871992" watchObservedRunningTime="2026-06-09 15:21:16.964291253 +0000 UTC m=+1135.028865703" Jun 09 15:21:18.028448 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:18.028413 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:21:18.028853 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:18.028485 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:21:18.041102 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:18.041079 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:21:18.962435 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:18.962410 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx" Jun 09 15:21:54.644017 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:54.643937 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:21:54.778291 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:54.778253 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:21:55.773551 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:55.773511 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:21:55.873522 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:55.873489 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:21:58.594034 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:58.594000 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-666ddd7b78-zznww"] Jun 09 15:21:58.594568 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:58.594273 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-666ddd7b78-zznww" podUID="b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11" containerName="authorino" containerID="cri-o://771ba44f95622555e3b3f61a233a2a17524121d99df0d8aa3ab13357a89ecfec" gracePeriod=30 Jun 09 15:21:58.847188 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:58.847126 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-666ddd7b78-zznww" Jun 09 15:21:58.965438 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:58.965409 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-oidc-ca\") pod \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\" (UID: \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\") " Jun 09 15:21:58.965438 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:58.965442 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktqhq\" (UniqueName: \"kubernetes.io/projected/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-kube-api-access-ktqhq\") pod \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\" (UID: \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\") " Jun 09 15:21:58.965769 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:58.965520 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-tls-cert\") pod \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\" (UID: \"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11\") " Jun 09 15:21:58.967505 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:58.967467 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-kube-api-access-ktqhq" (OuterVolumeSpecName: "kube-api-access-ktqhq") pod "b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11" (UID: "b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11"). InnerVolumeSpecName "kube-api-access-ktqhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:21:58.971082 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:58.971055 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11" (UID: "b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:21:58.975416 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:58.975390 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11" (UID: "b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:21:59.066683 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:59.066649 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-tls-cert\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:21:59.066811 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:59.066696 2577 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-oidc-ca\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:21:59.066811 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:59.066709 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktqhq\" (UniqueName: \"kubernetes.io/projected/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11-kube-api-access-ktqhq\") on node \"ip-10-0-131-236.ec2.internal\" DevicePath \"\"" Jun 09 15:21:59.144774 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:59.144680 2577 generic.go:356] "Generic (PLEG): container finished" podID="b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11" containerID="771ba44f95622555e3b3f61a233a2a17524121d99df0d8aa3ab13357a89ecfec" exitCode=0 Jun 09 15:21:59.144774 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:59.144724 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-666ddd7b78-zznww" Jun 09 15:21:59.144774 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:59.144732 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-666ddd7b78-zznww" event={"ID":"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11","Type":"ContainerDied","Data":"771ba44f95622555e3b3f61a233a2a17524121d99df0d8aa3ab13357a89ecfec"} Jun 09 15:21:59.145023 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:59.144778 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-666ddd7b78-zznww" event={"ID":"b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11","Type":"ContainerDied","Data":"699793bbd0b6b6da04fda3f8b4855a4eafbe1a2feeec8ff23e1b4ac0ca4b8463"} Jun 09 15:21:59.145023 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:59.144800 2577 scope.go:117] "RemoveContainer" containerID="771ba44f95622555e3b3f61a233a2a17524121d99df0d8aa3ab13357a89ecfec" Jun 09 15:21:59.154265 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:59.154241 2577 scope.go:117] "RemoveContainer" containerID="771ba44f95622555e3b3f61a233a2a17524121d99df0d8aa3ab13357a89ecfec" Jun 09 15:21:59.154524 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:21:59.154505 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"771ba44f95622555e3b3f61a233a2a17524121d99df0d8aa3ab13357a89ecfec\": container with ID starting with 771ba44f95622555e3b3f61a233a2a17524121d99df0d8aa3ab13357a89ecfec not found: ID does not exist" containerID="771ba44f95622555e3b3f61a233a2a17524121d99df0d8aa3ab13357a89ecfec" Jun 09 15:21:59.154596 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:59.154531 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"771ba44f95622555e3b3f61a233a2a17524121d99df0d8aa3ab13357a89ecfec"} err="failed to get container status \"771ba44f95622555e3b3f61a233a2a17524121d99df0d8aa3ab13357a89ecfec\": rpc error: code = NotFound desc = could not find container \"771ba44f95622555e3b3f61a233a2a17524121d99df0d8aa3ab13357a89ecfec\": container with ID starting with 771ba44f95622555e3b3f61a233a2a17524121d99df0d8aa3ab13357a89ecfec not found: ID does not exist" Jun 09 15:21:59.166296 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:59.166276 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-666ddd7b78-zznww"] Jun 09 15:21:59.171791 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:21:59.171771 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-666ddd7b78-zznww"] Jun 09 15:22:00.379303 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:00.379268 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11" path="/var/lib/kubelet/pods/b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11/volumes" Jun 09 15:22:11.205743 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:11.205711 2577 generic.go:356] "Generic (PLEG): container finished" podID="d08bf935-509f-4b03-ae00-822e0da95015" containerID="41c4eea9fc54099afaaa109d4f3a27b7707f44506e18a5579fbd2995c0387527" exitCode=1 Jun 09 15:22:11.206139 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:11.205768 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" event={"ID":"d08bf935-509f-4b03-ae00-822e0da95015","Type":"ContainerDied","Data":"41c4eea9fc54099afaaa109d4f3a27b7707f44506e18a5579fbd2995c0387527"} Jun 09 15:22:11.206139 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:11.205841 2577 scope.go:117] "RemoveContainer" containerID="7cd3402dea1c79801c45fce23b5424351267bb7f2296e2d9c796da34623279ea" Jun 09 15:22:11.206265 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:11.206141 2577 scope.go:117] "RemoveContainer" containerID="41c4eea9fc54099afaaa109d4f3a27b7707f44506e18a5579fbd2995c0387527" Jun 09 15:22:11.206411 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:22:11.206390 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-wz8ht_openshift-ingress(d08bf935-509f-4b03-ae00-822e0da95015)\"" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" podUID="d08bf935-509f-4b03-ae00-822e0da95015" Jun 09 15:22:12.625312 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:12.625280 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:22:12.625722 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:12.625660 2577 scope.go:117] "RemoveContainer" containerID="41c4eea9fc54099afaaa109d4f3a27b7707f44506e18a5579fbd2995c0387527" Jun 09 15:22:12.625881 ip-10-0-131-236 kubenswrapper[2577]: E0609 15:22:12.625860 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-wz8ht_openshift-ingress(d08bf935-509f-4b03-ae00-822e0da95015)\"" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" podUID="d08bf935-509f-4b03-ae00-822e0da95015" Jun 09 15:22:16.475642 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:16.475593 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5c7f895466-8swrv_cfe31481-cd09-4075-9729-0932342805b0/nginx/0.log" Jun 09 15:22:16.823073 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:16.822989 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6d74d9b96d-hwcn9_0e392807-f685-4b2f-b1fc-883ee9b0c2f8/maas-api/0.log" Jun 09 15:22:16.941762 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:16.941721 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c498967fc-6hs2x_d67d4b2e-6fea-49e0-b395-47744d02cbc7/manager/0.log" Jun 09 15:22:17.577560 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:17.577533 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ff5447b54-z6ffw_d2a1a060-9d11-4aff-bc58-89042cfce0e2/copy-manifests/0.log" Jun 09 15:22:17.584500 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:17.584480 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ff5447b54-z6ffw_d2a1a060-9d11-4aff-bc58-89042cfce0e2/manager/0.log" Jun 09 15:22:19.204789 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:19.204760 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lzzwp_6b28ccdc-16bc-4318-b2b1-4b6654b53338/manager/0.log" Jun 09 15:22:19.321494 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:19.321467 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qk5f2_9088d720-9608-421a-aaeb-100aa162f324/manager/0.log" Jun 09 15:22:19.438972 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:19.438946 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6wxhn_e12295cb-77b7-4cdb-b157-c5a4aef81b42/kuadrant-console-plugin/0.log" Jun 09 15:22:19.565831 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:19.565768 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9hc84_0f2f6b84-3b6f-47ed-a67a-2f384213143e/registry-server/0.log" Jun 09 15:22:20.274873 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:20.274846 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjkvj4_7f9c23a3-a786-40e6-a635-1fe87aa51578/istio-proxy/0.log" Jun 09 15:22:20.773066 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:20.773042 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mc5bd_7d1a401c-03ab-4b5a-a520-400a445540f9/istio-proxy/1.log" Jun 09 15:22:20.890358 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:20.890326 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-zqrd7_224cd4f5-3eea-4cf4-9f66-446b1fc17091/payload-pre-processing/0.log" Jun 09 15:22:21.011490 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:21.011461 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-wz8ht_d08bf935-509f-4b03-ae00-822e0da95015/payload-processing/1.log" Jun 09 15:22:21.496342 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:21.496315 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq_63451a84-40b2-4ad2-9626-6597e961681e/main/0.log" Jun 09 15:22:21.503644 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:21.503625 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-x5jkq_63451a84-40b2-4ad2-9626-6597e961681e/storage-initializer/0.log" Jun 09 15:22:21.636444 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:21.636416 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-f6wln_01a35e9c-9b5c-4990-a252-fd640cb261ee/storage-initializer/0.log" Jun 09 15:22:21.651429 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:21.651408 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-f6wln_01a35e9c-9b5c-4990-a252-fd640cb261ee/main/0.log" Jun 09 15:22:21.780679 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:21.780586 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9_d95e6e4a-955f-45b6-b3e1-d7b02dc91634/storage-initializer/0.log" Jun 09 15:22:21.788441 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:21.788419 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-k88l9_d95e6e4a-955f-45b6-b3e1-d7b02dc91634/main/0.log" Jun 09 15:22:21.904592 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:21.904565 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx_ec83fa25-6c20-43c5-888d-f453a15a5af7/storage-initializer/0.log" Jun 09 15:22:21.912702 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:21.912681 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cg68mx_ec83fa25-6c20-43c5-888d-f453a15a5af7/main/0.log" Jun 09 15:22:22.026153 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:22.026125 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-t7645_145565e9-67b7-4f45-a7ab-dbf986f46b74/storage-initializer/0.log" Jun 09 15:22:22.034129 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:22.034076 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-t7645_145565e9-67b7-4f45-a7ab-dbf986f46b74/main/0.log" Jun 09 15:22:25.896748 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:25.896707 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:27.053068 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:27.053036 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:27.372676 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:27.372575 2577 scope.go:117] "RemoveContainer" containerID="41c4eea9fc54099afaaa109d4f3a27b7707f44506e18a5579fbd2995c0387527" Jun 09 15:22:28.004693 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:28.004661 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:22:28.290687 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:28.290577 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" event={"ID":"d08bf935-509f-4b03-ae00-822e0da95015","Type":"ContainerStarted","Data":"d2111e4cc18770fb67160a76a408ec8f9fb6eebbd8144a8da1e399748f8defec"} Jun 09 15:22:28.290687 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:28.290662 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:22:29.033844 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:29.033798 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wzf42_d0ecc9aa-f7a5-45b9-a149-46935344e89d/global-pull-secret-syncer/0.log" Jun 09 15:22:29.075665 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:29.075634 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r9vbh_010af952-07a7-423e-b0dc-b2318dac9bdb/konnectivity-agent/0.log" Jun 09 15:22:29.144693 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:29.144663 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-236.ec2.internal_654ff8c271d406a1aee9355158204960/haproxy/0.log" Jun 09 15:22:33.927069 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:33.927029 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lzzwp_6b28ccdc-16bc-4318-b2b1-4b6654b53338/manager/0.log" Jun 09 15:22:33.951787 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:33.951761 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qk5f2_9088d720-9608-421a-aaeb-100aa162f324/manager/0.log" Jun 09 15:22:33.975649 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:33.975599 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6wxhn_e12295cb-77b7-4cdb-b157-c5a4aef81b42/kuadrant-console-plugin/0.log" Jun 09 15:22:34.009200 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:34.009169 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9hc84_0f2f6b84-3b6f-47ed-a67a-2f384213143e/registry-server/0.log" Jun 09 15:22:36.037499 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:36.037459 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-dnswx_e46dded0-899e-4dfb-8535-f8eb08c8872a/kube-state-metrics/0.log" Jun 09 15:22:36.056255 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:36.056236 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-dnswx_e46dded0-899e-4dfb-8535-f8eb08c8872a/kube-rbac-proxy-main/0.log" Jun 09 15:22:36.077559 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:36.077534 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-dnswx_e46dded0-899e-4dfb-8535-f8eb08c8872a/kube-rbac-proxy-self/0.log" Jun 09 15:22:36.126648 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:36.126624 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-6cbbs_39caef52-48e7-4579-87dd-83626270df26/monitoring-plugin/0.log" Jun 09 15:22:36.234877 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:36.234849 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llq29_2477b750-9ef5-4d46-8b86-eda6cd19ffdb/node-exporter/0.log" Jun 09 15:22:36.253514 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:36.253493 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llq29_2477b750-9ef5-4d46-8b86-eda6cd19ffdb/kube-rbac-proxy/0.log" Jun 09 15:22:36.275720 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:36.275704 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llq29_2477b750-9ef5-4d46-8b86-eda6cd19ffdb/init-textfile/0.log" Jun 09 15:22:39.296954 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:39.296923 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-wz8ht" Jun 09 15:22:39.805143 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:39.805116 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-qzb4x_7207a032-507d-4078-bcc3-c77cf9e190a7/download-server/0.log" Jun 09 15:22:40.357566 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.357524 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c"] Jun 09 15:22:40.357967 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.357954 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11" containerName="authorino" Jun 09 15:22:40.357967 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.357968 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11" containerName="authorino" Jun 09 15:22:40.358079 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.358046 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5ac2e88-450f-4b92-89cf-c7ff1fb9ef11" containerName="authorino" Jun 09 15:22:40.361142 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.361123 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.363245 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.363225 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9f6rk\"/\"kube-root-ca.crt\"" Jun 09 15:22:40.363864 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.363842 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9f6rk\"/\"default-dockercfg-m6gg9\"" Jun 09 15:22:40.363978 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.363861 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9f6rk\"/\"openshift-service-ca.crt\"" Jun 09 15:22:40.370496 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.370473 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c"] Jun 09 15:22:40.539045 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.539016 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhb6z\" (UniqueName: \"kubernetes.io/projected/d0af2524-d84f-4b64-8735-f8102fca3335-kube-api-access-xhb6z\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.539207 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.539069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0af2524-d84f-4b64-8735-f8102fca3335-podres\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.539207 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.539139 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0af2524-d84f-4b64-8735-f8102fca3335-sys\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.539207 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.539178 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0af2524-d84f-4b64-8735-f8102fca3335-proc\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.539207 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.539199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0af2524-d84f-4b64-8735-f8102fca3335-lib-modules\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.640169 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.640087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhb6z\" (UniqueName: \"kubernetes.io/projected/d0af2524-d84f-4b64-8735-f8102fca3335-kube-api-access-xhb6z\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.640169 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.640136 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0af2524-d84f-4b64-8735-f8102fca3335-podres\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.640169 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.640154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0af2524-d84f-4b64-8735-f8102fca3335-sys\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.640381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.640182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0af2524-d84f-4b64-8735-f8102fca3335-proc\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.640381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.640208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0af2524-d84f-4b64-8735-f8102fca3335-lib-modules\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.640381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.640252 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0af2524-d84f-4b64-8735-f8102fca3335-sys\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.640381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.640284 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0af2524-d84f-4b64-8735-f8102fca3335-podres\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.640381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.640321 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0af2524-d84f-4b64-8735-f8102fca3335-proc\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.640381 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.640342 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0af2524-d84f-4b64-8735-f8102fca3335-lib-modules\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.648349 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.648333 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhb6z\" (UniqueName: \"kubernetes.io/projected/d0af2524-d84f-4b64-8735-f8102fca3335-kube-api-access-xhb6z\") pod \"perf-node-gather-daemonset-d6d7c\" (UID: \"d0af2524-d84f-4b64-8735-f8102fca3335\") " pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.672547 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.672518 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:40.804066 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:40.804042 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c"] Jun 09 15:22:40.805660 ip-10-0-131-236 kubenswrapper[2577]: W0609 15:22:40.805629 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd0af2524_d84f_4b64_8735_f8102fca3335.slice/crio-a27aa4dd282ceda796e02843f9c406a9c6f669e0d7171f24748216478bd36909 WatchSource:0}: Error finding container a27aa4dd282ceda796e02843f9c406a9c6f669e0d7171f24748216478bd36909: Status 404 returned error can't find the container with id a27aa4dd282ceda796e02843f9c406a9c6f669e0d7171f24748216478bd36909 Jun 09 15:22:41.358306 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:41.358273 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" event={"ID":"d0af2524-d84f-4b64-8735-f8102fca3335","Type":"ContainerStarted","Data":"935ae0304dc9dd2d5324f1fcadf8c32c0bd3d2d0d975ae1b648b3f0ec1d92eac"} Jun 09 15:22:41.358712 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:41.358323 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" event={"ID":"d0af2524-d84f-4b64-8735-f8102fca3335","Type":"ContainerStarted","Data":"a27aa4dd282ceda796e02843f9c406a9c6f669e0d7171f24748216478bd36909"} Jun 09 15:22:41.358712 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:41.358368 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:41.374918 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:41.374873 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" podStartSLOduration=1.374858537 podStartE2EDuration="1.374858537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:22:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:22:41.373350462 +0000 UTC m=+1219.437924926" watchObservedRunningTime="2026-06-09 15:22:41.374858537 +0000 UTC m=+1219.439432987" Jun 09 15:22:41.853656 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:41.853629 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lg9b8_3dda6239-4344-4d5f-91b7-fc9a0a6597c2/dns/0.log" Jun 09 15:22:41.873187 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:41.873165 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lg9b8_3dda6239-4344-4d5f-91b7-fc9a0a6597c2/kube-rbac-proxy/0.log" Jun 09 15:22:41.942052 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:41.942025 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7279q_3e2b3935-080c-42d7-9c11-02c58bd8d6ec/dns-node-resolver/0.log" Jun 09 15:22:42.523466 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:42.523437 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7445cd6d48-ngvsb_a76db812-d3c4-4fdc-9835-01c5be6319d9/registry/0.log" Jun 09 15:22:42.542619 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:42.542584 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6tsz7_6d2fb819-c531-4e5c-90ba-69875d3e02fc/node-ca/0.log" Jun 09 15:22:43.546934 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:43.546903 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjkvj4_7f9c23a3-a786-40e6-a635-1fe87aa51578/istio-proxy/0.log" Jun 09 15:22:43.679397 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:43.679366 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mc5bd_7d1a401c-03ab-4b5a-a520-400a445540f9/istio-proxy/0.log" Jun 09 15:22:43.682044 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:43.682026 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mc5bd_7d1a401c-03ab-4b5a-a520-400a445540f9/istio-proxy/1.log" Jun 09 15:22:43.703332 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:43.703310 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-zqrd7_224cd4f5-3eea-4cf4-9f66-446b1fc17091/payload-pre-processing/0.log" Jun 09 15:22:43.724173 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:43.724149 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-wz8ht_d08bf935-509f-4b03-ae00-822e0da95015/payload-processing/2.log" Jun 09 15:22:43.730785 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:43.730761 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-wz8ht_d08bf935-509f-4b03-ae00-822e0da95015/payload-processing/1.log" Jun 09 15:22:44.343118 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:44.343088 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9l9tf_e3d76fef-ea75-4e7d-8de5-f1a607a448b6/serve-healthcheck-canary/0.log" Jun 09 15:22:44.896787 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:44.896745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-jp4gp_cb4d7536-714c-4647-bc2c-a9f7bf3d2369/insights-operator/1.log" Jun 09 15:22:44.896787 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:44.896783 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-jp4gp_cb4d7536-714c-4647-bc2c-a9f7bf3d2369/insights-operator/0.log" Jun 09 15:22:44.917737 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:44.917699 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dgl42_2d12388a-f2be-4278-8650-2a5c8b4b2f04/kube-rbac-proxy/0.log" Jun 09 15:22:44.937205 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:44.937188 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dgl42_2d12388a-f2be-4278-8650-2a5c8b4b2f04/exporter/0.log" Jun 09 15:22:44.957387 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:44.957365 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dgl42_2d12388a-f2be-4278-8650-2a5c8b4b2f04/extractor/0.log" Jun 09 15:22:47.320931 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:47.320892 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5c7f895466-8swrv_cfe31481-cd09-4075-9729-0932342805b0/nginx/0.log" Jun 09 15:22:47.372207 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:47.372178 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9f6rk/perf-node-gather-daemonset-d6d7c" Jun 09 15:22:47.406159 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:47.406135 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6d74d9b96d-hwcn9_0e392807-f685-4b2f-b1fc-883ee9b0c2f8/maas-api/0.log" Jun 09 15:22:47.431193 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:47.431172 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c498967fc-6hs2x_d67d4b2e-6fea-49e0-b395-47744d02cbc7/manager/0.log" Jun 09 15:22:47.674063 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:47.673983 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ff5447b54-z6ffw_d2a1a060-9d11-4aff-bc58-89042cfce0e2/manager/0.log" Jun 09 15:22:47.693626 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:47.693578 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ff5447b54-z6ffw_d2a1a060-9d11-4aff-bc58-89042cfce0e2/copy-manifests/0.log" Jun 09 15:22:49.328547 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:49.328460 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6b54fb96bd-nc5hg_f006ff89-aa41-4c77-aa4b-b908aee97ff8/manager/0.log" Jun 09 15:22:55.029899 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:55.029865 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjkvj4_7f9c23a3-a786-40e6-a635-1fe87aa51578/istio-proxy/0.log" Jun 09 15:22:55.138717 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:55.138692 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mc5bd_7d1a401c-03ab-4b5a-a520-400a445540f9/istio-proxy/0.log" Jun 09 15:22:55.141725 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:55.141701 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mc5bd_7d1a401c-03ab-4b5a-a520-400a445540f9/istio-proxy/1.log" Jun 09 15:22:55.155835 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:55.155814 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-zqrd7_224cd4f5-3eea-4cf4-9f66-446b1fc17091/payload-pre-processing/0.log" Jun 09 15:22:55.168593 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:55.168575 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-wz8ht_d08bf935-509f-4b03-ae00-822e0da95015/payload-processing/2.log" Jun 09 15:22:55.174668 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:55.174648 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-wz8ht_d08bf935-509f-4b03-ae00-822e0da95015/payload-processing/1.log" Jun 09 15:22:56.310063 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.310031 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjkvj4_7f9c23a3-a786-40e6-a635-1fe87aa51578/istio-proxy/0.log" Jun 09 15:22:56.421992 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.421909 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mc5bd_7d1a401c-03ab-4b5a-a520-400a445540f9/istio-proxy/0.log" Jun 09 15:22:56.424980 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.424955 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mc5bd_7d1a401c-03ab-4b5a-a520-400a445540f9/istio-proxy/1.log" Jun 09 15:22:56.441888 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.441857 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-zqrd7_224cd4f5-3eea-4cf4-9f66-446b1fc17091/payload-pre-processing/0.log" Jun 09 15:22:56.452229 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.452208 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-wz8ht_d08bf935-509f-4b03-ae00-822e0da95015/payload-processing/2.log" Jun 09 15:22:56.458602 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.458585 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-wz8ht_d08bf935-509f-4b03-ae00-822e0da95015/payload-processing/1.log" Jun 09 15:22:56.655108 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.655082 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gttwt_133e775b-f85e-4940-a6d1-5d3989eebe0a/kube-multus-additional-cni-plugins/0.log" Jun 09 15:22:56.679915 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.679849 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gttwt_133e775b-f85e-4940-a6d1-5d3989eebe0a/egress-router-binary-copy/0.log" Jun 09 15:22:56.703027 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.703003 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gttwt_133e775b-f85e-4940-a6d1-5d3989eebe0a/cni-plugins/0.log" Jun 09 15:22:56.727766 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.727748 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gttwt_133e775b-f85e-4940-a6d1-5d3989eebe0a/bond-cni-plugin/0.log" Jun 09 15:22:56.748688 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.748669 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gttwt_133e775b-f85e-4940-a6d1-5d3989eebe0a/routeoverride-cni/0.log" Jun 09 15:22:56.774439 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.774420 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gttwt_133e775b-f85e-4940-a6d1-5d3989eebe0a/whereabouts-cni-bincopy/0.log" Jun 09 15:22:56.796759 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.796730 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gttwt_133e775b-f85e-4940-a6d1-5d3989eebe0a/whereabouts-cni/0.log" Jun 09 15:22:56.997128 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:56.997100 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wb4sw_7fe3e493-a090-4fc2-aef0-f02d3b791af8/kube-multus/0.log" Jun 09 15:22:57.143411 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:57.143379 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ngkbp_554ab5a3-a06d-4031-849a-d0afc7d6de4a/network-metrics-daemon/0.log" Jun 09 15:22:57.168031 ip-10-0-131-236 kubenswrapper[2577]: I0609 15:22:57.167986 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ngkbp_554ab5a3-a06d-4031-849a-d0afc7d6de4a/kube-rbac-proxy/0.log"