Jun 08 19:33:17.567550 ip-10-0-131-230 systemd[1]: Starting Kubernetes Kubelet... Jun 08 19:33:17.932371 ip-10-0-131-230 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:33:17.932371 ip-10-0-131-230 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 19:33:17.932371 ip-10-0-131-230 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:33:17.932371 ip-10-0-131-230 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 19:33:17.932371 ip-10-0-131-230 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:33:17.933897 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.933813 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 19:33:17.938541 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.938525 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:33:17.938541 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.938542 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:33:17.938606 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.938546 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:33:17.938606 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.938549 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:33:17.938606 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.938553 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:33:17.938606 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.938556 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:33:17.938606 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.938559 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:33:17.938606 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.938562 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:33:17.938606 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.938598 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:33:17.940008 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.939979 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:33:17.940008 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940001 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:33:17.940174 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940018 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:33:17.940174 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940024 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:33:17.940174 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940029 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:33:17.940174 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940033 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:33:17.940174 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940038 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:33:17.940174 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940148 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:33:17.940174 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940157 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:33:17.940174 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940162 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:33:17.940174 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940166 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:33:17.940174 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940170 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:33:17.940174 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940174 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:33:17.940174 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940178 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:33:17.940174 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940182 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940187 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940191 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940195 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940201 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940205 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940209 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940214 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940219 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940223 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940246 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940252 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940256 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940260 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940265 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940270 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940273 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940277 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940281 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940286 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:33:17.940739 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940290 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940294 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940299 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940303 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940307 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940323 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940331 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940337 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940341 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940346 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940350 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940355 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940359 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940364 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940369 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940374 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940379 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940383 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940387 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940392 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:33:17.941692 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940396 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940401 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940405 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940410 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940414 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940419 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940423 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940427 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940432 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940436 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940441 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940445 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940450 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940454 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940459 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940468 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940474 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940479 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940483 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940488 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:33:17.942559 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940492 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940497 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940501 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940505 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940510 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940514 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940520 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940525 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940529 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940533 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940538 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940542 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940546 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940550 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940555 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.940560 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941740 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941751 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941756 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941760 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:33:17.943425 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941764 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941769 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941773 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941778 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941782 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941786 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941790 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941794 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941799 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941806 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941813 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941818 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941823 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941827 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941832 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941836 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941841 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941845 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941852 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:33:17.944300 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941857 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941861 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941867 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941872 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941877 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941881 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941886 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941891 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941895 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941900 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941904 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941911 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941917 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941923 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941927 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941931 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941936 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941941 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941945 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941949 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:33:17.945040 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941954 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941958 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941962 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941966 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941970 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941976 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941980 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941985 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941989 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941993 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.941997 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942002 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942006 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942011 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942015 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942020 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942025 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942029 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942033 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942046 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:33:17.945583 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942050 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942055 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942059 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942063 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942068 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942072 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942077 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942081 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942085 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942089 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942093 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942097 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942101 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942106 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942111 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942115 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942119 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942124 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942128 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942134 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:33:17.946158 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942138 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942142 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942147 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942152 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942156 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942161 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942167 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942172 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942177 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942181 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942186 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942190 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942194 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942199 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942203 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942207 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942828 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942837 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942842 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:33:17.946883 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942847 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942852 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942856 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942861 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942865 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942870 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942874 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942879 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942883 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942888 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942892 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942897 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942901 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942905 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942910 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942914 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942919 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942923 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942927 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942931 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:33:17.947368 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942936 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942941 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942945 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942949 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942953 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942958 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942962 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942969 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942975 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942979 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942984 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942988 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942992 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.942996 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943002 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943006 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943010 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943015 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943019 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:33:17.947968 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943026 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943030 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943035 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943039 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943044 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943048 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943052 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943056 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943060 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943065 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943069 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943073 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943077 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943082 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943086 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943091 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943095 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943100 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943104 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:33:17.948459 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943108 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943112 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943116 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943120 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943124 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943129 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943133 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943137 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943141 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943146 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943150 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943154 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943158 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943164 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943168 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943172 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943176 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943180 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943185 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943189 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:33:17.948925 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943193 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943197 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943205 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943210 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943216 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943220 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943241 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943246 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943251 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943256 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943260 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943267 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943273 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943278 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943282 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943287 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943292 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.943297 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943402 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943417 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943427 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 19:33:17.949436 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943433 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943439 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943444 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943450 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943457 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943463 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943468 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943473 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943479 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943484 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943489 2579 flags.go:64] FLAG: --cgroup-root="" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943494 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943499 2579 flags.go:64] FLAG: --client-ca-file="" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943505 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943511 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943517 2579 flags.go:64] FLAG: --cluster-domain="" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943521 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943526 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943531 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943537 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943543 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943549 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943554 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 19:33:17.949947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943560 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943565 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943570 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943575 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943580 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943585 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943591 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943596 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943601 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943606 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943611 2579 flags.go:64] FLAG: --enable-server="true" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943615 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943623 2579 flags.go:64] FLAG: --event-burst="100" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943628 2579 flags.go:64] FLAG: --event-qps="50" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943633 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943638 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943643 2579 flags.go:64] FLAG: --eviction-hard="" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943649 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943654 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943658 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943664 2579 flags.go:64] FLAG: --eviction-soft="" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943668 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943675 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943680 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943686 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 19:33:17.950516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943690 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943695 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943699 2579 flags.go:64] FLAG: --feature-gates="" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943705 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943710 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943715 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943722 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943727 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943731 2579 flags.go:64] FLAG: --help="false" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943736 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-131-230.ec2.internal" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943741 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943745 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943750 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943756 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943762 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943766 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943771 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943775 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943780 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943784 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943790 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943796 2579 flags.go:64] FLAG: --kube-reserved="" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943801 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943806 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 19:33:17.951269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943811 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943815 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943820 2579 flags.go:64] FLAG: --lock-file="" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943824 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943829 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943837 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943846 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943851 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943856 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943860 2579 flags.go:64] FLAG: --logging-format="text" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943865 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943870 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943875 2579 flags.go:64] FLAG: --manifest-url="" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943879 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943886 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943892 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943898 2579 flags.go:64] FLAG: --max-pods="110" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943903 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943908 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943912 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943917 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943924 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943929 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943934 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943945 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 19:33:17.951891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943949 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943955 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943960 2579 flags.go:64] FLAG: --pod-cidr="" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943964 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943972 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943977 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943982 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943987 2579 flags.go:64] FLAG: --port="10250" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943992 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.943996 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d83c65a67885bde1" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944003 2579 flags.go:64] FLAG: --qos-reserved="" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944008 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944013 2579 flags.go:64] FLAG: --register-node="true" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944020 2579 flags.go:64] FLAG: --register-with-taints="" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944029 2579 flags.go:64] FLAG: --registry-burst="10" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944034 2579 flags.go:64] FLAG: --registry-qps="5" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944039 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944043 2579 flags.go:64] FLAG: --reserved-memory="" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944049 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944054 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944059 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944064 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944069 2579 flags.go:64] FLAG: --runonce="false" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944074 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944079 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 19:33:17.952524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944084 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944089 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944094 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944100 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944105 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944110 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944115 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944120 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944125 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944129 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944134 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944139 2579 flags.go:64] FLAG: --system-cgroups="" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944144 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944153 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944157 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944162 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944168 2579 flags.go:64] FLAG: --tls-min-version="" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944172 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944177 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944181 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944189 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944193 2579 flags.go:64] FLAG: --v="2" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944199 2579 flags.go:64] FLAG: --version="false" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944206 2579 flags.go:64] FLAG: --vmodule="" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944212 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 19:33:17.953134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.944218 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944438 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944447 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944452 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944458 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944463 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944468 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944474 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944480 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944484 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944491 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944495 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944500 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944505 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944509 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944513 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944517 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944521 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944526 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:33:17.953853 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944532 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944539 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944545 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944550 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944554 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944558 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944563 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944567 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944573 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944578 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944583 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944587 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944592 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944596 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944601 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944606 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944610 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944615 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944619 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944623 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:33:17.954352 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944629 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944633 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944638 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944643 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944647 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944652 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944656 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944661 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944665 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944669 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944674 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944678 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944683 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944688 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944692 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944696 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944700 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944704 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944708 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944713 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:33:17.954843 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944718 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944723 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944727 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944731 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944735 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944739 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944744 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944748 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944752 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944756 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944760 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944764 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944768 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944774 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944778 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944784 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944788 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944792 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944796 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944800 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:33:17.955347 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944805 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944809 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944813 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944817 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944821 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944826 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944830 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944835 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944839 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944844 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944848 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944852 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944856 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944861 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944865 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944869 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944873 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944877 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944882 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944886 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:33:17.955825 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.944890 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.945520 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.952569 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.952588 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.953344 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.953352 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953409 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953415 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953418 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953421 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953424 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953427 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953430 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953432 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:33:17.956330 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953435 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953438 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953441 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953443 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953446 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953449 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953452 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953455 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953457 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953460 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953463 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953466 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953469 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953471 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953474 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953477 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953479 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953482 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953485 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953487 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:33:17.956684 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953490 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953494 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953497 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953500 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953502 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953505 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953508 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953510 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953513 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953516 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953519 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953521 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953524 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953526 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953529 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953532 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953535 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953537 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953540 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:33:17.957160 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953543 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953545 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953548 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953551 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953554 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953556 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953559 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953562 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953564 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953567 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953570 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953572 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953575 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953577 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953581 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953584 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953587 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953590 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953593 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953596 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:33:17.957639 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953598 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953601 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953603 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953606 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953609 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953611 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953614 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953616 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953619 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953623 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953626 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953629 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953633 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953636 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953638 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953642 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953646 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953650 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953653 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:33:17.958145 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953655 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953658 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953661 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953663 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953666 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953669 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953672 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953675 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953678 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953681 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953685 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953689 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953692 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.953697 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953829 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:33:17.958633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953833 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953837 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953839 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953843 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953847 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953849 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953853 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953856 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953859 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953862 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953864 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953867 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953870 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953873 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953875 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953878 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953881 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953884 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953887 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953890 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:33:17.959041 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953892 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953895 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953898 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953901 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953904 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953906 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953909 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953912 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953915 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953917 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953920 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953922 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953925 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953928 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953930 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953933 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953935 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953938 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953940 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:33:17.959542 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953943 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953946 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953948 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953951 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953954 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953956 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953959 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953962 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953966 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953970 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953972 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953975 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953978 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953980 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953983 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953986 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953988 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953993 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.953996 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:33:17.959995 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954000 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954002 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954006 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954008 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954011 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954014 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954017 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954020 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954023 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954025 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954028 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954031 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954033 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954044 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954048 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954051 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954054 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954057 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954059 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954062 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:33:17.960514 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954065 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954068 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954070 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954073 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954076 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954078 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954081 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954084 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954086 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954089 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954092 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954094 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954097 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954100 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954103 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954106 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954109 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954111 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954114 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:33:17.961022 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:17.954117 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:33:17.961616 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.954121 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:33:17.961616 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.954253 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 19:33:17.961616 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.958523 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 19:33:17.961616 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.960002 2579 server.go:1019] "Starting client certificate rotation" Jun 08 19:33:17.961616 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.960104 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 19:33:17.961616 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.960142 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 19:33:17.962703 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.962689 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 19:33:17.966887 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.966870 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 19:33:17.977515 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.977495 2579 log.go:25] "Validated CRI v1 runtime API" Jun 08 19:33:17.980300 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.980286 2579 log.go:25] "Validated CRI v1 image API" Jun 08 19:33:17.981701 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.981682 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 19:33:17.984303 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.984285 2579 fs.go:135] Filesystem UUIDs: map[2651ac8e-7af2-46b5-a143-b857af1b5761:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fe6536d1-8582-4627-908e-621454d4ed52:/dev/nvme0n1p3] Jun 08 19:33:17.984365 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.984303 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 19:33:17.985267 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.985250 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 19:33:17.989460 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.989355 2579 manager.go:216] Machine: {Timestamp:2026-06-08 19:33:17.988807655 +0000 UTC m=+0.309980162 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099504 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27662eea107cec9c6b75862e3d75c0 SystemUUID:ec27662e-ea10-7cec-9c6b-75862e3d75c0 BootID:45ad4169-7cc5-44e7-8bb6-ccc3634e8a62 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f2:db:f2:f8:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f2:db:f2:f8:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:69:07:52:ee:b5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 19:33:17.989460 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.989454 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 19:33:17.989573 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.989561 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 19:33:17.992624 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.992595 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 19:33:17.992757 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.992627 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-230.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 19:33:17.993899 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.993889 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 19:33:17.993931 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.993901 2579 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 19:33:17.993931 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.993908 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 19:33:17.994532 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.994521 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 19:33:17.995598 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.995589 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 19:33:17.998860 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.998849 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 08 19:33:17.998991 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.998981 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 19:33:17.999019 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.999013 2579 kubelet.go:486] "Attempting to sync node with API server" Jun 08 19:33:17.999049 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.999027 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 19:33:17.999049 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.999045 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 19:33:17.999107 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.999061 2579 kubelet.go:398] "Adding apiserver pod source" Jun 08 19:33:17.999107 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.999081 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 19:33:17.999524 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.999510 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 19:33:17.999588 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:17.999537 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 19:33:18.001405 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.001390 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 19:33:18.003509 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.003496 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 19:33:18.003562 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.003526 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 19:33:18.004900 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.004890 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 19:33:18.004943 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.004905 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 19:33:18.004943 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.004910 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 19:33:18.004943 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.004917 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 19:33:18.004943 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.004927 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 19:33:18.004943 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.004932 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 19:33:18.004943 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.004941 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 19:33:18.004943 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.004947 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 19:33:18.005202 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.004954 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 19:33:18.005202 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.004959 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 19:33:18.005202 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.004973 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 19:33:18.005202 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.004979 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 19:33:18.005202 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.005002 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 19:33:18.005202 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.005007 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 19:33:18.008117 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.008103 2579 server.go:1268] "Started kubelet" Jun 08 19:33:18.009009 ip-10-0-131-230 systemd[1]: Started Kubernetes Kubelet. Jun 08 19:33:18.011881 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.011613 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 19:33:18.011881 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.011806 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 19:33:18.012034 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.011914 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 19:33:18.014172 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.014151 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 19:33:18.014651 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.014635 2579 server.go:310] "Adding debug handlers to kubelet server" Jun 08 19:33:18.014742 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.014674 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-230.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 19:33:18.014742 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.014626 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 19:33:18.014742 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.014674 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-230.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 19:33:18.015747 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.015728 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 19:33:18.020127 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.019126 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-230.ec2.internal.18b7320a6cff9ae4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-230.ec2.internal,UID:ip-10-0-131-230.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-230.ec2.internal,},FirstTimestamp:2026-06-08 19:33:18.008072932 +0000 UTC m=+0.329245441,LastTimestamp:2026-06-08 19:33:18.008072932 +0000 UTC m=+0.329245441,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-230.ec2.internal,}" Jun 08 19:33:18.020558 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.020537 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 19:33:18.020653 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.020538 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 19:33:18.020808 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.020787 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:18.021222 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.021202 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 19:33:18.021317 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.021244 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 19:33:18.021317 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.021262 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 19:33:18.021424 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.021365 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 08 19:33:18.021424 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.021383 2579 reconciler.go:29] "Reconciler: start to sync state" Jun 08 19:33:18.022284 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.022265 2579 factory.go:55] Registering systemd factory Jun 08 19:33:18.022284 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.022284 2579 factory.go:223] Registration of the systemd container factory successfully Jun 08 19:33:18.022544 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.022526 2579 factory.go:153] Registering CRI-O factory Jun 08 19:33:18.022544 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.022546 2579 factory.go:223] Registration of the crio container factory successfully Jun 08 19:33:18.022671 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.022635 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 19:33:18.022671 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.022661 2579 factory.go:103] Registering Raw factory Jun 08 19:33:18.022769 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.022676 2579 manager.go:1196] Started watching for new ooms in manager Jun 08 19:33:18.023052 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.023038 2579 manager.go:349] Starting recovery of all containers Jun 08 19:33:18.025973 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.025945 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-230.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 19:33:18.026064 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.025975 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 19:33:18.032683 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.032658 2579 manager.go:354] Recovery completed Jun 08 19:33:18.037641 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.037626 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:18.039623 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.039603 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:18.039693 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.039636 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:18.039693 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.039647 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:18.040022 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.040001 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cf7hv" Jun 08 19:33:18.040184 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.040171 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 19:33:18.040237 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.040186 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 19:33:18.040237 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.040186 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:18.040237 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.040203 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 08 19:33:18.040911 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.040896 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:18.040977 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.040922 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:18.040977 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.040935 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:18.041342 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.041330 2579 policy_none.go:49] "None policy: Start" Jun 08 19:33:18.041383 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.041347 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 19:33:18.041383 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.041358 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 19:33:18.041697 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.041628 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-230.ec2.internal.18b7320a6ee10549 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-230.ec2.internal,UID:ip-10-0-131-230.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-230.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-230.ec2.internal,},FirstTimestamp:2026-06-08 19:33:18.039622985 +0000 UTC m=+0.360795496,LastTimestamp:2026-06-08 19:33:18.039622985 +0000 UTC m=+0.360795496,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-230.ec2.internal,}" Jun 08 19:33:18.042300 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.042289 2579 policy_none.go:47] "Start" Jun 08 19:33:18.047130 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.047115 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cf7hv" Jun 08 19:33:18.077823 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.077801 2579 manager.go:337] "Starting Device Plugin manager" Jun 08 19:33:18.085601 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.077850 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 19:33:18.085601 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.077865 2579 server.go:87] "Starting device plugin registration server" Jun 08 19:33:18.085601 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.078129 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 19:33:18.085601 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.078142 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 19:33:18.085601 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.078317 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 19:33:18.085601 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.078440 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 19:33:18.085601 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.078450 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 19:33:18.085601 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.078858 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 19:33:18.085601 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.078911 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:18.088173 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.088152 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 19:33:18.089368 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.089348 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 19:33:18.089424 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.089395 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 19:33:18.089424 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.089419 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 19:33:18.089497 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.089457 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 19:33:18.090880 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.090857 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:33:18.178467 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.178437 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:18.181662 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.181646 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:18.181732 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.181676 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:18.181732 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.181687 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:18.181732 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.181715 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.189536 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.189521 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal"] Jun 08 19:33:18.189608 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.189599 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:18.190413 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.190390 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:18.190520 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.190422 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:18.190520 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.190432 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:18.191661 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.191649 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:18.191781 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.191761 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.191837 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.191801 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:18.191936 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.191923 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.191971 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.191943 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-230.ec2.internal\": node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:18.192407 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.192393 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:18.192503 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.192408 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:18.192503 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.192417 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:18.192503 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.192428 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:18.192503 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.192430 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:18.192503 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.192438 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:18.193741 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.193725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.193820 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.193753 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:18.194448 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.194435 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:18.194538 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.194462 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:18.194538 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.194475 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:18.217418 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.217399 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:18.220572 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.220557 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-230.ec2.internal\" not found" node="ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.222477 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.222462 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/16c4b44f87ee90e27d9e620eb6227309-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal\" (UID: \"16c4b44f87ee90e27d9e620eb6227309\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.222545 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.222486 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16c4b44f87ee90e27d9e620eb6227309-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal\" (UID: \"16c4b44f87ee90e27d9e620eb6227309\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.222545 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.222503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fefb8afd1c16382fd0349c5eb50136cd-config\") pod \"kube-apiserver-proxy-ip-10-0-131-230.ec2.internal\" (UID: \"fefb8afd1c16382fd0349c5eb50136cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.224880 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.224866 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-230.ec2.internal\" not found" node="ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.318049 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.317997 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:18.323402 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.323382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fefb8afd1c16382fd0349c5eb50136cd-config\") pod \"kube-apiserver-proxy-ip-10-0-131-230.ec2.internal\" (UID: \"fefb8afd1c16382fd0349c5eb50136cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.323485 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.323403 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fefb8afd1c16382fd0349c5eb50136cd-config\") pod \"kube-apiserver-proxy-ip-10-0-131-230.ec2.internal\" (UID: \"fefb8afd1c16382fd0349c5eb50136cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.323485 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.323420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/16c4b44f87ee90e27d9e620eb6227309-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal\" (UID: \"16c4b44f87ee90e27d9e620eb6227309\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.323485 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.323455 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/16c4b44f87ee90e27d9e620eb6227309-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal\" (UID: \"16c4b44f87ee90e27d9e620eb6227309\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.323485 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.323472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16c4b44f87ee90e27d9e620eb6227309-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal\" (UID: \"16c4b44f87ee90e27d9e620eb6227309\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.323485 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.323476 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16c4b44f87ee90e27d9e620eb6227309-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal\" (UID: \"16c4b44f87ee90e27d9e620eb6227309\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.418582 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.418536 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:18.519350 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.519281 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:18.525627 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.525607 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.530275 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.530261 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal" Jun 08 19:33:18.620349 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.620308 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:18.720809 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.720774 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:18.821317 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.821217 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:18.921776 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:18.921744 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:18.959073 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.959043 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 19:33:18.960009 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:18.959202 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 19:33:19.021841 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:19.021811 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:19.027690 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:19.027663 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c4b44f87ee90e27d9e620eb6227309.slice/crio-a35c27e77f445543080fcb5d80560b88f666a0a1c0606ba403f41b6720687217 WatchSource:0}: Error finding container a35c27e77f445543080fcb5d80560b88f666a0a1c0606ba403f41b6720687217: Status 404 returned error can't find the container with id a35c27e77f445543080fcb5d80560b88f666a0a1c0606ba403f41b6720687217 Jun 08 19:33:19.027866 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:19.027854 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfefb8afd1c16382fd0349c5eb50136cd.slice/crio-be43f4b7498d580cc5573573f841c93e4a637ad4da50d561dd48ec28a2713c74 WatchSource:0}: Error finding container be43f4b7498d580cc5573573f841c93e4a637ad4da50d561dd48ec28a2713c74: Status 404 returned error can't find the container with id be43f4b7498d580cc5573573f841c93e4a637ad4da50d561dd48ec28a2713c74 Jun 08 19:33:19.032206 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:19.032190 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:33:19.049442 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:19.049412 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 19:28:18 +0000 UTC" deadline="2028-02-24 06:36:33.92545873 +0000 UTC" Jun 08 19:33:19.049520 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:19.049437 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15011h3m14.876024857s" Jun 08 19:33:19.072268 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:19.072212 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:33:19.092449 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:19.092403 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal" event={"ID":"fefb8afd1c16382fd0349c5eb50136cd","Type":"ContainerStarted","Data":"be43f4b7498d580cc5573573f841c93e4a637ad4da50d561dd48ec28a2713c74"} Jun 08 19:33:19.093402 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:19.093381 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" event={"ID":"16c4b44f87ee90e27d9e620eb6227309","Type":"ContainerStarted","Data":"a35c27e77f445543080fcb5d80560b88f666a0a1c0606ba403f41b6720687217"} Jun 08 19:33:19.122634 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:19.122613 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:19.223141 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:19.223115 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:19.323675 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:19.323594 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-230.ec2.internal\" not found" Jun 08 19:33:19.387305 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:19.387263 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:33:19.421124 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:19.421096 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:33:19.521669 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:19.521623 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" Jun 08 19:33:19.534570 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:19.534542 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 19:33:19.535604 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:19.535580 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal" Jun 08 19:33:19.544958 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:19.544927 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 19:33:20.000083 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.000039 2579 apiserver.go:52] "Watching apiserver" Jun 08 19:33:20.010323 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.010290 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 19:33:20.010746 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.010713 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nxg8x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp","openshift-dns/node-resolver-k5ngh","openshift-multus/multus-additional-cni-plugins-gqx95","openshift-multus/multus-m7bf7","openshift-multus/network-metrics-daemon-n6d4n","openshift-network-diagnostics/network-check-target-8rxxd","openshift-ovn-kubernetes/ovnkube-node-gj6rg","kube-system/konnectivity-agent-7pt67","kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7bc6g","openshift-image-registry/node-ca-wgpqd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal","openshift-network-operator/iptables-alerter-zdtwz"] Jun 08 19:33:20.012625 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.012598 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:20.012734 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.012700 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:20.013586 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.013564 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.014973 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.014892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k5ngh" Jun 08 19:33:20.016314 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.016204 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-24wc6\"" Jun 08 19:33:20.016314 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.016264 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:33:20.016487 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.016264 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 19:33:20.016487 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.016386 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.017360 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.017260 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 19:33:20.017360 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.017274 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ff8nd\"" Jun 08 19:33:20.017602 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.017584 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 19:33:20.017839 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.017815 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.018766 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.018747 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 19:33:20.018860 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.018805 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 19:33:20.019005 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.018986 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 19:33:20.019066 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.019027 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 19:33:20.019267 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.019250 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k4jh4\"" Jun 08 19:33:20.019337 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.019257 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 19:33:20.019529 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.019437 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:20.019529 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.019500 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:20.019939 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.019894 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 19:33:20.020432 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.020277 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4vfgj\"" Jun 08 19:33:20.021141 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.021123 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7pt67" Jun 08 19:33:20.022624 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.021675 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 19:33:20.023076 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.023054 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zdtwz" Jun 08 19:33:20.023671 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.023576 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 19:33:20.026986 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.024047 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xrwbk\"" Jun 08 19:33:20.026986 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.024247 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 19:33:20.026986 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.025317 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:33:20.026986 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.025585 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zj2ns\"" Jun 08 19:33:20.026986 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.025670 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 19:33:20.026986 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.025587 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 19:33:20.028019 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.027998 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.030987 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.030544 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.031483 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.031463 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 19:33:20.031747 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.031723 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38b5552c-7a48-49e6-aa7d-ab0227399875-cni-binary-copy\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.031831 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.031762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-multus-conf-dir\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.031831 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.031786 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-systemd\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.031831 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.031810 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-host\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.032007 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.031833 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c05ff177-e1c7-44e3-9e62-548a84922331-etc-tuned\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.032007 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.031607 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 19:33:20.032007 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.031867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee34602e-4af8-4158-bf0c-7243bdc592d6-os-release\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.032007 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.031893 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee34602e-4af8-4158-bf0c-7243bdc592d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.032007 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.031647 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 19:33:20.032007 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.031638 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5794g\"" Jun 08 19:33:20.032007 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.031917 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-system-cni-dir\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.032351 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-cnibin\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.032351 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-multus-socket-dir-parent\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.032351 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-var-lib-kubelet\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.032351 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032172 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m69fg\" (UniqueName: \"kubernetes.io/projected/2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c-kube-api-access-m69fg\") pod \"node-resolver-k5ngh\" (UID: \"2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c\") " pod="openshift-dns/node-resolver-k5ngh" Jun 08 19:33:20.032351 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-multus-cni-dir\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.032351 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032249 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-hostroot\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.032351 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvjrf\" (UniqueName: \"kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf\") pod \"network-check-target-8rxxd\" (UID: \"cad3851a-c674-4a01-9118-aa40c13d59d7\") " pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:20.032351 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032297 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86c21eb5-0ae6-4d16-94dc-ba72a5293c17-iptables-alerter-script\") pod \"iptables-alerter-zdtwz\" (UID: \"86c21eb5-0ae6-4d16-94dc-ba72a5293c17\") " pod="openshift-network-operator/iptables-alerter-zdtwz" Jun 08 19:33:20.032351 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032318 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-sysctl-conf\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.032351 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee34602e-4af8-4158-bf0c-7243bdc592d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee34602e-4af8-4158-bf0c-7243bdc592d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032404 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032440 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86c21eb5-0ae6-4d16-94dc-ba72a5293c17-host-slash\") pod \"iptables-alerter-zdtwz\" (UID: \"86c21eb5-0ae6-4d16-94dc-ba72a5293c17\") " pod="openshift-network-operator/iptables-alerter-zdtwz" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-sysconfig\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032492 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-kubernetes\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-sys\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032537 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-lib-modules\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjbk2\" (UniqueName: \"kubernetes.io/projected/c05ff177-e1c7-44e3-9e62-548a84922331-kube-api-access-pjbk2\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032583 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee34602e-4af8-4158-bf0c-7243bdc592d6-system-cni-dir\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032641 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-os-release\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032668 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-var-lib-cni-bin\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-var-lib-kubelet\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpk6n\" (UniqueName: \"kubernetes.io/projected/38b5552c-7a48-49e6-aa7d-ab0227399875-kube-api-access-bpk6n\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032780 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg8t2\" (UniqueName: \"kubernetes.io/projected/7bb7542c-5411-4674-ae66-49f2a63958c0-kube-api-access-rg8t2\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032817 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-modprobe-d\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.032856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-sysctl-d\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032860 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-var-lib-cni-multus\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032885 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e504f78f-6fd2-4d1f-b356-000b5e9222e7-agent-certs\") pod \"konnectivity-agent-7pt67\" (UID: \"e504f78f-6fd2-4d1f-b356-000b5e9222e7\") " pod="kube-system/konnectivity-agent-7pt67" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032905 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e504f78f-6fd2-4d1f-b356-000b5e9222e7-konnectivity-ca\") pod \"konnectivity-agent-7pt67\" (UID: \"e504f78f-6fd2-4d1f-b356-000b5e9222e7\") " pod="kube-system/konnectivity-agent-7pt67" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032942 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-run-k8s-cni-cncf-io\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38b5552c-7a48-49e6-aa7d-ab0227399875-multus-daemon-config\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.032991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxrqm\" (UniqueName: \"kubernetes.io/projected/86c21eb5-0ae6-4d16-94dc-ba72a5293c17-kube-api-access-sxrqm\") pod \"iptables-alerter-zdtwz\" (UID: \"86c21eb5-0ae6-4d16-94dc-ba72a5293c17\") " pod="openshift-network-operator/iptables-alerter-zdtwz" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.033012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-run\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.033046 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c-hosts-file\") pod \"node-resolver-k5ngh\" (UID: \"2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c\") " pod="openshift-dns/node-resolver-k5ngh" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.033082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee34602e-4af8-4158-bf0c-7243bdc592d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.033124 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkv5b\" (UniqueName: \"kubernetes.io/projected/ee34602e-4af8-4158-bf0c-7243bdc592d6-kube-api-access-lkv5b\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.033148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-run-netns\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.033170 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-run-multus-certs\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.033193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-etc-kubernetes\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.033214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c05ff177-e1c7-44e3-9e62-548a84922331-tmp\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.033263 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c-tmp-dir\") pod \"node-resolver-k5ngh\" (UID: \"2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c\") " pod="openshift-dns/node-resolver-k5ngh" Jun 08 19:33:20.033645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.033285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee34602e-4af8-4158-bf0c-7243bdc592d6-cnibin\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.034380 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.033984 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 19:33:20.034380 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.034292 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 19:33:20.034586 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.034532 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mp8cj\"" Jun 08 19:33:20.034653 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.034592 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 19:33:20.034774 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.034758 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 19:33:20.034948 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.034929 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:20.035014 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.034982 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 19:33:20.035014 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.034999 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:20.036170 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.036131 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgpqd" Jun 08 19:33:20.036821 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.036578 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 19:33:20.038521 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.038501 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 19:33:20.038609 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.038575 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 19:33:20.038904 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.038739 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 19:33:20.038904 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.038773 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5bthk\"" Jun 08 19:33:20.054447 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.054418 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v48rd" Jun 08 19:33:20.057487 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.057468 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:33:20.063117 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.062740 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v48rd" Jun 08 19:33:20.122854 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.122828 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 19:33:20.134008 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.133983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee34602e-4af8-4158-bf0c-7243bdc592d6-cnibin\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.134170 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-etc-openvswitch\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.134170 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134053 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-cni-bin\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.134170 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-multus-conf-dir\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.134170 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-host\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.134170 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134114 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee34602e-4af8-4158-bf0c-7243bdc592d6-cnibin\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.134170 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c05ff177-e1c7-44e3-9e62-548a84922331-etc-tuned\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.134170 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-dbus\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134182 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-multus-conf-dir\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-registration-dir\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt858\" (UniqueName: \"kubernetes.io/projected/5c3d018d-c654-4567-a7fa-7917402cb1dd-kube-api-access-vt858\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-system-cni-dir\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134273 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-cnibin\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-multus-socket-dir-parent\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m69fg\" (UniqueName: \"kubernetes.io/projected/2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c-kube-api-access-m69fg\") pod \"node-resolver-k5ngh\" (UID: \"2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c\") " pod="openshift-dns/node-resolver-k5ngh" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d241132c-eb3a-4381-8b55-ebec819c514f-env-overrides\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134412 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134417 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-host\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-hostroot\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-sysctl-conf\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.134500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee34602e-4af8-4158-bf0c-7243bdc592d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.135105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134506 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-cnibin\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.135105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134517 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-sys-fs\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.135105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134521 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 19:33:20.135105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134603 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-multus-socket-dir-parent\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.135105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134663 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-hostroot\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.135105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134778 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-sysctl-conf\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.135105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134962 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee34602e-4af8-4158-bf0c-7243bdc592d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.135105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.134545 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee34602e-4af8-4158-bf0c-7243bdc592d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.135105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135044 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-system-cni-dir\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.135105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135060 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkv5b\" (UniqueName: \"kubernetes.io/projected/ee34602e-4af8-4158-bf0c-7243bdc592d6-kube-api-access-lkv5b\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.135105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:20.135623 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-sys\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.135623 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjbk2\" (UniqueName: \"kubernetes.io/projected/c05ff177-e1c7-44e3-9e62-548a84922331-kube-api-access-pjbk2\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.135623 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.135190 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:20.135623 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-os-release\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.135623 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.135301 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs podName:7bb7542c-5411-4674-ae66-49f2a63958c0 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:20.635268592 +0000 UTC m=+2.956441119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs") pod "network-metrics-daemon-n6d4n" (UID: "7bb7542c-5411-4674-ae66-49f2a63958c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:20.135623 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135366 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee34602e-4af8-4158-bf0c-7243bdc592d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.135623 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135451 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-sys\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.135623 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135477 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-os-release\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.135623 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-var-lib-cni-bin\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.135623 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135620 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-var-lib-kubelet\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135642 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpk6n\" (UniqueName: \"kubernetes.io/projected/38b5552c-7a48-49e6-aa7d-ab0227399875-kube-api-access-bpk6n\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8t2\" (UniqueName: \"kubernetes.io/projected/7bb7542c-5411-4674-ae66-49f2a63958c0-kube-api-access-rg8t2\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135669 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-var-lib-cni-bin\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-modprobe-d\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135695 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-var-lib-kubelet\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-sysctl-d\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-var-lib-cni-multus\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135796 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-modprobe-d\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e504f78f-6fd2-4d1f-b356-000b5e9222e7-agent-certs\") pod \"konnectivity-agent-7pt67\" (UID: \"e504f78f-6fd2-4d1f-b356-000b5e9222e7\") " pod="kube-system/konnectivity-agent-7pt67" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135839 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e504f78f-6fd2-4d1f-b356-000b5e9222e7-konnectivity-ca\") pod \"konnectivity-agent-7pt67\" (UID: \"e504f78f-6fd2-4d1f-b356-000b5e9222e7\") " pod="kube-system/konnectivity-agent-7pt67" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38b5552c-7a48-49e6-aa7d-ab0227399875-multus-daemon-config\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135875 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-run\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c-hosts-file\") pod \"node-resolver-k5ngh\" (UID: \"2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c\") " pod="openshift-dns/node-resolver-k5ngh" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d241132c-eb3a-4381-8b55-ebec819c514f-ovnkube-config\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135920 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frlv8\" (UniqueName: \"kubernetes.io/projected/d241132c-eb3a-4381-8b55-ebec819c514f-kube-api-access-frlv8\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.136070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135926 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-sysctl-d\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-run-netns\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.135996 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-var-lib-cni-multus\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136013 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-run\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136053 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c-hosts-file\") pod \"node-resolver-k5ngh\" (UID: \"2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c\") " pod="openshift-dns/node-resolver-k5ngh" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136098 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-run-netns\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-run-multus-certs\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-etc-kubernetes\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-kubelet\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136215 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-run-ovn\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-cni-netd\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38b5552c-7a48-49e6-aa7d-ab0227399875-cni-binary-copy\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136304 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-systemd\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee34602e-4af8-4158-bf0c-7243bdc592d6-os-release\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136359 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-etc-kubernetes\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee34602e-4af8-4158-bf0c-7243bdc592d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136405 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-slash\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.136930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136430 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-var-lib-openvswitch\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136456 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d241132c-eb3a-4381-8b55-ebec819c514f-ovnkube-script-lib\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-var-lib-kubelet\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-run-systemd\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136530 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-socket-dir\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136547 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38b5552c-7a48-49e6-aa7d-ab0227399875-multus-daemon-config\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136570 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e504f78f-6fd2-4d1f-b356-000b5e9222e7-konnectivity-ca\") pod \"konnectivity-agent-7pt67\" (UID: \"e504f78f-6fd2-4d1f-b356-000b5e9222e7\") " pod="kube-system/konnectivity-agent-7pt67" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-systemd-units\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-multus-cni-dir\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136330 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-run-multus-certs\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvjrf\" (UniqueName: \"kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf\") pod \"network-check-target-8rxxd\" (UID: \"cad3851a-c674-4a01-9118-aa40c13d59d7\") " pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136664 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-systemd\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86c21eb5-0ae6-4d16-94dc-ba72a5293c17-iptables-alerter-script\") pod \"iptables-alerter-zdtwz\" (UID: \"86c21eb5-0ae6-4d16-94dc-ba72a5293c17\") " pod="openshift-network-operator/iptables-alerter-zdtwz" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136676 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee34602e-4af8-4158-bf0c-7243bdc592d6-os-release\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee34602e-4af8-4158-bf0c-7243bdc592d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136731 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-run-netns\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136736 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-multus-cni-dir\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.137723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-run-ovn-kubernetes\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136783 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86c21eb5-0ae6-4d16-94dc-ba72a5293c17-host-slash\") pod \"iptables-alerter-zdtwz\" (UID: \"86c21eb5-0ae6-4d16-94dc-ba72a5293c17\") " pod="openshift-network-operator/iptables-alerter-zdtwz" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-sysconfig\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee34602e-4af8-4158-bf0c-7243bdc592d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136861 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-kubernetes\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-lib-modules\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee34602e-4af8-4158-bf0c-7243bdc592d6-system-cni-dir\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136926 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86c21eb5-0ae6-4d16-94dc-ba72a5293c17-host-slash\") pod \"iptables-alerter-zdtwz\" (UID: \"86c21eb5-0ae6-4d16-94dc-ba72a5293c17\") " pod="openshift-network-operator/iptables-alerter-zdtwz" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-run-openvswitch\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136928 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-sysconfig\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-node-log\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136981 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-etc-kubernetes\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136993 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee34602e-4af8-4158-bf0c-7243bdc592d6-system-cni-dir\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136884 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-var-lib-kubelet\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.136989 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-log-socket\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137063 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c05ff177-e1c7-44e3-9e62-548a84922331-lib-modules\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.138539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d241132c-eb3a-4381-8b55-ebec819c514f-ovn-node-metrics-cert\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed47d3ee-170c-42a6-913f-b808115fe16b-serviceca\") pod \"node-ca-wgpqd\" (UID: \"ed47d3ee-170c-42a6-913f-b808115fe16b\") " pod="openshift-image-registry/node-ca-wgpqd" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137134 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-kubelet-config\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137176 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86c21eb5-0ae6-4d16-94dc-ba72a5293c17-iptables-alerter-script\") pod \"iptables-alerter-zdtwz\" (UID: \"86c21eb5-0ae6-4d16-94dc-ba72a5293c17\") " pod="openshift-network-operator/iptables-alerter-zdtwz" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137212 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee34602e-4af8-4158-bf0c-7243bdc592d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed47d3ee-170c-42a6-913f-b808115fe16b-host\") pod \"node-ca-wgpqd\" (UID: \"ed47d3ee-170c-42a6-913f-b808115fe16b\") " pod="openshift-image-registry/node-ca-wgpqd" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137288 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft55d\" (UniqueName: \"kubernetes.io/projected/ed47d3ee-170c-42a6-913f-b808115fe16b-kube-api-access-ft55d\") pod \"node-ca-wgpqd\" (UID: \"ed47d3ee-170c-42a6-913f-b808115fe16b\") " pod="openshift-image-registry/node-ca-wgpqd" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137328 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-device-dir\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137351 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-run-k8s-cni-cncf-io\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxrqm\" (UniqueName: \"kubernetes.io/projected/86c21eb5-0ae6-4d16-94dc-ba72a5293c17-kube-api-access-sxrqm\") pod \"iptables-alerter-zdtwz\" (UID: \"86c21eb5-0ae6-4d16-94dc-ba72a5293c17\") " pod="openshift-network-operator/iptables-alerter-zdtwz" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c05ff177-e1c7-44e3-9e62-548a84922331-tmp\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c-tmp-dir\") pod \"node-resolver-k5ngh\" (UID: \"2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c\") " pod="openshift-dns/node-resolver-k5ngh" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137439 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38b5552c-7a48-49e6-aa7d-ab0227399875-host-run-k8s-cni-cncf-io\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137734 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c-tmp-dir\") pod \"node-resolver-k5ngh\" (UID: \"2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c\") " pod="openshift-dns/node-resolver-k5ngh" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.137988 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c05ff177-e1c7-44e3-9e62-548a84922331-etc-tuned\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.138894 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38b5552c-7a48-49e6-aa7d-ab0227399875-cni-binary-copy\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.139417 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.139078 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e504f78f-6fd2-4d1f-b356-000b5e9222e7-agent-certs\") pod \"konnectivity-agent-7pt67\" (UID: \"e504f78f-6fd2-4d1f-b356-000b5e9222e7\") " pod="kube-system/konnectivity-agent-7pt67" Jun 08 19:33:20.140164 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.139637 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c05ff177-e1c7-44e3-9e62-548a84922331-tmp\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.142563 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.142541 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m69fg\" (UniqueName: \"kubernetes.io/projected/2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c-kube-api-access-m69fg\") pod \"node-resolver-k5ngh\" (UID: \"2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c\") " pod="openshift-dns/node-resolver-k5ngh" Jun 08 19:33:20.144396 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.144373 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkv5b\" (UniqueName: \"kubernetes.io/projected/ee34602e-4af8-4158-bf0c-7243bdc592d6-kube-api-access-lkv5b\") pod \"multus-additional-cni-plugins-gqx95\" (UID: \"ee34602e-4af8-4158-bf0c-7243bdc592d6\") " pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.144631 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.144612 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjbk2\" (UniqueName: \"kubernetes.io/projected/c05ff177-e1c7-44e3-9e62-548a84922331-kube-api-access-pjbk2\") pod \"tuned-7bc6g\" (UID: \"c05ff177-e1c7-44e3-9e62-548a84922331\") " pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.147040 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.147017 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:33:20.147140 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.147049 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:33:20.147140 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.147063 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dvjrf for pod openshift-network-diagnostics/network-check-target-8rxxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:20.147287 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.147141 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf podName:cad3851a-c674-4a01-9118-aa40c13d59d7 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:20.647120774 +0000 UTC m=+2.968293285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dvjrf" (UniqueName: "kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf") pod "network-check-target-8rxxd" (UID: "cad3851a-c674-4a01-9118-aa40c13d59d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:20.147543 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.147525 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpk6n\" (UniqueName: \"kubernetes.io/projected/38b5552c-7a48-49e6-aa7d-ab0227399875-kube-api-access-bpk6n\") pod \"multus-m7bf7\" (UID: \"38b5552c-7a48-49e6-aa7d-ab0227399875\") " pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.149578 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.149554 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg8t2\" (UniqueName: \"kubernetes.io/projected/7bb7542c-5411-4674-ae66-49f2a63958c0-kube-api-access-rg8t2\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:20.155206 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.155180 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxrqm\" (UniqueName: \"kubernetes.io/projected/86c21eb5-0ae6-4d16-94dc-ba72a5293c17-kube-api-access-sxrqm\") pod \"iptables-alerter-zdtwz\" (UID: \"86c21eb5-0ae6-4d16-94dc-ba72a5293c17\") " pod="openshift-network-operator/iptables-alerter-zdtwz" Jun 08 19:33:20.237977 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.237950 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-etc-openvswitch\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.237977 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.237981 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-cni-bin\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.238219 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-dbus\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:20.238219 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238055 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-etc-openvswitch\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.238219 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238069 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-cni-bin\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.238219 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-registration-dir\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.238219 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt858\" (UniqueName: \"kubernetes.io/projected/5c3d018d-c654-4567-a7fa-7917402cb1dd-kube-api-access-vt858\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.238219 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238139 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-dbus\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:20.238219 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238143 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d241132c-eb3a-4381-8b55-ebec819c514f-env-overrides\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.238219 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238191 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-registration-dir\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-sys-fs\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238360 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d241132c-eb3a-4381-8b55-ebec819c514f-ovnkube-config\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.238395 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238414 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238419 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlv8\" (UniqueName: \"kubernetes.io/projected/d241132c-eb3a-4381-8b55-ebec819c514f-kube-api-access-frlv8\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238421 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-sys-fs\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.238456 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret podName:e7189a06-ddfa-4e70-bbe2-9204fde5bccd nodeName:}" failed. No retries permitted until 2026-06-08 19:33:20.738438029 +0000 UTC m=+3.059610536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret") pod "global-pull-secret-syncer-nxg8x" (UID: "e7189a06-ddfa-4e70-bbe2-9204fde5bccd") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238469 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238491 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-kubelet\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-run-ovn\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238539 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-cni-netd\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-slash\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238569 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-run-ovn\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.238612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238551 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-kubelet\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-var-lib-openvswitch\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238611 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-slash\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238617 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-cni-netd\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238624 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-var-lib-openvswitch\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238591 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d241132c-eb3a-4381-8b55-ebec819c514f-env-overrides\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d241132c-eb3a-4381-8b55-ebec819c514f-ovnkube-script-lib\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-run-systemd\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-socket-dir\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238719 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-run-systemd\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-systemd-units\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-run-netns\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238812 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-systemd-units\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-run-ovn-kubernetes\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238839 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-run-netns\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238794 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-socket-dir\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238846 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-run-openvswitch\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-node-log\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238875 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-run-ovn-kubernetes\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238893 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-log-socket\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238910 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-node-log\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238895 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-run-openvswitch\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238940 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-log-socket\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d241132c-eb3a-4381-8b55-ebec819c514f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.238990 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d241132c-eb3a-4381-8b55-ebec819c514f-ovn-node-metrics-cert\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.239017 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d241132c-eb3a-4381-8b55-ebec819c514f-ovnkube-script-lib\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.239019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed47d3ee-170c-42a6-913f-b808115fe16b-serviceca\") pod \"node-ca-wgpqd\" (UID: \"ed47d3ee-170c-42a6-913f-b808115fe16b\") " pod="openshift-image-registry/node-ca-wgpqd" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.239061 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-kubelet-config\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.239076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed47d3ee-170c-42a6-913f-b808115fe16b-host\") pod \"node-ca-wgpqd\" (UID: \"ed47d3ee-170c-42a6-913f-b808115fe16b\") " pod="openshift-image-registry/node-ca-wgpqd" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.239093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft55d\" (UniqueName: \"kubernetes.io/projected/ed47d3ee-170c-42a6-913f-b808115fe16b-kube-api-access-ft55d\") pod \"node-ca-wgpqd\" (UID: \"ed47d3ee-170c-42a6-913f-b808115fe16b\") " pod="openshift-image-registry/node-ca-wgpqd" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.239110 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-device-dir\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.239143 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-kubelet-config\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.239145 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed47d3ee-170c-42a6-913f-b808115fe16b-host\") pod \"node-ca-wgpqd\" (UID: \"ed47d3ee-170c-42a6-913f-b808115fe16b\") " pod="openshift-image-registry/node-ca-wgpqd" Jun 08 19:33:20.239872 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.239215 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c3d018d-c654-4567-a7fa-7917402cb1dd-device-dir\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.240410 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.239432 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed47d3ee-170c-42a6-913f-b808115fe16b-serviceca\") pod \"node-ca-wgpqd\" (UID: \"ed47d3ee-170c-42a6-913f-b808115fe16b\") " pod="openshift-image-registry/node-ca-wgpqd" Jun 08 19:33:20.240410 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.239446 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d241132c-eb3a-4381-8b55-ebec819c514f-ovnkube-config\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.241171 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.241149 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d241132c-eb3a-4381-8b55-ebec819c514f-ovn-node-metrics-cert\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.246861 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.246840 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frlv8\" (UniqueName: \"kubernetes.io/projected/d241132c-eb3a-4381-8b55-ebec819c514f-kube-api-access-frlv8\") pod \"ovnkube-node-gj6rg\" (UID: \"d241132c-eb3a-4381-8b55-ebec819c514f\") " pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.247065 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.247045 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft55d\" (UniqueName: \"kubernetes.io/projected/ed47d3ee-170c-42a6-913f-b808115fe16b-kube-api-access-ft55d\") pod \"node-ca-wgpqd\" (UID: \"ed47d3ee-170c-42a6-913f-b808115fe16b\") " pod="openshift-image-registry/node-ca-wgpqd" Jun 08 19:33:20.247666 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.247640 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt858\" (UniqueName: \"kubernetes.io/projected/5c3d018d-c654-4567-a7fa-7917402cb1dd-kube-api-access-vt858\") pod \"aws-ebs-csi-driver-node-8g6hp\" (UID: \"5c3d018d-c654-4567-a7fa-7917402cb1dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.326772 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.326688 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" Jun 08 19:33:20.335120 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.335097 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k5ngh" Jun 08 19:33:20.344432 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.344410 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gqx95" Jun 08 19:33:20.349123 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.349102 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m7bf7" Jun 08 19:33:20.357862 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.357838 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7pt67" Jun 08 19:33:20.365499 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.365473 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zdtwz" Jun 08 19:33:20.373131 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.373109 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" Jun 08 19:33:20.380792 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.380770 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:20.387535 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.387514 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgpqd" Jun 08 19:33:20.642433 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.642360 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:20.642579 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.642510 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:20.642623 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.642582 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs podName:7bb7542c-5411-4674-ae66-49f2a63958c0 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:21.642564928 +0000 UTC m=+3.963737443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs") pod "network-metrics-daemon-n6d4n" (UID: "7bb7542c-5411-4674-ae66-49f2a63958c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:20.742840 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.742799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvjrf\" (UniqueName: \"kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf\") pod \"network-check-target-8rxxd\" (UID: \"cad3851a-c674-4a01-9118-aa40c13d59d7\") " pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:20.743018 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:20.742866 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:20.743018 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.742972 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:20.743018 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.743002 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:33:20.743149 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.743029 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:33:20.743149 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.743046 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dvjrf for pod openshift-network-diagnostics/network-check-target-8rxxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:20.743149 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.743031 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret podName:e7189a06-ddfa-4e70-bbe2-9204fde5bccd nodeName:}" failed. No retries permitted until 2026-06-08 19:33:21.743016637 +0000 UTC m=+4.064189154 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret") pod "global-pull-secret-syncer-nxg8x" (UID: "e7189a06-ddfa-4e70-bbe2-9204fde5bccd") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:20.743149 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:20.743113 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf podName:cad3851a-c674-4a01-9118-aa40c13d59d7 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:21.743096849 +0000 UTC m=+4.064269350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvjrf" (UniqueName: "kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf") pod "network-check-target-8rxxd" (UID: "cad3851a-c674-4a01-9118-aa40c13d59d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:20.935697 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:20.935480 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9c09fa_ad4e_4e6a_9e87_c5e273b49d0c.slice/crio-4d644e39a1d42519a02263b554276e3da58003c4493b647eb594419c29673bd3 WatchSource:0}: Error finding container 4d644e39a1d42519a02263b554276e3da58003c4493b647eb594419c29673bd3: Status 404 returned error can't find the container with id 4d644e39a1d42519a02263b554276e3da58003c4493b647eb594419c29673bd3 Jun 08 19:33:20.937750 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:20.937646 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode504f78f_6fd2_4d1f_b356_000b5e9222e7.slice/crio-9c69d83ee3ff2f1d6a487fe53f826bc5abcf69acf8ce310aa8907b137b9fe2f4 WatchSource:0}: Error finding container 9c69d83ee3ff2f1d6a487fe53f826bc5abcf69acf8ce310aa8907b137b9fe2f4: Status 404 returned error can't find the container with id 9c69d83ee3ff2f1d6a487fe53f826bc5abcf69acf8ce310aa8907b137b9fe2f4 Jun 08 19:33:20.939894 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:20.939872 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee34602e_4af8_4158_bf0c_7243bdc592d6.slice/crio-85743864500e9e596545e2e22deb71a78c0ebd803aebe4ec3346fb033baadb6f WatchSource:0}: Error finding container 85743864500e9e596545e2e22deb71a78c0ebd803aebe4ec3346fb033baadb6f: Status 404 returned error can't find the container with id 85743864500e9e596545e2e22deb71a78c0ebd803aebe4ec3346fb033baadb6f Jun 08 19:33:20.941088 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:20.941070 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3d018d_c654_4567_a7fa_7917402cb1dd.slice/crio-5b1357676390c48453fd8e17ab0de310d07bc141464919fe3277a55c10867296 WatchSource:0}: Error finding container 5b1357676390c48453fd8e17ab0de310d07bc141464919fe3277a55c10867296: Status 404 returned error can't find the container with id 5b1357676390c48453fd8e17ab0de310d07bc141464919fe3277a55c10867296 Jun 08 19:33:20.942788 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:20.942766 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd241132c_eb3a_4381_8b55_ebec819c514f.slice/crio-d3acd4ba27b2cca5cb5b0c631efad44a41815a59c462c59de1546e3d2e16d513 WatchSource:0}: Error finding container d3acd4ba27b2cca5cb5b0c631efad44a41815a59c462c59de1546e3d2e16d513: Status 404 returned error can't find the container with id d3acd4ba27b2cca5cb5b0c631efad44a41815a59c462c59de1546e3d2e16d513 Jun 08 19:33:20.964736 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:20.964713 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc05ff177_e1c7_44e3_9e62_548a84922331.slice/crio-92113f16e173a7c511a9142f52b578decb4ab7287d5dc9fbc8e1e8d0d22666e0 WatchSource:0}: Error finding container 92113f16e173a7c511a9142f52b578decb4ab7287d5dc9fbc8e1e8d0d22666e0: Status 404 returned error can't find the container with id 92113f16e173a7c511a9142f52b578decb4ab7287d5dc9fbc8e1e8d0d22666e0 Jun 08 19:33:20.966320 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:20.966299 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c21eb5_0ae6_4d16_94dc_ba72a5293c17.slice/crio-d3c3d014e83e80e8934c542585a1ac967b467eee2500612774e0dc6fab3a9375 WatchSource:0}: Error finding container d3c3d014e83e80e8934c542585a1ac967b467eee2500612774e0dc6fab3a9375: Status 404 returned error can't find the container with id d3c3d014e83e80e8934c542585a1ac967b467eee2500612774e0dc6fab3a9375 Jun 08 19:33:20.966862 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:20.966845 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b5552c_7a48_49e6_aa7d_ab0227399875.slice/crio-ea291ecfaa2adcc9b98581750e8bc6775aa96e6f7b531799e03a06d0c2e72036 WatchSource:0}: Error finding container ea291ecfaa2adcc9b98581750e8bc6775aa96e6f7b531799e03a06d0c2e72036: Status 404 returned error can't find the container with id ea291ecfaa2adcc9b98581750e8bc6775aa96e6f7b531799e03a06d0c2e72036 Jun 08 19:33:20.967780 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:20.967758 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded47d3ee_170c_42a6_913f_b808115fe16b.slice/crio-7b7eb6a0e57406c74f63c32d3d174be03b8408f699ab7c64085b50642ea8c950 WatchSource:0}: Error finding container 7b7eb6a0e57406c74f63c32d3d174be03b8408f699ab7c64085b50642ea8c950: Status 404 returned error can't find the container with id 7b7eb6a0e57406c74f63c32d3d174be03b8408f699ab7c64085b50642ea8c950 Jun 08 19:33:21.066530 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.066487 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 19:28:20 +0000 UTC" deadline="2028-02-24 04:27:16.329708084 +0000 UTC" Jun 08 19:33:21.066530 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.066527 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15008h53m55.263183193s" Jun 08 19:33:21.098576 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.098534 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" event={"ID":"d241132c-eb3a-4381-8b55-ebec819c514f","Type":"ContainerStarted","Data":"d3acd4ba27b2cca5cb5b0c631efad44a41815a59c462c59de1546e3d2e16d513"} Jun 08 19:33:21.099715 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.099688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx95" event={"ID":"ee34602e-4af8-4158-bf0c-7243bdc592d6","Type":"ContainerStarted","Data":"85743864500e9e596545e2e22deb71a78c0ebd803aebe4ec3346fb033baadb6f"} Jun 08 19:33:21.100937 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.100914 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k5ngh" event={"ID":"2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c","Type":"ContainerStarted","Data":"4d644e39a1d42519a02263b554276e3da58003c4493b647eb594419c29673bd3"} Jun 08 19:33:21.102818 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.102793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal" event={"ID":"fefb8afd1c16382fd0349c5eb50136cd","Type":"ContainerStarted","Data":"73b4a7ddca98896f58b0046b3d23cade24e0d83470671d10616c28df8c90d2d2"} Jun 08 19:33:21.103990 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.103959 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zdtwz" event={"ID":"86c21eb5-0ae6-4d16-94dc-ba72a5293c17","Type":"ContainerStarted","Data":"d3c3d014e83e80e8934c542585a1ac967b467eee2500612774e0dc6fab3a9375"} Jun 08 19:33:21.105079 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.105055 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" event={"ID":"c05ff177-e1c7-44e3-9e62-548a84922331","Type":"ContainerStarted","Data":"92113f16e173a7c511a9142f52b578decb4ab7287d5dc9fbc8e1e8d0d22666e0"} Jun 08 19:33:21.106192 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.106165 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" event={"ID":"5c3d018d-c654-4567-a7fa-7917402cb1dd","Type":"ContainerStarted","Data":"5b1357676390c48453fd8e17ab0de310d07bc141464919fe3277a55c10867296"} Jun 08 19:33:21.107316 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.107293 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7pt67" event={"ID":"e504f78f-6fd2-4d1f-b356-000b5e9222e7","Type":"ContainerStarted","Data":"9c69d83ee3ff2f1d6a487fe53f826bc5abcf69acf8ce310aa8907b137b9fe2f4"} Jun 08 19:33:21.108428 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.108406 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgpqd" event={"ID":"ed47d3ee-170c-42a6-913f-b808115fe16b","Type":"ContainerStarted","Data":"7b7eb6a0e57406c74f63c32d3d174be03b8408f699ab7c64085b50642ea8c950"} Jun 08 19:33:21.109497 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.109478 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m7bf7" event={"ID":"38b5552c-7a48-49e6-aa7d-ab0227399875","Type":"ContainerStarted","Data":"ea291ecfaa2adcc9b98581750e8bc6775aa96e6f7b531799e03a06d0c2e72036"} Jun 08 19:33:21.123505 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.123458 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-230.ec2.internal" podStartSLOduration=2.123446525 podStartE2EDuration="2.123446525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:21.123261878 +0000 UTC m=+3.444434394" watchObservedRunningTime="2026-06-08 19:33:21.123446525 +0000 UTC m=+3.444619042" Jun 08 19:33:21.649701 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.649606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:21.649876 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:21.649765 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:21.649876 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:21.649829 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs podName:7bb7542c-5411-4674-ae66-49f2a63958c0 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:23.649810585 +0000 UTC m=+5.970983085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs") pod "network-metrics-daemon-n6d4n" (UID: "7bb7542c-5411-4674-ae66-49f2a63958c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:21.750537 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.750496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvjrf\" (UniqueName: \"kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf\") pod \"network-check-target-8rxxd\" (UID: \"cad3851a-c674-4a01-9118-aa40c13d59d7\") " pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:21.750707 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:21.750588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:21.750768 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:21.750714 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:21.750837 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:21.750776 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret podName:e7189a06-ddfa-4e70-bbe2-9204fde5bccd nodeName:}" failed. No retries permitted until 2026-06-08 19:33:23.750757898 +0000 UTC m=+6.071930398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret") pod "global-pull-secret-syncer-nxg8x" (UID: "e7189a06-ddfa-4e70-bbe2-9204fde5bccd") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:21.751213 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:21.751192 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:33:21.751318 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:21.751219 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:33:21.751318 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:21.751248 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dvjrf for pod openshift-network-diagnostics/network-check-target-8rxxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:21.751318 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:21.751297 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf podName:cad3851a-c674-4a01-9118-aa40c13d59d7 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:23.751282456 +0000 UTC m=+6.072454956 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvjrf" (UniqueName: "kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf") pod "network-check-target-8rxxd" (UID: "cad3851a-c674-4a01-9118-aa40c13d59d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:22.066727 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:22.066633 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 19:28:20 +0000 UTC" deadline="2028-01-21 03:53:02.967002163 +0000 UTC" Jun 08 19:33:22.066727 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:22.066677 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14192h19m40.900329531s" Jun 08 19:33:22.096501 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:22.096472 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:22.096665 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:22.096595 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:22.097009 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:22.096989 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:22.097132 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:22.097102 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:22.097201 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:22.097183 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:22.097309 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:22.097273 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:22.125257 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:22.124831 2579 generic.go:356] "Generic (PLEG): container finished" podID="16c4b44f87ee90e27d9e620eb6227309" containerID="aa7558a617e8308b70ec168230d68d7470e81eb647dda40bb76cbb7f6ac59637" exitCode=0 Jun 08 19:33:22.126172 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:22.126091 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" event={"ID":"16c4b44f87ee90e27d9e620eb6227309","Type":"ContainerDied","Data":"aa7558a617e8308b70ec168230d68d7470e81eb647dda40bb76cbb7f6ac59637"} Jun 08 19:33:23.150822 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:23.150779 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" event={"ID":"16c4b44f87ee90e27d9e620eb6227309","Type":"ContainerStarted","Data":"5f149d98bb245357712af73283c5fd8351bc3eeba790842025dbd3f6f3e39d83"} Jun 08 19:33:23.169928 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:23.169872 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-230.ec2.internal" podStartSLOduration=4.169850506 podStartE2EDuration="4.169850506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:23.168969128 +0000 UTC m=+5.490141645" watchObservedRunningTime="2026-06-08 19:33:23.169850506 +0000 UTC m=+5.491023024" Jun 08 19:33:23.667308 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:23.667267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:23.667495 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:23.667463 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:23.667557 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:23.667530 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs podName:7bb7542c-5411-4674-ae66-49f2a63958c0 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:27.667509751 +0000 UTC m=+9.988682258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs") pod "network-metrics-daemon-n6d4n" (UID: "7bb7542c-5411-4674-ae66-49f2a63958c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:23.768854 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:23.767958 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvjrf\" (UniqueName: \"kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf\") pod \"network-check-target-8rxxd\" (UID: \"cad3851a-c674-4a01-9118-aa40c13d59d7\") " pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:23.768854 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:23.768036 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:23.768854 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:23.768211 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:23.768854 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:23.768291 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret podName:e7189a06-ddfa-4e70-bbe2-9204fde5bccd nodeName:}" failed. No retries permitted until 2026-06-08 19:33:27.768272643 +0000 UTC m=+10.089445143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret") pod "global-pull-secret-syncer-nxg8x" (UID: "e7189a06-ddfa-4e70-bbe2-9204fde5bccd") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:23.768854 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:23.768708 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:33:23.768854 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:23.768732 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:33:23.768854 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:23.768745 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dvjrf for pod openshift-network-diagnostics/network-check-target-8rxxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:23.768854 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:23.768794 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf podName:cad3851a-c674-4a01-9118-aa40c13d59d7 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:27.768778073 +0000 UTC m=+10.089950574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvjrf" (UniqueName: "kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf") pod "network-check-target-8rxxd" (UID: "cad3851a-c674-4a01-9118-aa40c13d59d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:24.091369 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:24.090251 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:24.091369 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:24.090392 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:24.091369 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:24.090852 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:24.091369 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:24.090954 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:24.091369 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:24.091091 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:24.091369 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:24.091172 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:26.089964 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:26.089929 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:26.090443 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:26.090083 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:26.090443 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:26.089929 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:26.090582 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:26.090553 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:26.090714 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:26.090614 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:26.090714 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:26.090694 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:27.701935 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:27.701897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:27.702442 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:27.702119 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:27.702442 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:27.702188 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs podName:7bb7542c-5411-4674-ae66-49f2a63958c0 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:35.702165468 +0000 UTC m=+18.023337971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs") pod "network-metrics-daemon-n6d4n" (UID: "7bb7542c-5411-4674-ae66-49f2a63958c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:27.802719 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:27.802662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvjrf\" (UniqueName: \"kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf\") pod \"network-check-target-8rxxd\" (UID: \"cad3851a-c674-4a01-9118-aa40c13d59d7\") " pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:27.802892 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:27.802744 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:27.802892 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:27.802865 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:27.802892 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:27.802869 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:33:27.803040 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:27.802898 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:33:27.803040 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:27.802913 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dvjrf for pod openshift-network-diagnostics/network-check-target-8rxxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:27.803040 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:27.802922 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret podName:e7189a06-ddfa-4e70-bbe2-9204fde5bccd nodeName:}" failed. No retries permitted until 2026-06-08 19:33:35.802905124 +0000 UTC m=+18.124077620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret") pod "global-pull-secret-syncer-nxg8x" (UID: "e7189a06-ddfa-4e70-bbe2-9204fde5bccd") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:27.803040 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:27.802963 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf podName:cad3851a-c674-4a01-9118-aa40c13d59d7 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:35.802946024 +0000 UTC m=+18.124118523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvjrf" (UniqueName: "kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf") pod "network-check-target-8rxxd" (UID: "cad3851a-c674-4a01-9118-aa40c13d59d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:28.092612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:28.091791 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:28.092612 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:28.091911 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:28.092612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:28.092315 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:28.092612 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:28.092410 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:28.092612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:28.092469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:28.092958 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:28.092665 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:30.089861 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:30.089830 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:30.090251 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:30.089842 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:30.090251 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:30.089939 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:30.090251 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:30.089842 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:30.090251 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:30.090007 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:30.090251 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:30.090087 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:32.090635 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:32.090596 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:32.091097 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:32.090752 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:32.091097 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:32.090603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:32.091097 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:32.090596 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:32.091097 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:32.090874 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:32.091097 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:32.090961 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:34.090530 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:34.090498 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:34.090530 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:34.090498 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:34.091032 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:34.090498 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:34.091032 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:34.090637 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:34.091032 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:34.090721 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:34.091032 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:34.090799 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:35.764137 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:35.764094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:35.764653 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:35.764279 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:35.764653 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:35.764366 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs podName:7bb7542c-5411-4674-ae66-49f2a63958c0 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:51.76434612 +0000 UTC m=+34.085518613 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs") pod "network-metrics-daemon-n6d4n" (UID: "7bb7542c-5411-4674-ae66-49f2a63958c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:35.864776 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:35.864725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvjrf\" (UniqueName: \"kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf\") pod \"network-check-target-8rxxd\" (UID: \"cad3851a-c674-4a01-9118-aa40c13d59d7\") " pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:35.864945 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:35.864892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:35.864945 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:35.864908 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:33:35.864945 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:35.864934 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:33:35.864945 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:35.864947 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dvjrf for pod openshift-network-diagnostics/network-check-target-8rxxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:35.865122 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:35.864993 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:35.865122 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:35.865015 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf podName:cad3851a-c674-4a01-9118-aa40c13d59d7 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:51.864995775 +0000 UTC m=+34.186168270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvjrf" (UniqueName: "kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf") pod "network-check-target-8rxxd" (UID: "cad3851a-c674-4a01-9118-aa40c13d59d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:35.865122 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:35.865045 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret podName:e7189a06-ddfa-4e70-bbe2-9204fde5bccd nodeName:}" failed. No retries permitted until 2026-06-08 19:33:51.865028511 +0000 UTC m=+34.186201012 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret") pod "global-pull-secret-syncer-nxg8x" (UID: "e7189a06-ddfa-4e70-bbe2-9204fde5bccd") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:36.090024 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:36.089895 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:36.090024 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:36.089921 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:36.090024 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:36.090016 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:36.090320 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:36.090040 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:36.090320 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:36.090133 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:36.090320 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:36.090216 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:38.090719 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:38.090680 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:38.091281 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:38.090770 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:38.091281 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:38.090794 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:38.091281 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:38.090912 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:38.091281 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:38.090974 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:38.091281 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:38.091053 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:40.089682 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:40.089612 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:40.090046 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:40.089619 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:40.090046 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:40.089722 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:40.090046 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:40.089623 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:40.090046 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:40.089790 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:40.090046 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:40.089886 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:40.185960 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:40.185925 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" event={"ID":"5c3d018d-c654-4567-a7fa-7917402cb1dd","Type":"ContainerStarted","Data":"eca0e4b0611a579e41a685eaf1a9ba0aaa01b21cebf2c94b88cd91d0a8f3ce2d"} Jun 08 19:33:40.187319 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:40.187295 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7pt67" event={"ID":"e504f78f-6fd2-4d1f-b356-000b5e9222e7","Type":"ContainerStarted","Data":"0628064c43a3732c9a425fde25845d11b2b62247840b452bcea4be553bb03008"} Jun 08 19:33:40.189103 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:40.189050 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgpqd" event={"ID":"ed47d3ee-170c-42a6-913f-b808115fe16b","Type":"ContainerStarted","Data":"bf6fa7e29d5a9705bbe6dc89489a50e3b2c3ffacceea87ec1b560d7f6be21529"} Jun 08 19:33:40.207439 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:40.207396 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7pt67" podStartSLOduration=3.307216705 podStartE2EDuration="22.207382618s" totalImagesPullingTime="18.900165913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:40.206666226 +0000 UTC m=+22.527838767" watchObservedRunningTime="2026-06-08 19:33:40.207382618 +0000 UTC m=+22.528555133" Jun 08 19:33:40.223537 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:40.223494 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wgpqd" podStartSLOduration=8.022684158 podStartE2EDuration="22.223476942s" totalImagesPullingTime="14.200792784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:40.222787099 +0000 UTC m=+22.543959616" watchObservedRunningTime="2026-06-08 19:33:40.223476942 +0000 UTC m=+22.544649459" Jun 08 19:33:41.192382 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.192090 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k5ngh" event={"ID":"2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c","Type":"ContainerStarted","Data":"9255488d1d92d62d80018c1fe9ae0411883296241561f964e76b9b46207a28a9"} Jun 08 19:33:41.193527 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.193501 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" event={"ID":"c05ff177-e1c7-44e3-9e62-548a84922331","Type":"ContainerStarted","Data":"589df22b1b174e4625bc0672baf840d3aa77f1adba1b7d7358f86700f1fb2c89"} Jun 08 19:33:41.194864 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.194843 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m7bf7" event={"ID":"38b5552c-7a48-49e6-aa7d-ab0227399875","Type":"ContainerStarted","Data":"9f3de940a02b87dacb131830db504e73dbeade5a9cf73d273488d62f1e354a90"} Jun 08 19:33:41.200328 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.200308 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gj6rg_d241132c-eb3a-4381-8b55-ebec819c514f/ovn-acl-logging/0.log" Jun 08 19:33:41.200635 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.200617 2579 generic.go:356] "Generic (PLEG): container finished" podID="d241132c-eb3a-4381-8b55-ebec819c514f" containerID="0d7a035a485a928a2698d53ac885119f4ed510e905c7828ab9e2c28f7aadb9b7" exitCode=1 Jun 08 19:33:41.200694 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.200681 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" event={"ID":"d241132c-eb3a-4381-8b55-ebec819c514f","Type":"ContainerStarted","Data":"11f09be411b0afc36106ed53db94a4117e8d7f3e44eb839044f8e884a889178b"} Jun 08 19:33:41.200778 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.200752 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" event={"ID":"d241132c-eb3a-4381-8b55-ebec819c514f","Type":"ContainerStarted","Data":"dafbd13ada3663d7a745b00ea0f9d9bee1fc742d1209f5edb84da9c08b2ff0ed"} Jun 08 19:33:41.200887 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.200786 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" event={"ID":"d241132c-eb3a-4381-8b55-ebec819c514f","Type":"ContainerStarted","Data":"66a503c90b1dc61a63905dd9d110e5c3b0ca7a0a3ab99c99246ad382bf79be0c"} Jun 08 19:33:41.200887 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.200814 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" event={"ID":"d241132c-eb3a-4381-8b55-ebec819c514f","Type":"ContainerDied","Data":"0d7a035a485a928a2698d53ac885119f4ed510e905c7828ab9e2c28f7aadb9b7"} Jun 08 19:33:41.200887 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.200842 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" event={"ID":"d241132c-eb3a-4381-8b55-ebec819c514f","Type":"ContainerStarted","Data":"fece6b78767e7ffc5cde656c37f51044097fc93d8a54099451f10bef23e83b24"} Jun 08 19:33:41.202131 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.202110 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee34602e-4af8-4158-bf0c-7243bdc592d6" containerID="2a149e8898612b6a6ba013a15a9c046bb5b2a03f5ebdee10098b65d0553a73bf" exitCode=0 Jun 08 19:33:41.202213 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.202178 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx95" event={"ID":"ee34602e-4af8-4158-bf0c-7243bdc592d6","Type":"ContainerDied","Data":"2a149e8898612b6a6ba013a15a9c046bb5b2a03f5ebdee10098b65d0553a73bf"} Jun 08 19:33:41.210031 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.209992 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k5ngh" podStartSLOduration=4.277140444 podStartE2EDuration="23.209979273s" totalImagesPullingTime="18.932838829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:41.20993008 +0000 UTC m=+23.531102595" watchObservedRunningTime="2026-06-08 19:33:41.209979273 +0000 UTC m=+23.531151783" Jun 08 19:33:41.262743 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.262697 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7bc6g" podStartSLOduration=4.35804631 podStartE2EDuration="23.262683483s" totalImagesPullingTime="18.904637173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:41.262570564 +0000 UTC m=+23.583743091" watchObservedRunningTime="2026-06-08 19:33:41.262683483 +0000 UTC m=+23.583855998" Jun 08 19:33:41.263033 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.263015 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m7bf7" podStartSLOduration=4.123258833 podStartE2EDuration="23.263010298s" totalImagesPullingTime="19.139751465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:41.247712763 +0000 UTC m=+23.568885279" watchObservedRunningTime="2026-06-08 19:33:41.263010298 +0000 UTC m=+23.584182863" Jun 08 19:33:41.463375 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:41.463348 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 19:33:42.089843 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:42.089735 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T19:33:41.463369165Z","UUID":"4a4379fd-ab6c-477e-9848-c5818671c4ad","Handler":null,"Name":"","Endpoint":""} Jun 08 19:33:42.090351 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:42.090326 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:42.090470 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:42.090455 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:42.090523 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:42.090336 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:42.090685 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:42.090609 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:42.090685 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:42.090675 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:42.090944 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:42.090776 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:42.091875 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:42.091821 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 19:33:42.091875 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:42.091864 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 19:33:42.207037 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:42.206981 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" event={"ID":"5c3d018d-c654-4567-a7fa-7917402cb1dd","Type":"ContainerStarted","Data":"c15947bf8fa663f308a7e7f9d3aa2a08bce7ccb8e25550e2e757bbef022ee62f"} Jun 08 19:33:42.210284 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:42.210260 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gj6rg_d241132c-eb3a-4381-8b55-ebec819c514f/ovn-acl-logging/0.log" Jun 08 19:33:42.210687 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:42.210650 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" event={"ID":"d241132c-eb3a-4381-8b55-ebec819c514f","Type":"ContainerStarted","Data":"b84dec727d776075b5995195ee68f4de29a2a39985b9b140f7d7ec89e0dd560d"} Jun 08 19:33:42.212266 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:42.212242 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zdtwz" event={"ID":"86c21eb5-0ae6-4d16-94dc-ba72a5293c17","Type":"ContainerStarted","Data":"e67534859a2d5ed65769035a650a9f10a3f539fab70e62b728e4ac13ad323eea"} Jun 08 19:33:42.228771 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:42.228718 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zdtwz" podStartSLOduration=5.33056823 podStartE2EDuration="24.228702477s" totalImagesPullingTime="18.898134247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:42.228675208 +0000 UTC m=+24.549847738" watchObservedRunningTime="2026-06-08 19:33:42.228702477 +0000 UTC m=+24.549874986" Jun 08 19:33:43.113150 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:43.112922 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7pt67" Jun 08 19:33:43.217475 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:43.217442 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" event={"ID":"5c3d018d-c654-4567-a7fa-7917402cb1dd","Type":"ContainerStarted","Data":"de85494fd007bb8b1161b9ac0bd1442583932c24dbee044efb09b7494176de46"} Jun 08 19:33:44.090163 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:44.090130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:44.090386 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:44.090130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:44.090386 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:44.090293 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:44.090386 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:44.090306 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:44.090560 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:44.090435 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:44.090621 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:44.090564 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:44.153736 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:44.153698 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7pt67" Jun 08 19:33:44.154380 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:44.154349 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7pt67" Jun 08 19:33:44.175898 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:44.175842 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6hp" podStartSLOduration=5.221460132 podStartE2EDuration="26.17582627s" totalImagesPullingTime="20.954366138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:43.23780583 +0000 UTC m=+25.558978370" watchObservedRunningTime="2026-06-08 19:33:44.17582627 +0000 UTC m=+26.496998813" Jun 08 19:33:44.222611 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:44.222582 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gj6rg_d241132c-eb3a-4381-8b55-ebec819c514f/ovn-acl-logging/0.log" Jun 08 19:33:44.223275 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:44.223074 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" event={"ID":"d241132c-eb3a-4381-8b55-ebec819c514f","Type":"ContainerStarted","Data":"96d705663c7c85f162398ea7fe1519a9467a1328fc7f15825a6a08e9e2b95b2f"} Jun 08 19:33:44.223953 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:44.223928 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7pt67" Jun 08 19:33:46.090673 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:46.090433 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:46.091350 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:46.090444 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:46.091350 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:46.090440 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:46.091350 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:46.091074 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:46.093703 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:46.091787 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:46.093703 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:46.092006 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:46.229974 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:46.229943 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gj6rg_d241132c-eb3a-4381-8b55-ebec819c514f/ovn-acl-logging/0.log" Jun 08 19:33:46.230382 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:46.230356 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" event={"ID":"d241132c-eb3a-4381-8b55-ebec819c514f","Type":"ContainerStarted","Data":"969854834a860eea3f2babf193743514a5667701e0b00e1e970c9c9a330f3fb8"} Jun 08 19:33:46.230640 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:46.230624 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:46.230890 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:46.230864 2579 scope.go:117] "RemoveContainer" containerID="0d7a035a485a928a2698d53ac885119f4ed510e905c7828ab9e2c28f7aadb9b7" Jun 08 19:33:46.232328 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:46.232300 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee34602e-4af8-4158-bf0c-7243bdc592d6" containerID="68bada7ca2ddeb5b507d423170342847fbe9707625beb8e035c101d4aea956fc" exitCode=0 Jun 08 19:33:46.232414 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:46.232344 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx95" event={"ID":"ee34602e-4af8-4158-bf0c-7243bdc592d6","Type":"ContainerDied","Data":"68bada7ca2ddeb5b507d423170342847fbe9707625beb8e035c101d4aea956fc"} Jun 08 19:33:46.249058 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:46.249042 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:47.237855 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:47.237828 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gj6rg_d241132c-eb3a-4381-8b55-ebec819c514f/ovn-acl-logging/0.log" Jun 08 19:33:47.238585 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:47.238262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" event={"ID":"d241132c-eb3a-4381-8b55-ebec819c514f","Type":"ContainerStarted","Data":"0deb7e15cd89f97bef92572f33a7f14ca5d99bb310c4e90a2b6dafc34282f6da"} Jun 08 19:33:47.238585 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:47.238435 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:47.238585 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:47.238487 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:47.252949 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:47.252928 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:33:47.308874 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:47.308826 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" podStartSLOduration=9.899192213 podStartE2EDuration="29.30881051s" totalImagesPullingTime="19.409618297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:47.275943827 +0000 UTC m=+29.597116341" watchObservedRunningTime="2026-06-08 19:33:47.30881051 +0000 UTC m=+29.629983026" Jun 08 19:33:47.741444 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:47.741414 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nxg8x"] Jun 08 19:33:47.741588 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:47.741555 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:47.741659 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:47.741643 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:47.744630 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:47.744559 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8rxxd"] Jun 08 19:33:47.744735 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:47.744647 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:47.744735 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:47.744718 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:47.751643 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:47.751619 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n6d4n"] Jun 08 19:33:47.751763 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:47.751736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:47.751867 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:47.751844 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:48.242455 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:48.242280 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee34602e-4af8-4158-bf0c-7243bdc592d6" containerID="1aaf8bdacddfa1738ca45daf984cc7e83dfaf23a9a238c5a78fa7810a801856f" exitCode=0 Jun 08 19:33:48.242455 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:48.242375 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx95" event={"ID":"ee34602e-4af8-4158-bf0c-7243bdc592d6","Type":"ContainerDied","Data":"1aaf8bdacddfa1738ca45daf984cc7e83dfaf23a9a238c5a78fa7810a801856f"} Jun 08 19:33:49.089877 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:49.089848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:49.090064 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:49.089896 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:49.090064 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:49.089957 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:49.090170 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:49.090057 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:50.093755 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:50.093689 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:50.094268 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:50.093791 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:50.248728 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:50.248689 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee34602e-4af8-4158-bf0c-7243bdc592d6" containerID="3ea28c79caf00331e22d2134df9b128965350faf5957c0a61d50d722ac0b5664" exitCode=0 Jun 08 19:33:50.248857 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:50.248756 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx95" event={"ID":"ee34602e-4af8-4158-bf0c-7243bdc592d6","Type":"ContainerDied","Data":"3ea28c79caf00331e22d2134df9b128965350faf5957c0a61d50d722ac0b5664"} Jun 08 19:33:51.090403 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:51.090370 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:51.090403 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:51.090401 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:51.090613 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:51.090490 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:51.090613 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:51.090599 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:51.788355 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:51.788277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:51.788842 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:51.788435 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:51.788842 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:51.788495 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs podName:7bb7542c-5411-4674-ae66-49f2a63958c0 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:23.78848131 +0000 UTC m=+66.109653804 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs") pod "network-metrics-daemon-n6d4n" (UID: "7bb7542c-5411-4674-ae66-49f2a63958c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:51.888701 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:51.888663 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvjrf\" (UniqueName: \"kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf\") pod \"network-check-target-8rxxd\" (UID: \"cad3851a-c674-4a01-9118-aa40c13d59d7\") " pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:51.888875 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:51.888719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:51.888875 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:51.888817 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:51.888875 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:51.888824 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:33:51.888875 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:51.888845 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:33:51.888875 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:51.888854 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dvjrf for pod openshift-network-diagnostics/network-check-target-8rxxd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:51.889061 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:51.888883 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret podName:e7189a06-ddfa-4e70-bbe2-9204fde5bccd nodeName:}" failed. No retries permitted until 2026-06-08 19:34:23.888865381 +0000 UTC m=+66.210037879 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret") pod "global-pull-secret-syncer-nxg8x" (UID: "e7189a06-ddfa-4e70-bbe2-9204fde5bccd") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:51.889061 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:51.888901 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf podName:cad3851a-c674-4a01-9118-aa40c13d59d7 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:23.888890536 +0000 UTC m=+66.210063034 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvjrf" (UniqueName: "kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf") pod "network-check-target-8rxxd" (UID: "cad3851a-c674-4a01-9118-aa40c13d59d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:52.092617 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:52.092532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:52.092777 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:52.092655 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:33:53.090601 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:53.090565 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:53.091012 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:53.090665 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8rxxd" podUID="cad3851a-c674-4a01-9118-aa40c13d59d7" Jun 08 19:33:53.091012 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:53.090721 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:53.091012 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:53.090828 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxg8x" podUID="e7189a06-ddfa-4e70-bbe2-9204fde5bccd" Jun 08 19:33:54.000840 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.000810 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-230.ec2.internal" event="NodeReady" Jun 08 19:33:54.001037 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.000945 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 19:33:54.041511 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.041479 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65fcbb6b89-68qxv"] Jun 08 19:33:54.045130 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.045105 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.047850 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.047816 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 19:33:54.047850 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.047842 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 19:33:54.048022 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.047876 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 19:33:54.048022 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.047980 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2dhx6\"" Jun 08 19:33:54.054925 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.054684 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-d76rp"] Jun 08 19:33:54.055718 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.055695 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 19:33:54.058342 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.058322 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-blblx"] Jun 08 19:33:54.058466 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.058450 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d76rp" Jun 08 19:33:54.062157 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.061698 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-twfxs"] Jun 08 19:33:54.062157 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.061851 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:33:54.062457 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.062440 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g6zb8\"" Jun 08 19:33:54.062591 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.062569 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 19:33:54.062702 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.062448 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 19:33:54.065065 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.065047 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ggvbh\"" Jun 08 19:33:54.065517 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.065304 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 19:33:54.065614 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.065078 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 19:33:54.067487 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.067464 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z4n9s"] Jun 08 19:33:54.067619 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.067602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:54.071531 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.071373 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 19:33:54.071647 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.071560 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 19:33:54.071807 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.071786 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dhlvj\"" Jun 08 19:33:54.071904 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.071885 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65fcbb6b89-68qxv"] Jun 08 19:33:54.072645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.071917 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-blblx"] Jun 08 19:33:54.072645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.071939 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-d76rp"] Jun 08 19:33:54.072645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.071957 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z4n9s"] Jun 08 19:33:54.072645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.072040 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z4n9s" Jun 08 19:33:54.075785 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.075764 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7jbdc\"" Jun 08 19:33:54.075881 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.075802 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 19:33:54.076170 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.076152 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 19:33:54.076263 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.076182 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 19:33:54.076779 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.076757 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-twfxs"] Jun 08 19:33:54.090124 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.090106 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:33:54.092740 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.092717 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 19:33:54.092740 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.092735 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kkkgg\"" Jun 08 19:33:54.197138 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.197084 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:54.202966 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.202939 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsk7v\" (UniqueName: \"kubernetes.io/projected/7a3537b7-27ae-4d2a-9389-f9781d970489-kube-api-access-zsk7v\") pod \"ingress-canary-z4n9s\" (UID: \"7a3537b7-27ae-4d2a-9389-f9781d970489\") " pod="openshift-ingress-canary/ingress-canary-z4n9s" Jun 08 19:33:54.203106 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.202974 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1bc57ce-1262-48c0-abc8-105e94f58ccf-ca-trust-extracted\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.203106 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203006 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978c7936-1cc3-4978-b11e-6d67d174c107-tmp-dir\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:54.203106 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-bound-sa-token\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.203106 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64jps\" (UniqueName: \"kubernetes.io/projected/8607577f-2f23-4d00-ab76-dd41d4c2c5fc-kube-api-access-64jps\") pod \"network-check-source-dbd9cf844-d76rp\" (UID: \"8607577f-2f23-4d00-ab76-dd41d4c2c5fc\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d76rp" Jun 08 19:33:54.203106 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:33:54.203454 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/978c7936-1cc3-4978-b11e-6d67d174c107-config-volume\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:54.203454 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203167 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a3537b7-27ae-4d2a-9389-f9781d970489-cert\") pod \"ingress-canary-z4n9s\" (UID: \"7a3537b7-27ae-4d2a-9389-f9781d970489\") " pod="openshift-ingress-canary/ingress-canary-z4n9s" Jun 08 19:33:54.203454 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv85v\" (UniqueName: \"kubernetes.io/projected/978c7936-1cc3-4978-b11e-6d67d174c107-kube-api-access-vv85v\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:54.203454 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203277 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-certificates\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.203454 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:54.203454 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6kjn\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-kube-api-access-q6kjn\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.203454 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a53f856-c42c-4d5d-9d1e-aa93d293874c-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:33:54.203454 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203404 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1bc57ce-1262-48c0-abc8-105e94f58ccf-trusted-ca\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.203786 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203462 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1bc57ce-1262-48c0-abc8-105e94f58ccf-image-registry-private-configuration\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.203786 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203496 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.203786 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.203537 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1bc57ce-1262-48c0-abc8-105e94f58ccf-installation-pull-secrets\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.304913 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.304791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1bc57ce-1262-48c0-abc8-105e94f58ccf-installation-pull-secrets\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.304913 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.304864 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsk7v\" (UniqueName: \"kubernetes.io/projected/7a3537b7-27ae-4d2a-9389-f9781d970489-kube-api-access-zsk7v\") pod \"ingress-canary-z4n9s\" (UID: \"7a3537b7-27ae-4d2a-9389-f9781d970489\") " pod="openshift-ingress-canary/ingress-canary-z4n9s" Jun 08 19:33:54.304913 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.304891 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1bc57ce-1262-48c0-abc8-105e94f58ccf-ca-trust-extracted\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.305184 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.304917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978c7936-1cc3-4978-b11e-6d67d174c107-tmp-dir\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:54.305184 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.304941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-bound-sa-token\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.305184 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64jps\" (UniqueName: \"kubernetes.io/projected/8607577f-2f23-4d00-ab76-dd41d4c2c5fc-kube-api-access-64jps\") pod \"network-check-source-dbd9cf844-d76rp\" (UID: \"8607577f-2f23-4d00-ab76-dd41d4c2c5fc\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d76rp" Jun 08 19:33:54.305184 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305131 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:33:54.305184 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305165 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/978c7936-1cc3-4978-b11e-6d67d174c107-config-volume\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:54.305184 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305183 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a3537b7-27ae-4d2a-9389-f9781d970489-cert\") pod \"ingress-canary-z4n9s\" (UID: \"7a3537b7-27ae-4d2a-9389-f9781d970489\") " pod="openshift-ingress-canary/ingress-canary-z4n9s" Jun 08 19:33:54.305455 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv85v\" (UniqueName: \"kubernetes.io/projected/978c7936-1cc3-4978-b11e-6d67d174c107-kube-api-access-vv85v\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:54.305455 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-certificates\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.305455 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305275 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978c7936-1cc3-4978-b11e-6d67d174c107-tmp-dir\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:54.305455 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305310 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:54.305455 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6kjn\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-kube-api-access-q6kjn\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.305455 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a53f856-c42c-4d5d-9d1e-aa93d293874c-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:33:54.305455 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1bc57ce-1262-48c0-abc8-105e94f58ccf-trusted-ca\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.305455 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1bc57ce-1262-48c0-abc8-105e94f58ccf-image-registry-private-configuration\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.305455 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.305858 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.305496 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:33:54.305858 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.305511 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fcbb6b89-68qxv: secret "image-registry-tls" not found Jun 08 19:33:54.305858 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.305560 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1bc57ce-1262-48c0-abc8-105e94f58ccf-ca-trust-extracted\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.305858 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.305572 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls podName:a1bc57ce-1262-48c0-abc8-105e94f58ccf nodeName:}" failed. No retries permitted until 2026-06-08 19:33:54.805553749 +0000 UTC m=+37.126726244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls") pod "image-registry-65fcbb6b89-68qxv" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf") : secret "image-registry-tls" not found Jun 08 19:33:54.305858 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.305649 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:33:54.305858 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.305698 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert podName:9a53f856-c42c-4d5d-9d1e-aa93d293874c nodeName:}" failed. No retries permitted until 2026-06-08 19:33:54.805685636 +0000 UTC m=+37.126858130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-blblx" (UID: "9a53f856-c42c-4d5d-9d1e-aa93d293874c") : secret "networking-console-plugin-cert" not found Jun 08 19:33:54.306242 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.306196 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/978c7936-1cc3-4978-b11e-6d67d174c107-config-volume\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:54.306372 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.306265 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:33:54.306372 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.306324 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls podName:978c7936-1cc3-4978-b11e-6d67d174c107 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:54.806307287 +0000 UTC m=+37.127479789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls") pod "dns-default-twfxs" (UID: "978c7936-1cc3-4978-b11e-6d67d174c107") : secret "dns-default-metrics-tls" not found Jun 08 19:33:54.306554 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.306384 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a53f856-c42c-4d5d-9d1e-aa93d293874c-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:33:54.306755 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.306733 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1bc57ce-1262-48c0-abc8-105e94f58ccf-trusted-ca\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.306838 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.306770 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-certificates\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.309980 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.309960 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1bc57ce-1262-48c0-abc8-105e94f58ccf-image-registry-private-configuration\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.310104 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.310072 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1bc57ce-1262-48c0-abc8-105e94f58ccf-installation-pull-secrets\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.310222 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.310198 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a3537b7-27ae-4d2a-9389-f9781d970489-cert\") pod \"ingress-canary-z4n9s\" (UID: \"7a3537b7-27ae-4d2a-9389-f9781d970489\") " pod="openshift-ingress-canary/ingress-canary-z4n9s" Jun 08 19:33:54.313987 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.313803 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsk7v\" (UniqueName: \"kubernetes.io/projected/7a3537b7-27ae-4d2a-9389-f9781d970489-kube-api-access-zsk7v\") pod \"ingress-canary-z4n9s\" (UID: \"7a3537b7-27ae-4d2a-9389-f9781d970489\") " pod="openshift-ingress-canary/ingress-canary-z4n9s" Jun 08 19:33:54.313987 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.313946 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-bound-sa-token\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.314448 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.314423 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6kjn\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-kube-api-access-q6kjn\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.315270 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.315211 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv85v\" (UniqueName: \"kubernetes.io/projected/978c7936-1cc3-4978-b11e-6d67d174c107-kube-api-access-vv85v\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:54.315399 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.315384 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64jps\" (UniqueName: \"kubernetes.io/projected/8607577f-2f23-4d00-ab76-dd41d4c2c5fc-kube-api-access-64jps\") pod \"network-check-source-dbd9cf844-d76rp\" (UID: \"8607577f-2f23-4d00-ab76-dd41d4c2c5fc\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d76rp" Jun 08 19:33:54.325854 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.325818 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:54.375557 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.375523 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d76rp" Jun 08 19:33:54.398706 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.398679 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z4n9s" Jun 08 19:33:54.809962 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.809923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:33:54.810171 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.810021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:54.810171 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.810107 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:33:54.810171 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:54.810144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:54.810427 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.810193 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert podName:9a53f856-c42c-4d5d-9d1e-aa93d293874c nodeName:}" failed. No retries permitted until 2026-06-08 19:33:55.810173562 +0000 UTC m=+38.131346083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-blblx" (UID: "9a53f856-c42c-4d5d-9d1e-aa93d293874c") : secret "networking-console-plugin-cert" not found Jun 08 19:33:54.810427 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.810119 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:33:54.810427 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.810250 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:33:54.810427 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.810264 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fcbb6b89-68qxv: secret "image-registry-tls" not found Jun 08 19:33:54.810427 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.810295 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls podName:978c7936-1cc3-4978-b11e-6d67d174c107 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:55.81027494 +0000 UTC m=+38.131447452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls") pod "dns-default-twfxs" (UID: "978c7936-1cc3-4978-b11e-6d67d174c107") : secret "dns-default-metrics-tls" not found Jun 08 19:33:54.810427 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:54.810320 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls podName:a1bc57ce-1262-48c0-abc8-105e94f58ccf nodeName:}" failed. No retries permitted until 2026-06-08 19:33:55.810310221 +0000 UTC m=+38.131482715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls") pod "image-registry-65fcbb6b89-68qxv" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf") : secret "image-registry-tls" not found Jun 08 19:33:55.090505 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:55.090422 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:33:55.090669 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:55.090422 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:33:55.093223 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:55.093202 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 19:33:55.094247 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:55.094213 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ntgfs\"" Jun 08 19:33:55.487646 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:55.487620 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-d76rp"] Jun 08 19:33:55.491431 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:55.491401 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z4n9s"] Jun 08 19:33:55.498325 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:33:55.498299 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a3537b7_27ae_4d2a_9389_f9781d970489.slice/crio-f3c4411821ff76b9007f391c22d124bd67d9eaf2a4dd157c3bf298fbd828460e WatchSource:0}: Error finding container f3c4411821ff76b9007f391c22d124bd67d9eaf2a4dd157c3bf298fbd828460e: Status 404 returned error can't find the container with id f3c4411821ff76b9007f391c22d124bd67d9eaf2a4dd157c3bf298fbd828460e Jun 08 19:33:55.592630 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:55.592554 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:55.686622 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:55.686583 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:55.819603 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:55.819429 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:55.819798 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:55.819574 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:33:55.819798 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:55.819668 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:33:55.819798 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:55.819681 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fcbb6b89-68qxv: secret "image-registry-tls" not found Jun 08 19:33:55.819798 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:55.819734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:55.819983 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:55.819806 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls podName:a1bc57ce-1262-48c0-abc8-105e94f58ccf nodeName:}" failed. No retries permitted until 2026-06-08 19:33:57.819781766 +0000 UTC m=+40.140954269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls") pod "image-registry-65fcbb6b89-68qxv" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf") : secret "image-registry-tls" not found Jun 08 19:33:55.819983 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:55.819811 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:33:55.819983 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:55.819860 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls podName:978c7936-1cc3-4978-b11e-6d67d174c107 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:57.819845002 +0000 UTC m=+40.141017511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls") pod "dns-default-twfxs" (UID: "978c7936-1cc3-4978-b11e-6d67d174c107") : secret "dns-default-metrics-tls" not found Jun 08 19:33:55.819983 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:55.819721 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:33:55.819983 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:55.819904 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert podName:9a53f856-c42c-4d5d-9d1e-aa93d293874c nodeName:}" failed. No retries permitted until 2026-06-08 19:33:57.819894221 +0000 UTC m=+40.141066729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-blblx" (UID: "9a53f856-c42c-4d5d-9d1e-aa93d293874c") : secret "networking-console-plugin-cert" not found Jun 08 19:33:56.095129 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:56.095085 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:56.155776 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:56.155692 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:56.228145 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:56.228053 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:56.267942 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:56.267908 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee34602e-4af8-4158-bf0c-7243bdc592d6" containerID="7fb4bed75695d5b7d187684396bb859d56bff97e000c163edc93b7e755267606" exitCode=0 Jun 08 19:33:56.268110 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:56.267999 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx95" event={"ID":"ee34602e-4af8-4158-bf0c-7243bdc592d6","Type":"ContainerDied","Data":"7fb4bed75695d5b7d187684396bb859d56bff97e000c163edc93b7e755267606"} Jun 08 19:33:56.269722 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:56.269670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z4n9s" event={"ID":"7a3537b7-27ae-4d2a-9389-f9781d970489","Type":"ContainerStarted","Data":"f3c4411821ff76b9007f391c22d124bd67d9eaf2a4dd157c3bf298fbd828460e"} Jun 08 19:33:56.271178 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:56.271122 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d76rp" event={"ID":"8607577f-2f23-4d00-ab76-dd41d4c2c5fc","Type":"ContainerStarted","Data":"a38647739122cd3d8ee007ee6537e32113f8e9ce3568c9de2426c6c99ee69721"} Jun 08 19:33:56.299578 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:56.299501 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:57.159735 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:57.159700 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:57.265181 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:57.265118 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:57.278272 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:57.278241 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee34602e-4af8-4158-bf0c-7243bdc592d6" containerID="61889b355c0750279e3afa3791634a48cdf604a4b582ae65f3e2b4c0ac3ab907" exitCode=0 Jun 08 19:33:57.278440 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:57.278291 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx95" event={"ID":"ee34602e-4af8-4158-bf0c-7243bdc592d6","Type":"ContainerDied","Data":"61889b355c0750279e3afa3791634a48cdf604a4b582ae65f3e2b4c0ac3ab907"} Jun 08 19:33:57.837086 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:57.836995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:33:57.837086 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:57.837079 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:33:57.837339 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:57.837117 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:33:57.837339 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:57.837153 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:33:57.837339 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:57.837241 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert podName:9a53f856-c42c-4d5d-9d1e-aa93d293874c nodeName:}" failed. No retries permitted until 2026-06-08 19:34:01.837203381 +0000 UTC m=+44.158375894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-blblx" (UID: "9a53f856-c42c-4d5d-9d1e-aa93d293874c") : secret "networking-console-plugin-cert" not found Jun 08 19:33:57.837339 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:57.837275 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:33:57.837339 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:57.837336 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls podName:978c7936-1cc3-4978-b11e-6d67d174c107 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:01.837319073 +0000 UTC m=+44.158491569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls") pod "dns-default-twfxs" (UID: "978c7936-1cc3-4978-b11e-6d67d174c107") : secret "dns-default-metrics-tls" not found Jun 08 19:33:57.837596 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:57.837411 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:33:57.837596 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:57.837431 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fcbb6b89-68qxv: secret "image-registry-tls" not found Jun 08 19:33:57.837596 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:33:57.837483 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls podName:a1bc57ce-1262-48c0-abc8-105e94f58ccf nodeName:}" failed. No retries permitted until 2026-06-08 19:34:01.837467617 +0000 UTC m=+44.158640114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls") pod "image-registry-65fcbb6b89-68qxv" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf") : secret "image-registry-tls" not found Jun 08 19:33:58.111523 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:58.111412 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:59.239645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:59.239602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:59.287448 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:59.287416 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx95" event={"ID":"ee34602e-4af8-4158-bf0c-7243bdc592d6","Type":"ContainerStarted","Data":"0b1ca1a874da11410fc72db57ded051c747d462487f5049ae4dd981b728a1858"} Jun 08 19:33:59.288891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:59.288867 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z4n9s" event={"ID":"7a3537b7-27ae-4d2a-9389-f9781d970489","Type":"ContainerStarted","Data":"1ed2a080ce0c48f9522546d648af24e4c7d707c3272d3ae16fb62557b5bbc44c"} Jun 08 19:33:59.290379 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:59.290358 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d76rp" event={"ID":"8607577f-2f23-4d00-ab76-dd41d4c2c5fc","Type":"ContainerStarted","Data":"8d1def3a886793df13799c8c281e43449fe631e8c803d23416261c1a988390ac"} Jun 08 19:33:59.312161 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:59.312117 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gqx95" podStartSLOduration=11.017101474 podStartE2EDuration="41.312105119s" totalImagesPullingTime="30.295003645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:59.310711649 +0000 UTC m=+41.631884164" watchObservedRunningTime="2026-06-08 19:33:59.312105119 +0000 UTC m=+41.633277636" Jun 08 19:33:59.315790 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:59.315769 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:59.330921 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:59.330884 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d76rp" podStartSLOduration=32.970443453 podStartE2EDuration="36.330875025s" totalImagesPullingTime="3.360431572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:33:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:59.330039731 +0000 UTC m=+41.651212246" watchObservedRunningTime="2026-06-08 19:33:59.330875025 +0000 UTC m=+41.652047565" Jun 08 19:33:59.350755 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:59.350719 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z4n9s" podStartSLOduration=2.004174861 podStartE2EDuration="5.350706865s" totalImagesPullingTime="3.346532004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:59.350347346 +0000 UTC m=+41.671519864" watchObservedRunningTime="2026-06-08 19:33:59.350706865 +0000 UTC m=+41.671879382" Jun 08 19:33:59.448014 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:59.447973 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:59.509100 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:59.508996 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:59.588078 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:59.588047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:33:59.687068 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:33:59.687037 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:01.868597 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:01.868560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:34:01.868597 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:01.868603 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:34:01.869019 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:01.868645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:34:01.869019 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:01.868727 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:34:01.869019 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:01.868737 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:34:01.869019 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:01.868765 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:34:01.869019 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:01.868782 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fcbb6b89-68qxv: secret "image-registry-tls" not found Jun 08 19:34:01.869019 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:01.868783 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert podName:9a53f856-c42c-4d5d-9d1e-aa93d293874c nodeName:}" failed. No retries permitted until 2026-06-08 19:34:09.868768459 +0000 UTC m=+52.189940952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-blblx" (UID: "9a53f856-c42c-4d5d-9d1e-aa93d293874c") : secret "networking-console-plugin-cert" not found Jun 08 19:34:01.869019 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:01.868829 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls podName:978c7936-1cc3-4978-b11e-6d67d174c107 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:09.868815616 +0000 UTC m=+52.189988114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls") pod "dns-default-twfxs" (UID: "978c7936-1cc3-4978-b11e-6d67d174c107") : secret "dns-default-metrics-tls" not found Jun 08 19:34:01.869019 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:01.868845 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls podName:a1bc57ce-1262-48c0-abc8-105e94f58ccf nodeName:}" failed. No retries permitted until 2026-06-08 19:34:09.868839649 +0000 UTC m=+52.190012143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls") pod "image-registry-65fcbb6b89-68qxv" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf") : secret "image-registry-tls" not found Jun 08 19:34:07.936695 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:07.936659 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:08.038049 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:08.038007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:09.926806 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:09.926770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:34:09.927306 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:09.926813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:34:09.927306 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:09.926862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:34:09.927306 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:09.926918 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:34:09.927306 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:09.926949 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:34:09.927306 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:09.926973 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:34:09.927306 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:09.926987 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fcbb6b89-68qxv: secret "image-registry-tls" not found Jun 08 19:34:09.927306 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:09.927000 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls podName:978c7936-1cc3-4978-b11e-6d67d174c107 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:25.926977633 +0000 UTC m=+68.248150146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls") pod "dns-default-twfxs" (UID: "978c7936-1cc3-4978-b11e-6d67d174c107") : secret "dns-default-metrics-tls" not found Jun 08 19:34:09.927306 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:09.927018 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert podName:9a53f856-c42c-4d5d-9d1e-aa93d293874c nodeName:}" failed. No retries permitted until 2026-06-08 19:34:25.927009968 +0000 UTC m=+68.248182477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-blblx" (UID: "9a53f856-c42c-4d5d-9d1e-aa93d293874c") : secret "networking-console-plugin-cert" not found Jun 08 19:34:09.927306 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:09.927031 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls podName:a1bc57ce-1262-48c0-abc8-105e94f58ccf nodeName:}" failed. No retries permitted until 2026-06-08 19:34:25.927025427 +0000 UTC m=+68.248197921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls") pod "image-registry-65fcbb6b89-68qxv" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf") : secret "image-registry-tls" not found Jun 08 19:34:11.218122 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:11.218077 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:11.284137 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:11.284099 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:11.347887 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:11.347853 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:13.275798 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:13.275760 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:13.327713 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:13.327683 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:19.258406 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:19.258377 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gj6rg" Jun 08 19:34:19.460179 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:19.460144 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:19.518833 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:19.518757 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:21.240161 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:21.240125 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:21.295901 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:21.295863 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:23.834111 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:23.834070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:34:23.836710 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:23.836692 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 19:34:23.844746 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:23.844729 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 19:34:23.844807 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:23.844796 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs podName:7bb7542c-5411-4674-ae66-49f2a63958c0 nodeName:}" failed. No retries permitted until 2026-06-08 19:35:27.844778893 +0000 UTC m=+130.165951387 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs") pod "network-metrics-daemon-n6d4n" (UID: "7bb7542c-5411-4674-ae66-49f2a63958c0") : secret "metrics-daemon-secret" not found Jun 08 19:34:23.935340 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:23.935290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvjrf\" (UniqueName: \"kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf\") pod \"network-check-target-8rxxd\" (UID: \"cad3851a-c674-4a01-9118-aa40c13d59d7\") " pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:34:23.935489 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:23.935390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:34:23.938039 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:23.938013 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 19:34:23.938787 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:23.938765 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvjrf\" (UniqueName: \"kubernetes.io/projected/cad3851a-c674-4a01-9118-aa40c13d59d7-kube-api-access-dvjrf\") pod \"network-check-target-8rxxd\" (UID: \"cad3851a-c674-4a01-9118-aa40c13d59d7\") " pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:34:23.948272 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:23.948253 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7189a06-ddfa-4e70-bbe2-9204fde5bccd-original-pull-secret\") pod \"global-pull-secret-syncer-nxg8x\" (UID: \"e7189a06-ddfa-4e70-bbe2-9204fde5bccd\") " pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:34:24.204254 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:24.204202 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ntgfs\"" Jun 08 19:34:24.207679 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:24.207665 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxg8x" Jun 08 19:34:24.211742 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:24.211719 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:34:24.341760 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:24.341731 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8rxxd"] Jun 08 19:34:24.344996 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:34:24.344969 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad3851a_c674_4a01_9118_aa40c13d59d7.slice/crio-ea2a6c2864cf0b71b0a547626fe045770e922ce00e5a6fd983f1986a4f1d968c WatchSource:0}: Error finding container ea2a6c2864cf0b71b0a547626fe045770e922ce00e5a6fd983f1986a4f1d968c: Status 404 returned error can't find the container with id ea2a6c2864cf0b71b0a547626fe045770e922ce00e5a6fd983f1986a4f1d968c Jun 08 19:34:24.352132 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:24.352103 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8rxxd" event={"ID":"cad3851a-c674-4a01-9118-aa40c13d59d7","Type":"ContainerStarted","Data":"ea2a6c2864cf0b71b0a547626fe045770e922ce00e5a6fd983f1986a4f1d968c"} Jun 08 19:34:24.354630 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:24.354606 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nxg8x"] Jun 08 19:34:24.357944 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:34:24.357922 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7189a06_ddfa_4e70_bbe2_9204fde5bccd.slice/crio-36f702652968437d483195bdc3153ab829d5a9dd0d06c02b0b36e7467e963d27 WatchSource:0}: Error finding container 36f702652968437d483195bdc3153ab829d5a9dd0d06c02b0b36e7467e963d27: Status 404 returned error can't find the container with id 36f702652968437d483195bdc3153ab829d5a9dd0d06c02b0b36e7467e963d27 Jun 08 19:34:25.356418 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:25.356373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8rxxd" event={"ID":"cad3851a-c674-4a01-9118-aa40c13d59d7","Type":"ContainerStarted","Data":"f9352df384eb952b4323dae66076f6ee4d4c1436cd55a19c5b6cfb331c33a49b"} Jun 08 19:34:25.356898 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:25.356440 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:34:25.357766 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:25.357735 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nxg8x" event={"ID":"e7189a06-ddfa-4e70-bbe2-9204fde5bccd","Type":"ContainerStarted","Data":"36f702652968437d483195bdc3153ab829d5a9dd0d06c02b0b36e7467e963d27"} Jun 08 19:34:25.372947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:25.372905 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8rxxd" podStartSLOduration=67.37288959 podStartE2EDuration="1m7.37288959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:33:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:34:25.372037624 +0000 UTC m=+67.693210140" watchObservedRunningTime="2026-06-08 19:34:25.37288959 +0000 UTC m=+67.694062097" Jun 08 19:34:25.951385 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:25.951346 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:34:25.951575 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:25.951413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:34:25.951575 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:25.951451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:34:25.951575 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:25.951513 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:34:25.951575 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:25.951570 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:34:25.951752 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:25.951584 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fcbb6b89-68qxv: secret "image-registry-tls" not found Jun 08 19:34:25.951752 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:25.951588 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert podName:9a53f856-c42c-4d5d-9d1e-aa93d293874c nodeName:}" failed. No retries permitted until 2026-06-08 19:34:57.951571459 +0000 UTC m=+100.272743953 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-blblx" (UID: "9a53f856-c42c-4d5d-9d1e-aa93d293874c") : secret "networking-console-plugin-cert" not found Jun 08 19:34:25.951752 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:25.951513 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:34:25.951752 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:25.951634 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls podName:a1bc57ce-1262-48c0-abc8-105e94f58ccf nodeName:}" failed. No retries permitted until 2026-06-08 19:34:57.951618182 +0000 UTC m=+100.272790691 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls") pod "image-registry-65fcbb6b89-68qxv" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf") : secret "image-registry-tls" not found Jun 08 19:34:25.951752 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:25.951651 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls podName:978c7936-1cc3-4978-b11e-6d67d174c107 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:57.951641945 +0000 UTC m=+100.272814444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls") pod "dns-default-twfxs" (UID: "978c7936-1cc3-4978-b11e-6d67d174c107") : secret "dns-default-metrics-tls" not found Jun 08 19:34:29.369658 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:29.369622 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nxg8x" event={"ID":"e7189a06-ddfa-4e70-bbe2-9204fde5bccd","Type":"ContainerStarted","Data":"e641037f707cfd8463211c164f7d0506685a99fa6c26cfa42cb0673f8b5243f3"} Jun 08 19:34:29.385630 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:29.385556 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nxg8x" podStartSLOduration=67.003127243 podStartE2EDuration="1m11.385540991s" totalImagesPullingTime="4.382413748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:34:29.384725992 +0000 UTC m=+71.705898504" watchObservedRunningTime="2026-06-08 19:34:29.385540991 +0000 UTC m=+71.706713508" Jun 08 19:34:34.199085 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:34.199043 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:34.264492 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:34.264454 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:34:56.363344 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:56.363313 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8rxxd" Jun 08 19:34:57.997617 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:57.997567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:34:57.997617 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:57.997621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:34:57.998051 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:34:57.997657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:34:57.998051 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:57.997730 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:34:57.998051 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:57.997771 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:34:57.998051 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:57.997790 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fcbb6b89-68qxv: secret "image-registry-tls" not found Jun 08 19:34:57.998051 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:57.997739 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:34:57.998051 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:57.997837 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls podName:978c7936-1cc3-4978-b11e-6d67d174c107 nodeName:}" failed. No retries permitted until 2026-06-08 19:36:01.997819321 +0000 UTC m=+164.318991815 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls") pod "dns-default-twfxs" (UID: "978c7936-1cc3-4978-b11e-6d67d174c107") : secret "dns-default-metrics-tls" not found Jun 08 19:34:57.998051 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:57.997855 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls podName:a1bc57ce-1262-48c0-abc8-105e94f58ccf nodeName:}" failed. No retries permitted until 2026-06-08 19:36:01.997848149 +0000 UTC m=+164.319020643 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls") pod "image-registry-65fcbb6b89-68qxv" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf") : secret "image-registry-tls" not found Jun 08 19:34:57.998051 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:34:57.997872 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert podName:9a53f856-c42c-4d5d-9d1e-aa93d293874c nodeName:}" failed. No retries permitted until 2026-06-08 19:36:01.997859016 +0000 UTC m=+164.319031514 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-blblx" (UID: "9a53f856-c42c-4d5d-9d1e-aa93d293874c") : secret "networking-console-plugin-cert" not found Jun 08 19:35:09.683587 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:35:09.683542 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:35:27.918901 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:35:27.918851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:35:27.919426 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:35:27.919018 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 19:35:27.919426 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:35:27.919085 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs podName:7bb7542c-5411-4674-ae66-49f2a63958c0 nodeName:}" failed. No retries permitted until 2026-06-08 19:37:29.919069443 +0000 UTC m=+252.240241937 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs") pod "network-metrics-daemon-n6d4n" (UID: "7bb7542c-5411-4674-ae66-49f2a63958c0") : secret "metrics-daemon-secret" not found Jun 08 19:35:57.056923 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:35:57.056860 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" podUID="a1bc57ce-1262-48c0-abc8-105e94f58ccf" Jun 08 19:35:57.084179 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:35:57.084148 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" podUID="9a53f856-c42c-4d5d-9d1e-aa93d293874c" Jun 08 19:35:57.090457 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:35:57.090420 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-twfxs" podUID="978c7936-1cc3-4978-b11e-6d67d174c107" Jun 08 19:35:57.104933 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:35:57.104894 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:35:57.581990 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:35:57.581958 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-twfxs" Jun 08 19:35:57.582169 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:35:57.581958 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:35:57.582169 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:35:57.581958 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:36:01.379738 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:36:01.379706 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:36:02.064020 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:36:02.063979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:36:02.064214 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:36:02.064032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:36:02.064214 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:36:02.064129 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:36:02.064214 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:36:02.064150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:36:02.064214 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:36:02.064176 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls podName:978c7936-1cc3-4978-b11e-6d67d174c107 nodeName:}" failed. No retries permitted until 2026-06-08 19:38:04.064164011 +0000 UTC m=+286.385336505 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls") pod "dns-default-twfxs" (UID: "978c7936-1cc3-4978-b11e-6d67d174c107") : secret "dns-default-metrics-tls" not found Jun 08 19:36:02.064214 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:36:02.064129 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 19:36:02.064586 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:36:02.064221 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 19:36:02.064586 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:36:02.064250 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fcbb6b89-68qxv: secret "image-registry-tls" not found Jun 08 19:36:02.064586 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:36:02.064275 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert podName:9a53f856-c42c-4d5d-9d1e-aa93d293874c nodeName:}" failed. No retries permitted until 2026-06-08 19:38:04.064259186 +0000 UTC m=+286.385431684 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-blblx" (UID: "9a53f856-c42c-4d5d-9d1e-aa93d293874c") : secret "networking-console-plugin-cert" not found Jun 08 19:36:02.064586 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:36:02.064298 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls podName:a1bc57ce-1262-48c0-abc8-105e94f58ccf nodeName:}" failed. No retries permitted until 2026-06-08 19:38:04.064287151 +0000 UTC m=+286.385459646 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls") pod "image-registry-65fcbb6b89-68qxv" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf") : secret "image-registry-tls" not found Jun 08 19:36:10.090452 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:36:10.090368 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:37:29.987135 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:29.987081 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:37:29.987657 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:29.987254 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 19:37:29.987657 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:29.987327 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs podName:7bb7542c-5411-4674-ae66-49f2a63958c0 nodeName:}" failed. No retries permitted until 2026-06-08 19:39:31.987309383 +0000 UTC m=+374.308481890 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs") pod "network-metrics-daemon-n6d4n" (UID: "7bb7542c-5411-4674-ae66-49f2a63958c0") : secret "metrics-daemon-secret" not found Jun 08 19:37:35.811728 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.811644 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qs5xk"] Jun 08 19:37:35.814470 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.814450 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qs5xk" Jun 08 19:37:35.814971 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.814949 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg"] Jun 08 19:37:35.816968 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.816950 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 08 19:37:35.817504 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.817485 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:35.818452 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.818380 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:37:35.818554 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.818533 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-45rgf\"" Jun 08 19:37:35.820683 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.820044 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g"] Jun 08 19:37:35.824670 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.824649 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" Jun 08 19:37:35.825357 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.825334 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 08 19:37:35.825456 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.825384 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 08 19:37:35.825456 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.825435 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-txtnf\"" Jun 08 19:37:35.825566 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.825552 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 19:37:35.825566 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.825561 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 19:37:35.827188 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.827162 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mjsj6\"" Jun 08 19:37:35.827188 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.827204 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qs5xk"] Jun 08 19:37:35.827372 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.827210 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:37:35.827614 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.827593 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 08 19:37:35.827719 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.827705 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 08 19:37:35.829956 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.829935 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg"] Jun 08 19:37:35.835137 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.835119 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g"] Jun 08 19:37:35.912128 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.912097 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-668b985f5-m2skx"] Jun 08 19:37:35.915108 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.915092 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:35.917679 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.917661 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 08 19:37:35.918289 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.918269 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 08 19:37:35.918377 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.918265 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 08 19:37:35.918377 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.918327 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 08 19:37:35.918484 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.918387 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 19:37:35.918484 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.918445 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 19:37:35.918585 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.918542 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wvgnt\"" Jun 08 19:37:35.927661 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.927641 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-668b985f5-m2skx"] Jun 08 19:37:35.928920 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.928898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vhmw\" (UniqueName: \"kubernetes.io/projected/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-kube-api-access-2vhmw\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:35.928999 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.928939 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wkq2g\" (UID: \"77ec7060-0947-415a-8619-0a0ff4bdcedc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" Jun 08 19:37:35.928999 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.928979 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:35.929066 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.929033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk8dp\" (UniqueName: \"kubernetes.io/projected/d1f796d3-db37-40e6-aeda-b4fd5ce7901d-kube-api-access-hk8dp\") pod \"volume-data-source-validator-78dd696465-qs5xk\" (UID: \"d1f796d3-db37-40e6-aeda-b4fd5ce7901d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qs5xk" Jun 08 19:37:35.929114 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.929100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf8w9\" (UniqueName: \"kubernetes.io/projected/77ec7060-0947-415a-8619-0a0ff4bdcedc-kube-api-access-hf8w9\") pod \"cluster-samples-operator-854f8b96b6-wkq2g\" (UID: \"77ec7060-0947-415a-8619-0a0ff4bdcedc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" Jun 08 19:37:35.929146 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:35.929127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:36.029566 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.029529 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:36.029566 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.029568 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-default-certificate\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.029785 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.029590 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.029785 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.029628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-stats-auth\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.029785 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.029670 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 19:37:36.029785 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.029695 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf8w9\" (UniqueName: \"kubernetes.io/projected/77ec7060-0947-415a-8619-0a0ff4bdcedc-kube-api-access-hf8w9\") pod \"cluster-samples-operator-854f8b96b6-wkq2g\" (UID: \"77ec7060-0947-415a-8619-0a0ff4bdcedc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" Jun 08 19:37:36.029785 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.029713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.029785 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.029736 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls podName:362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4 nodeName:}" failed. No retries permitted until 2026-06-08 19:37:36.529719158 +0000 UTC m=+258.850891655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rmnjg" (UID: "362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4") : secret "cluster-monitoring-operator-tls" not found Jun 08 19:37:36.030060 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.029792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:36.030060 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.029842 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wkq2g\" (UID: \"77ec7060-0947-415a-8619-0a0ff4bdcedc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" Jun 08 19:37:36.030060 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.029884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk8dp\" (UniqueName: \"kubernetes.io/projected/d1f796d3-db37-40e6-aeda-b4fd5ce7901d-kube-api-access-hk8dp\") pod \"volume-data-source-validator-78dd696465-qs5xk\" (UID: \"d1f796d3-db37-40e6-aeda-b4fd5ce7901d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qs5xk" Jun 08 19:37:36.030060 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.029936 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8kxl\" (UniqueName: \"kubernetes.io/projected/10ebd5b9-45a0-4544-85c3-ad58e61e391b-kube-api-access-q8kxl\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.030060 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.029965 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vhmw\" (UniqueName: \"kubernetes.io/projected/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-kube-api-access-2vhmw\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:36.030060 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.029983 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 19:37:36.030060 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.030036 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls podName:77ec7060-0947-415a-8619-0a0ff4bdcedc nodeName:}" failed. No retries permitted until 2026-06-08 19:37:36.530022998 +0000 UTC m=+258.851195492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-wkq2g" (UID: "77ec7060-0947-415a-8619-0a0ff4bdcedc") : secret "samples-operator-tls" not found Jun 08 19:37:36.030779 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.030753 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:36.040467 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.040443 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vhmw\" (UniqueName: \"kubernetes.io/projected/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-kube-api-access-2vhmw\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:36.040467 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.040459 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk8dp\" (UniqueName: \"kubernetes.io/projected/d1f796d3-db37-40e6-aeda-b4fd5ce7901d-kube-api-access-hk8dp\") pod \"volume-data-source-validator-78dd696465-qs5xk\" (UID: \"d1f796d3-db37-40e6-aeda-b4fd5ce7901d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qs5xk" Jun 08 19:37:36.040606 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.040445 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf8w9\" (UniqueName: \"kubernetes.io/projected/77ec7060-0947-415a-8619-0a0ff4bdcedc-kube-api-access-hf8w9\") pod \"cluster-samples-operator-854f8b96b6-wkq2g\" (UID: \"77ec7060-0947-415a-8619-0a0ff4bdcedc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" Jun 08 19:37:36.058848 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.058824 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:36.114206 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.114181 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:36.128176 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.128149 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qs5xk" Jun 08 19:37:36.130484 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.130460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8kxl\" (UniqueName: \"kubernetes.io/projected/10ebd5b9-45a0-4544-85c3-ad58e61e391b-kube-api-access-q8kxl\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.130573 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.130503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-default-certificate\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.130573 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.130523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.130573 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.130562 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-stats-auth\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.130716 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.130587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.130716 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.130668 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 19:37:36.130716 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.130695 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle podName:10ebd5b9-45a0-4544-85c3-ad58e61e391b nodeName:}" failed. No retries permitted until 2026-06-08 19:37:36.630678669 +0000 UTC m=+258.951851180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle") pod "router-default-668b985f5-m2skx" (UID: "10ebd5b9-45a0-4544-85c3-ad58e61e391b") : configmap references non-existent config key: service-ca.crt Jun 08 19:37:36.130866 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.130723 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs podName:10ebd5b9-45a0-4544-85c3-ad58e61e391b nodeName:}" failed. No retries permitted until 2026-06-08 19:37:36.630707113 +0000 UTC m=+258.951879621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs") pod "router-default-668b985f5-m2skx" (UID: "10ebd5b9-45a0-4544-85c3-ad58e61e391b") : secret "router-metrics-certs-default" not found Jun 08 19:37:36.133008 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.132979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-stats-auth\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.133008 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.132997 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-default-certificate\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.138700 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.138610 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8kxl\" (UniqueName: \"kubernetes.io/projected/10ebd5b9-45a0-4544-85c3-ad58e61e391b-kube-api-access-q8kxl\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.252565 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.252535 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qs5xk"] Jun 08 19:37:36.255647 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:37:36.255623 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f796d3_db37_40e6_aeda_b4fd5ce7901d.slice/crio-12cf8bb73677588fbe53d29b0dd0c5430b256ee320251040b49a683704022c0d WatchSource:0}: Error finding container 12cf8bb73677588fbe53d29b0dd0c5430b256ee320251040b49a683704022c0d: Status 404 returned error can't find the container with id 12cf8bb73677588fbe53d29b0dd0c5430b256ee320251040b49a683704022c0d Jun 08 19:37:36.535108 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.535010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wkq2g\" (UID: \"77ec7060-0947-415a-8619-0a0ff4bdcedc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" Jun 08 19:37:36.535108 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.535090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:36.535338 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.535160 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 19:37:36.535338 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.535197 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 19:37:36.535338 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.535223 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls podName:77ec7060-0947-415a-8619-0a0ff4bdcedc nodeName:}" failed. No retries permitted until 2026-06-08 19:37:37.535207842 +0000 UTC m=+259.856380337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-wkq2g" (UID: "77ec7060-0947-415a-8619-0a0ff4bdcedc") : secret "samples-operator-tls" not found Jun 08 19:37:36.535338 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.535261 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls podName:362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4 nodeName:}" failed. No retries permitted until 2026-06-08 19:37:37.535251343 +0000 UTC m=+259.856423841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rmnjg" (UID: "362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4") : secret "cluster-monitoring-operator-tls" not found Jun 08 19:37:36.636246 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.636188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.636435 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.636255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:36.636435 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.636363 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 19:37:36.636435 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.636382 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle podName:10ebd5b9-45a0-4544-85c3-ad58e61e391b nodeName:}" failed. No retries permitted until 2026-06-08 19:37:37.636365909 +0000 UTC m=+259.957538403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle") pod "router-default-668b985f5-m2skx" (UID: "10ebd5b9-45a0-4544-85c3-ad58e61e391b") : configmap references non-existent config key: service-ca.crt Jun 08 19:37:36.636435 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:36.636426 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs podName:10ebd5b9-45a0-4544-85c3-ad58e61e391b nodeName:}" failed. No retries permitted until 2026-06-08 19:37:37.636408091 +0000 UTC m=+259.957580584 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs") pod "router-default-668b985f5-m2skx" (UID: "10ebd5b9-45a0-4544-85c3-ad58e61e391b") : secret "router-metrics-certs-default" not found Jun 08 19:37:36.810749 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:36.810661 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qs5xk" event={"ID":"d1f796d3-db37-40e6-aeda-b4fd5ce7901d","Type":"ContainerStarted","Data":"12cf8bb73677588fbe53d29b0dd0c5430b256ee320251040b49a683704022c0d"} Jun 08 19:37:37.544428 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:37.544326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:37.544877 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:37.544490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wkq2g\" (UID: \"77ec7060-0947-415a-8619-0a0ff4bdcedc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" Jun 08 19:37:37.544877 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:37.544503 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 19:37:37.544877 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:37.544589 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls podName:362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4 nodeName:}" failed. No retries permitted until 2026-06-08 19:37:39.544565884 +0000 UTC m=+261.865738378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rmnjg" (UID: "362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4") : secret "cluster-monitoring-operator-tls" not found Jun 08 19:37:37.544877 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:37.544604 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 19:37:37.544877 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:37.544644 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls podName:77ec7060-0947-415a-8619-0a0ff4bdcedc nodeName:}" failed. No retries permitted until 2026-06-08 19:37:39.544633022 +0000 UTC m=+261.865805516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-wkq2g" (UID: "77ec7060-0947-415a-8619-0a0ff4bdcedc") : secret "samples-operator-tls" not found Jun 08 19:37:37.645141 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:37.645101 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:37.645327 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:37.645213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:37.645327 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:37.645292 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle podName:10ebd5b9-45a0-4544-85c3-ad58e61e391b nodeName:}" failed. No retries permitted until 2026-06-08 19:37:39.645271462 +0000 UTC m=+261.966443957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle") pod "router-default-668b985f5-m2skx" (UID: "10ebd5b9-45a0-4544-85c3-ad58e61e391b") : configmap references non-existent config key: service-ca.crt Jun 08 19:37:37.645414 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:37.645329 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 19:37:37.645414 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:37.645386 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs podName:10ebd5b9-45a0-4544-85c3-ad58e61e391b nodeName:}" failed. No retries permitted until 2026-06-08 19:37:39.645373859 +0000 UTC m=+261.966546353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs") pod "router-default-668b985f5-m2skx" (UID: "10ebd5b9-45a0-4544-85c3-ad58e61e391b") : secret "router-metrics-certs-default" not found Jun 08 19:37:37.816517 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:37.816420 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qs5xk" event={"ID":"d1f796d3-db37-40e6-aeda-b4fd5ce7901d","Type":"ContainerStarted","Data":"2d3cd0bea2b8d544157a86d5b32d4cc2c9adb275bfb4835cd62b4c07bc3a733f"} Jun 08 19:37:37.833650 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:37.833609 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-qs5xk" podStartSLOduration=1.89351791 podStartE2EDuration="2.833594856s" totalImagesPullingTime="940.076946ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:37:37.832191955 +0000 UTC m=+260.153364471" watchObservedRunningTime="2026-06-08 19:37:37.833594856 +0000 UTC m=+260.154767371" Jun 08 19:37:37.908873 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:37.908841 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:39.559474 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:39.559420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:39.559877 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:39.559586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wkq2g\" (UID: \"77ec7060-0947-415a-8619-0a0ff4bdcedc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" Jun 08 19:37:39.559877 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:39.559586 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 19:37:39.559877 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:39.559627 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 19:37:39.559877 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:39.559683 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls podName:362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4 nodeName:}" failed. No retries permitted until 2026-06-08 19:37:43.559668787 +0000 UTC m=+265.880841282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rmnjg" (UID: "362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4") : secret "cluster-monitoring-operator-tls" not found Jun 08 19:37:39.559877 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:39.559708 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls podName:77ec7060-0947-415a-8619-0a0ff4bdcedc nodeName:}" failed. No retries permitted until 2026-06-08 19:37:43.559692509 +0000 UTC m=+265.880865006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-wkq2g" (UID: "77ec7060-0947-415a-8619-0a0ff4bdcedc") : secret "samples-operator-tls" not found Jun 08 19:37:39.660422 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:39.660380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:39.660422 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:39.660428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:39.660606 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:39.660524 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 19:37:39.660606 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:39.660580 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs podName:10ebd5b9-45a0-4544-85c3-ad58e61e391b nodeName:}" failed. No retries permitted until 2026-06-08 19:37:43.660564964 +0000 UTC m=+265.981737459 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs") pod "router-default-668b985f5-m2skx" (UID: "10ebd5b9-45a0-4544-85c3-ad58e61e391b") : secret "router-metrics-certs-default" not found Jun 08 19:37:39.660606 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:39.660593 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle podName:10ebd5b9-45a0-4544-85c3-ad58e61e391b nodeName:}" failed. No retries permitted until 2026-06-08 19:37:43.660587588 +0000 UTC m=+265.981760083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle") pod "router-default-668b985f5-m2skx" (UID: "10ebd5b9-45a0-4544-85c3-ad58e61e391b") : configmap references non-existent config key: service-ca.crt Jun 08 19:37:41.011938 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:41.011867 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:41.112548 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:41.112512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:41.212010 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:41.211980 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:41.701399 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:41.701369 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:42.140219 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:42.140193 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:42.200509 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:42.200485 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:42.403289 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:42.403194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:42.503992 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:42.503961 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:42.858511 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:42.858432 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:42.954370 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:42.954342 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:43.593240 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:43.593202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:43.593630 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:43.593359 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 19:37:43.593630 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:43.593378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wkq2g\" (UID: \"77ec7060-0947-415a-8619-0a0ff4bdcedc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" Jun 08 19:37:43.593728 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:43.593713 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls podName:362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4 nodeName:}" failed. No retries permitted until 2026-06-08 19:37:51.593684207 +0000 UTC m=+273.914856701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rmnjg" (UID: "362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4") : secret "cluster-monitoring-operator-tls" not found Jun 08 19:37:43.593837 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:43.593813 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 19:37:43.593915 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:43.593904 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls podName:77ec7060-0947-415a-8619-0a0ff4bdcedc nodeName:}" failed. No retries permitted until 2026-06-08 19:37:51.593885312 +0000 UTC m=+273.915057825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-wkq2g" (UID: "77ec7060-0947-415a-8619-0a0ff4bdcedc") : secret "samples-operator-tls" not found Jun 08 19:37:43.694301 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:43.694259 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:43.694465 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:43.694314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:43.694465 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:43.694412 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 19:37:43.694542 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:43.694425 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle podName:10ebd5b9-45a0-4544-85c3-ad58e61e391b nodeName:}" failed. No retries permitted until 2026-06-08 19:37:51.694411018 +0000 UTC m=+274.015583511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle") pod "router-default-668b985f5-m2skx" (UID: "10ebd5b9-45a0-4544-85c3-ad58e61e391b") : configmap references non-existent config key: service-ca.crt Jun 08 19:37:43.694542 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:43.694491 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs podName:10ebd5b9-45a0-4544-85c3-ad58e61e391b nodeName:}" failed. No retries permitted until 2026-06-08 19:37:51.694476317 +0000 UTC m=+274.015648812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs") pod "router-default-668b985f5-m2skx" (UID: "10ebd5b9-45a0-4544-85c3-ad58e61e391b") : secret "router-metrics-certs-default" not found Jun 08 19:37:43.752063 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:43.752039 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k5ngh_2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c/dns-node-resolver/0.log" Jun 08 19:37:44.018878 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.018848 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rd67n"] Jun 08 19:37:44.021971 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.021955 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" Jun 08 19:37:44.025382 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.025360 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 08 19:37:44.026079 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.026060 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4s5ff\"" Jun 08 19:37:44.026132 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.026118 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 08 19:37:44.026223 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.026207 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 08 19:37:44.030149 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.030117 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 08 19:37:44.037661 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.037639 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rd67n"] Jun 08 19:37:44.069505 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.069478 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:44.097777 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.097755 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t6pq\" (UniqueName: \"kubernetes.io/projected/15d401d5-b996-478f-a263-eb272b81a783-kube-api-access-8t6pq\") pod \"service-ca-7d74d578b8-rd67n\" (UID: \"15d401d5-b996-478f-a263-eb272b81a783\") " pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" Jun 08 19:37:44.097913 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.097797 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/15d401d5-b996-478f-a263-eb272b81a783-signing-cabundle\") pod \"service-ca-7d74d578b8-rd67n\" (UID: \"15d401d5-b996-478f-a263-eb272b81a783\") " pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" Jun 08 19:37:44.097913 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.097877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/15d401d5-b996-478f-a263-eb272b81a783-signing-key\") pod \"service-ca-7d74d578b8-rd67n\" (UID: \"15d401d5-b996-478f-a263-eb272b81a783\") " pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" Jun 08 19:37:44.199315 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.199282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t6pq\" (UniqueName: \"kubernetes.io/projected/15d401d5-b996-478f-a263-eb272b81a783-kube-api-access-8t6pq\") pod \"service-ca-7d74d578b8-rd67n\" (UID: \"15d401d5-b996-478f-a263-eb272b81a783\") " pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" Jun 08 19:37:44.199527 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.199505 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/15d401d5-b996-478f-a263-eb272b81a783-signing-cabundle\") pod \"service-ca-7d74d578b8-rd67n\" (UID: \"15d401d5-b996-478f-a263-eb272b81a783\") " pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" Jun 08 19:37:44.199618 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.199602 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/15d401d5-b996-478f-a263-eb272b81a783-signing-key\") pod \"service-ca-7d74d578b8-rd67n\" (UID: \"15d401d5-b996-478f-a263-eb272b81a783\") " pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" Jun 08 19:37:44.200297 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.200268 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/15d401d5-b996-478f-a263-eb272b81a783-signing-cabundle\") pod \"service-ca-7d74d578b8-rd67n\" (UID: \"15d401d5-b996-478f-a263-eb272b81a783\") " pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" Jun 08 19:37:44.201901 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.201882 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/15d401d5-b996-478f-a263-eb272b81a783-signing-key\") pod \"service-ca-7d74d578b8-rd67n\" (UID: \"15d401d5-b996-478f-a263-eb272b81a783\") " pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" Jun 08 19:37:44.209722 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.209703 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t6pq\" (UniqueName: \"kubernetes.io/projected/15d401d5-b996-478f-a263-eb272b81a783-kube-api-access-8t6pq\") pod \"service-ca-7d74d578b8-rd67n\" (UID: \"15d401d5-b996-478f-a263-eb272b81a783\") " pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" Jun 08 19:37:44.331068 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.330969 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" Jun 08 19:37:44.450844 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.450812 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rd67n"] Jun 08 19:37:44.453800 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:37:44.453773 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d401d5_b996_478f_a263_eb272b81a783.slice/crio-51a0c9ba3287afba8eb9dfbe5c28aa2cfa748e6d171916ed254394ceabd28e75 WatchSource:0}: Error finding container 51a0c9ba3287afba8eb9dfbe5c28aa2cfa748e6d171916ed254394ceabd28e75: Status 404 returned error can't find the container with id 51a0c9ba3287afba8eb9dfbe5c28aa2cfa748e6d171916ed254394ceabd28e75 Jun 08 19:37:44.836929 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.836895 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" event={"ID":"15d401d5-b996-478f-a263-eb272b81a783","Type":"ContainerStarted","Data":"51a0c9ba3287afba8eb9dfbe5c28aa2cfa748e6d171916ed254394ceabd28e75"} Jun 08 19:37:44.871779 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:44.871746 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:45.152938 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:45.152910 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wgpqd_ed47d3ee-170c-42a6-913f-b808115fe16b/node-ca/0.log" Jun 08 19:37:45.951522 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:45.951488 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4n9s_7a3537b7-27ae-4d2a-9389-f9781d970489/serve-healthcheck-canary/0.log" Jun 08 19:37:46.844428 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:46.844344 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" event={"ID":"15d401d5-b996-478f-a263-eb272b81a783","Type":"ContainerStarted","Data":"c5291b2f2a5d9f20cf8f9d17f197702ecad099c64447b47367ee20789ee808f8"} Jun 08 19:37:46.860727 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:46.860662 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-rd67n" podStartSLOduration=1.733946899 podStartE2EDuration="3.860642349s" totalImagesPullingTime="2.12669545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:37:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:37:46.86051884 +0000 UTC m=+269.181691357" watchObservedRunningTime="2026-06-08 19:37:46.860642349 +0000 UTC m=+269.181814866" Jun 08 19:37:47.891374 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:47.891345 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:48.365078 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:48.365035 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:48.508069 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:48.508024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:48.608115 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:48.608078 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:48.708757 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:48.708668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:48.761543 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:48.761506 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:49.258330 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:49.258303 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:49.860757 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:49.860695 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:50.264437 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:50.264404 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:50.457804 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:50.457745 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:51.061929 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:51.061861 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:51.259550 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:51.259485 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:51.666982 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:51.666951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wkq2g\" (UID: \"77ec7060-0947-415a-8619-0a0ff4bdcedc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" Jun 08 19:37:51.667371 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:51.667024 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:37:51.667371 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:51.667159 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 19:37:51.667371 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:51.667238 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls podName:362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4 nodeName:}" failed. No retries permitted until 2026-06-08 19:38:07.667209814 +0000 UTC m=+289.988382308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rmnjg" (UID: "362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4") : secret "cluster-monitoring-operator-tls" not found Jun 08 19:37:51.669488 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:51.669459 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77ec7060-0947-415a-8619-0a0ff4bdcedc-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-wkq2g\" (UID: \"77ec7060-0947-415a-8619-0a0ff4bdcedc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" Jun 08 19:37:51.679187 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:51.679138 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:51.741553 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:51.741522 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" Jun 08 19:37:51.767769 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:51.767743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:51.767893 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:51.767798 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:37:51.767961 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:51.767894 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 19:37:51.767961 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:51.767948 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle podName:10ebd5b9-45a0-4544-85c3-ad58e61e391b nodeName:}" failed. No retries permitted until 2026-06-08 19:38:07.767928543 +0000 UTC m=+290.089101037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle") pod "router-default-668b985f5-m2skx" (UID: "10ebd5b9-45a0-4544-85c3-ad58e61e391b") : configmap references non-existent config key: service-ca.crt Jun 08 19:37:51.768052 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:37:51.767972 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs podName:10ebd5b9-45a0-4544-85c3-ad58e61e391b nodeName:}" failed. No retries permitted until 2026-06-08 19:38:07.767961902 +0000 UTC m=+290.089134396 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs") pod "router-default-668b985f5-m2skx" (UID: "10ebd5b9-45a0-4544-85c3-ad58e61e391b") : secret "router-metrics-certs-default" not found Jun 08 19:37:51.861397 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:51.861356 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:51.875385 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:51.875355 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g"] Jun 08 19:37:52.060153 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:52.060110 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:52.256496 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:52.256380 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:52.330756 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:52.330721 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:52.702215 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:52.702180 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:52.864779 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:52.864743 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" event={"ID":"77ec7060-0947-415a-8619-0a0ff4bdcedc","Type":"ContainerStarted","Data":"576ed307774ad19b55022e4dc495b809c22e4b63597b84c36589930f481f615b"} Jun 08 19:37:53.071688 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:53.071589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:53.463881 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:53.463850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:53.860259 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:53.860197 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:54.103268 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:54.103173 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:54.264030 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:54.263987 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:54.669891 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:54.669856 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:54.735132 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:54.735072 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:54.865182 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:54.865149 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:54.873942 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:54.873914 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" event={"ID":"77ec7060-0947-415a-8619-0a0ff4bdcedc","Type":"ContainerStarted","Data":"dd2d303ce671c4be99c217b4e282d5a4951d6ea141ef880fe835d4de77aba043"} Jun 08 19:37:54.874072 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:54.873970 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" event={"ID":"77ec7060-0947-415a-8619-0a0ff4bdcedc","Type":"ContainerStarted","Data":"6e69139ffdd5be2d821397e335c254d6be08616905a8892d4f73d2c3e537316d"} Jun 08 19:37:54.891704 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:54.891654 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-wkq2g" podStartSLOduration=17.994264391 podStartE2EDuration="19.891638072s" totalImagesPullingTime="1.897373681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:37:54.890345535 +0000 UTC m=+277.211518052" watchObservedRunningTime="2026-06-08 19:37:54.891638072 +0000 UTC m=+277.212810587" Jun 08 19:37:55.481580 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:55.481531 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:55.626273 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:55.626223 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:55.726679 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:55.726643 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:55.859742 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:55.859639 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:56.062575 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:56.062525 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:56.462463 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:56.462431 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:57.063560 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:57.063520 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:57.657500 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:57.657467 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:57.865107 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:57.865075 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:58.062637 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:58.062526 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:58.461908 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:58.461870 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:58.861489 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:58.861385 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:37:59.067613 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:37:59.067562 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:00.582952 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:38:00.582896 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" podUID="a1bc57ce-1262-48c0-abc8-105e94f58ccf" Jun 08 19:38:00.582952 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:38:00.582896 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-twfxs" podUID="978c7936-1cc3-4978-b11e-6d67d174c107" Jun 08 19:38:00.583416 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:38:00.582896 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" podUID="9a53f856-c42c-4d5d-9d1e-aa93d293874c" Jun 08 19:38:00.892135 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:00.892107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:38:00.892338 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:00.892107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:38:00.892338 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:00.892116 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-twfxs" Jun 08 19:38:01.777732 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:01.777701 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:04.164720 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.164679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:38:04.164720 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.164724 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:38:04.165305 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.164794 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:38:04.167155 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.167128 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") pod \"image-registry-65fcbb6b89-68qxv\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:38:04.167496 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.167476 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978c7936-1cc3-4978-b11e-6d67d174c107-metrics-tls\") pod \"dns-default-twfxs\" (UID: \"978c7936-1cc3-4978-b11e-6d67d174c107\") " pod="openshift-dns/dns-default-twfxs" Jun 08 19:38:04.167576 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.167555 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a53f856-c42c-4d5d-9d1e-aa93d293874c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-blblx\" (UID: \"9a53f856-c42c-4d5d-9d1e-aa93d293874c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:38:04.196772 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.196746 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ggvbh\"" Jun 08 19:38:04.196772 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.196766 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2dhx6\"" Jun 08 19:38:04.196931 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.196767 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dhlvj\"" Jun 08 19:38:04.203935 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.203916 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:38:04.204011 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.203942 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" Jun 08 19:38:04.204072 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.204014 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-twfxs" Jun 08 19:38:04.353010 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.352983 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-twfxs"] Jun 08 19:38:04.355780 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:38:04.355752 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978c7936_1cc3_4978_b11e_6d67d174c107.slice/crio-e365381f195038f82cbb0aef585180da8852f2d9c2febfad28f7f1b31843a81d WatchSource:0}: Error finding container e365381f195038f82cbb0aef585180da8852f2d9c2febfad28f7f1b31843a81d: Status 404 returned error can't find the container with id e365381f195038f82cbb0aef585180da8852f2d9c2febfad28f7f1b31843a81d Jun 08 19:38:04.576170 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.576097 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-blblx"] Jun 08 19:38:04.578997 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:38:04.578949 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a53f856_c42c_4d5d_9d1e_aa93d293874c.slice/crio-b5799fd3cb9ebcc6fae945d9e9f745fd5a0b141bb5e2d56ea0401afdf7620725 WatchSource:0}: Error finding container b5799fd3cb9ebcc6fae945d9e9f745fd5a0b141bb5e2d56ea0401afdf7620725: Status 404 returned error can't find the container with id b5799fd3cb9ebcc6fae945d9e9f745fd5a0b141bb5e2d56ea0401afdf7620725 Jun 08 19:38:04.580283 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.580254 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65fcbb6b89-68qxv"] Jun 08 19:38:04.585916 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:38:04.585891 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1bc57ce_1262_48c0_abc8_105e94f58ccf.slice/crio-5f961c38bc102e3e320e5da386c5ff9a11333cb974316211d65f75b7252a8de5 WatchSource:0}: Error finding container 5f961c38bc102e3e320e5da386c5ff9a11333cb974316211d65f75b7252a8de5: Status 404 returned error can't find the container with id 5f961c38bc102e3e320e5da386c5ff9a11333cb974316211d65f75b7252a8de5 Jun 08 19:38:04.913357 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.913314 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-twfxs" event={"ID":"978c7936-1cc3-4978-b11e-6d67d174c107","Type":"ContainerStarted","Data":"e365381f195038f82cbb0aef585180da8852f2d9c2febfad28f7f1b31843a81d"} Jun 08 19:38:04.914785 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.914751 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" event={"ID":"9a53f856-c42c-4d5d-9d1e-aa93d293874c","Type":"ContainerStarted","Data":"b5799fd3cb9ebcc6fae945d9e9f745fd5a0b141bb5e2d56ea0401afdf7620725"} Jun 08 19:38:04.916343 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.916287 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" event={"ID":"a1bc57ce-1262-48c0-abc8-105e94f58ccf","Type":"ContainerStarted","Data":"60eb71a3042f954bf972ac14dc2ca63ea30c6f9e14cf47bc0ff0164df050cd96"} Jun 08 19:38:04.916343 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.916336 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" event={"ID":"a1bc57ce-1262-48c0-abc8-105e94f58ccf","Type":"ContainerStarted","Data":"5f961c38bc102e3e320e5da386c5ff9a11333cb974316211d65f75b7252a8de5"} Jun 08 19:38:04.916622 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.916598 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:38:04.941430 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:04.941371 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" podStartSLOduration=286.941351349 podStartE2EDuration="4m46.941351349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:33:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:04.939221599 +0000 UTC m=+287.260394117" watchObservedRunningTime="2026-06-08 19:38:04.941351349 +0000 UTC m=+287.262523866" Jun 08 19:38:05.922103 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:05.922068 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" event={"ID":"9a53f856-c42c-4d5d-9d1e-aa93d293874c","Type":"ContainerStarted","Data":"51edf7d8fb3795eb301df64a87cdb9b8e510d98f3ec6d5c672423a931e610b53"} Jun 08 19:38:05.939071 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:05.939012 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-blblx" podStartSLOduration=255.78571371 podStartE2EDuration="4m16.938989364s" totalImagesPullingTime="1.153275654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:05.93756368 +0000 UTC m=+288.258736196" watchObservedRunningTime="2026-06-08 19:38:05.938989364 +0000 UTC m=+288.260161887" Jun 08 19:38:06.926780 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:06.926744 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-twfxs" event={"ID":"978c7936-1cc3-4978-b11e-6d67d174c107","Type":"ContainerStarted","Data":"5ce96cb1d2e8210eeeed53c9ad9d3fe0089015dbe1e0bc7dcd3ccdce77fc4bfc"} Jun 08 19:38:06.927318 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:06.926797 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-twfxs" event={"ID":"978c7936-1cc3-4978-b11e-6d67d174c107","Type":"ContainerStarted","Data":"5389f133c80dc6d9f0676067b840e19b56c81c6350ebd1cf85c9be3ee59d3b64"} Jun 08 19:38:06.947315 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:06.947269 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-twfxs" podStartSLOduration=251.008874391 podStartE2EDuration="4m12.947253411s" totalImagesPullingTime="1.93837902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:06.946673677 +0000 UTC m=+289.267846193" watchObservedRunningTime="2026-06-08 19:38:06.947253411 +0000 UTC m=+289.268425924" Jun 08 19:38:07.597894 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.597860 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:07.615334 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.615305 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t8tmq"] Jun 08 19:38:07.618809 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.618788 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.621485 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.621464 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 19:38:07.621598 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.621523 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 19:38:07.622586 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.622565 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 19:38:07.622692 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.622586 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 19:38:07.622692 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.622641 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r78hc\"" Jun 08 19:38:07.631605 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.631585 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t8tmq"] Jun 08 19:38:07.691777 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.691747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:38:07.691916 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.691786 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/15d521b7-f984-4e11-8899-ff3e26cb9b25-data-volume\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.691916 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.691809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs9zv\" (UniqueName: \"kubernetes.io/projected/15d521b7-f984-4e11-8899-ff3e26cb9b25-kube-api-access-hs9zv\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.692023 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.691920 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/15d521b7-f984-4e11-8899-ff3e26cb9b25-crio-socket\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.692023 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.691950 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/15d521b7-f984-4e11-8899-ff3e26cb9b25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.692023 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.691977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/15d521b7-f984-4e11-8899-ff3e26cb9b25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.692678 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.692650 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:07.694133 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.694107 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rmnjg\" (UID: \"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:38:07.793350 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.793315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/15d521b7-f984-4e11-8899-ff3e26cb9b25-data-volume\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.793536 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.793367 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs9zv\" (UniqueName: \"kubernetes.io/projected/15d521b7-f984-4e11-8899-ff3e26cb9b25-kube-api-access-hs9zv\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.793536 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.793402 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:38:07.793536 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.793454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:38:07.793536 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.793495 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/15d521b7-f984-4e11-8899-ff3e26cb9b25-crio-socket\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.793536 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.793528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/15d521b7-f984-4e11-8899-ff3e26cb9b25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.793768 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.793558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/15d521b7-f984-4e11-8899-ff3e26cb9b25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.793768 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.793589 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/15d521b7-f984-4e11-8899-ff3e26cb9b25-crio-socket\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.793768 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.793638 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/15d521b7-f984-4e11-8899-ff3e26cb9b25-data-volume\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.794171 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.794153 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10ebd5b9-45a0-4544-85c3-ad58e61e391b-service-ca-bundle\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:38:07.794257 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.794185 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/15d521b7-f984-4e11-8899-ff3e26cb9b25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.796562 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.796540 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/15d521b7-f984-4e11-8899-ff3e26cb9b25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.796675 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.796570 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10ebd5b9-45a0-4544-85c3-ad58e61e391b-metrics-certs\") pod \"router-default-668b985f5-m2skx\" (UID: \"10ebd5b9-45a0-4544-85c3-ad58e61e391b\") " pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:38:07.801352 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.801335 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs9zv\" (UniqueName: \"kubernetes.io/projected/15d521b7-f984-4e11-8899-ff3e26cb9b25-kube-api-access-hs9zv\") pod \"insights-runtime-extractor-t8tmq\" (UID: \"15d521b7-f984-4e11-8899-ff3e26cb9b25\") " pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.927479 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.927451 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t8tmq" Jun 08 19:38:07.930221 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.930201 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-twfxs" Jun 08 19:38:07.936467 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:07.936444 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" Jun 08 19:38:08.023662 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:08.023637 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:38:08.069107 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:08.069071 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t8tmq"] Jun 08 19:38:08.073243 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:38:08.073202 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d521b7_f984_4e11_8899_ff3e26cb9b25.slice/crio-4aba3897777c3a2534341e9213c768fbd62969bae11ec99dd08b50d19077274d WatchSource:0}: Error finding container 4aba3897777c3a2534341e9213c768fbd62969bae11ec99dd08b50d19077274d: Status 404 returned error can't find the container with id 4aba3897777c3a2534341e9213c768fbd62969bae11ec99dd08b50d19077274d Jun 08 19:38:08.086636 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:08.086612 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg"] Jun 08 19:38:08.171022 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:08.170997 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-668b985f5-m2skx"] Jun 08 19:38:08.173044 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:38:08.173012 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ebd5b9_45a0_4544_85c3_ad58e61e391b.slice/crio-ad2c88fa7fd79b333350bc282929582aa19a2dca62117d55d01bc32f61bb94d1 WatchSource:0}: Error finding container ad2c88fa7fd79b333350bc282929582aa19a2dca62117d55d01bc32f61bb94d1: Status 404 returned error can't find the container with id ad2c88fa7fd79b333350bc282929582aa19a2dca62117d55d01bc32f61bb94d1 Jun 08 19:38:08.934285 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:08.934246 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" event={"ID":"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4","Type":"ContainerStarted","Data":"969df506d385cf02fd866e62e152180daee57f3486eaf166ab2dec4dd41c6bf8"} Jun 08 19:38:08.935965 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:08.935937 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8tmq" event={"ID":"15d521b7-f984-4e11-8899-ff3e26cb9b25","Type":"ContainerStarted","Data":"f33d2f48b732439ec3926cbcffcde30cac51eb5a127f8b063a2d45342312a1c4"} Jun 08 19:38:08.936084 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:08.935989 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8tmq" event={"ID":"15d521b7-f984-4e11-8899-ff3e26cb9b25","Type":"ContainerStarted","Data":"b9605d3d09508adb91ab824b2c7f4681acb64bec231a3571e88d78408e1828af"} Jun 08 19:38:08.936084 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:08.936009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8tmq" event={"ID":"15d521b7-f984-4e11-8899-ff3e26cb9b25","Type":"ContainerStarted","Data":"4aba3897777c3a2534341e9213c768fbd62969bae11ec99dd08b50d19077274d"} Jun 08 19:38:08.937333 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:08.937306 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-668b985f5-m2skx" event={"ID":"10ebd5b9-45a0-4544-85c3-ad58e61e391b","Type":"ContainerStarted","Data":"bf330b108f782804bdc041dac180eed27f967fef7a9f9b969417687cd9d095fe"} Jun 08 19:38:08.937445 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:08.937351 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-668b985f5-m2skx" event={"ID":"10ebd5b9-45a0-4544-85c3-ad58e61e391b","Type":"ContainerStarted","Data":"ad2c88fa7fd79b333350bc282929582aa19a2dca62117d55d01bc32f61bb94d1"} Jun 08 19:38:08.957444 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:08.957402 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-668b985f5-m2skx" podStartSLOduration=33.957388188 podStartE2EDuration="33.957388188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:37:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:08.955890425 +0000 UTC m=+291.277062970" watchObservedRunningTime="2026-06-08 19:38:08.957388188 +0000 UTC m=+291.278560698" Jun 08 19:38:09.024313 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:09.024247 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:38:09.026957 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:09.026933 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:38:09.941598 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:09.941553 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:38:09.943415 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:09.943389 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-668b985f5-m2skx" Jun 08 19:38:10.853150 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:10.853067 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:10.947297 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:10.947265 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8tmq" event={"ID":"15d521b7-f984-4e11-8899-ff3e26cb9b25","Type":"ContainerStarted","Data":"487f9dc65df22934bf2cef06dc80ce3893bfe067d1de38f574e552eab9059500"} Jun 08 19:38:10.953371 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:10.953336 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" event={"ID":"362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4","Type":"ContainerStarted","Data":"b6db00e76f51c759de9f74ea5ee5c97f5012536f7a968add4d66a41f9087556f"} Jun 08 19:38:10.954475 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:10.954452 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:10.967878 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:10.967823 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t8tmq" podStartSLOduration=1.648614753 podStartE2EDuration="3.967801809s" totalImagesPullingTime="2.319187056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:38:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:10.967035752 +0000 UTC m=+293.288208269" watchObservedRunningTime="2026-06-08 19:38:10.967801809 +0000 UTC m=+293.288974326" Jun 08 19:38:10.987322 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:10.987267 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rmnjg" podStartSLOduration=33.55679076 podStartE2EDuration="35.987252303s" totalImagesPullingTime="2.430461543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:10.985994042 +0000 UTC m=+293.307166557" watchObservedRunningTime="2026-06-08 19:38:10.987252303 +0000 UTC m=+293.308424818" Jun 08 19:38:11.028766 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:11.028740 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:11.361748 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:11.361702 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:13.091628 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:38:13.091583 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n6d4n" podUID="7bb7542c-5411-4674-ae66-49f2a63958c0" Jun 08 19:38:14.039406 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.039365 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:14.069189 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.069158 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-jw94v"] Jun 08 19:38:14.074896 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.074878 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.077312 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.077294 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 08 19:38:14.077479 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.077445 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 08 19:38:14.078590 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.078575 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 19:38:14.078652 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.078622 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7qxlf\"" Jun 08 19:38:14.082031 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.082010 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-jw94v"] Jun 08 19:38:14.103300 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.103268 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:14.144442 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.144402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72c19e4a-97fb-415d-9299-9930e4a88ee8-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-jw94v\" (UID: \"72c19e4a-97fb-415d-9299-9930e4a88ee8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.144612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.144468 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/72c19e4a-97fb-415d-9299-9930e4a88ee8-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-jw94v\" (UID: \"72c19e4a-97fb-415d-9299-9930e4a88ee8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.144612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.144491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72c19e4a-97fb-415d-9299-9930e4a88ee8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-jw94v\" (UID: \"72c19e4a-97fb-415d-9299-9930e4a88ee8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.144612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.144544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g5sp\" (UniqueName: \"kubernetes.io/projected/72c19e4a-97fb-415d-9299-9930e4a88ee8-kube-api-access-2g5sp\") pod \"prometheus-operator-7f7d445d84-jw94v\" (UID: \"72c19e4a-97fb-415d-9299-9930e4a88ee8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.232245 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.232196 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:14.245858 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.245833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/72c19e4a-97fb-415d-9299-9930e4a88ee8-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-jw94v\" (UID: \"72c19e4a-97fb-415d-9299-9930e4a88ee8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.245973 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.245868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72c19e4a-97fb-415d-9299-9930e4a88ee8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-jw94v\" (UID: \"72c19e4a-97fb-415d-9299-9930e4a88ee8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.245973 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.245919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g5sp\" (UniqueName: \"kubernetes.io/projected/72c19e4a-97fb-415d-9299-9930e4a88ee8-kube-api-access-2g5sp\") pod \"prometheus-operator-7f7d445d84-jw94v\" (UID: \"72c19e4a-97fb-415d-9299-9930e4a88ee8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.246097 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.246074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72c19e4a-97fb-415d-9299-9930e4a88ee8-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-jw94v\" (UID: \"72c19e4a-97fb-415d-9299-9930e4a88ee8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.246709 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.246688 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72c19e4a-97fb-415d-9299-9930e4a88ee8-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-jw94v\" (UID: \"72c19e4a-97fb-415d-9299-9930e4a88ee8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.248319 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.248291 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72c19e4a-97fb-415d-9299-9930e4a88ee8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-jw94v\" (UID: \"72c19e4a-97fb-415d-9299-9930e4a88ee8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.248483 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.248463 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/72c19e4a-97fb-415d-9299-9930e4a88ee8-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-jw94v\" (UID: \"72c19e4a-97fb-415d-9299-9930e4a88ee8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.254410 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.254383 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g5sp\" (UniqueName: \"kubernetes.io/projected/72c19e4a-97fb-415d-9299-9930e4a88ee8-kube-api-access-2g5sp\") pod \"prometheus-operator-7f7d445d84-jw94v\" (UID: \"72c19e4a-97fb-415d-9299-9930e4a88ee8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.384865 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.384821 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" Jun 08 19:38:14.514026 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.513995 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-jw94v"] Jun 08 19:38:14.517057 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:38:14.517033 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c19e4a_97fb_415d_9299_9930e4a88ee8.slice/crio-5d8e7070eb2acf2d407fd87d466c14c0fa17208c46e07fbe056b25f51fc45f59 WatchSource:0}: Error finding container 5d8e7070eb2acf2d407fd87d466c14c0fa17208c46e07fbe056b25f51fc45f59: Status 404 returned error can't find the container with id 5d8e7070eb2acf2d407fd87d466c14c0fa17208c46e07fbe056b25f51fc45f59 Jun 08 19:38:14.968859 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:14.968819 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" event={"ID":"72c19e4a-97fb-415d-9299-9930e4a88ee8","Type":"ContainerStarted","Data":"5d8e7070eb2acf2d407fd87d466c14c0fa17208c46e07fbe056b25f51fc45f59"} Jun 08 19:38:15.974008 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:15.973973 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" event={"ID":"72c19e4a-97fb-415d-9299-9930e4a88ee8","Type":"ContainerStarted","Data":"356b8b446a4407f8ece0af984252eea64357af204b21941e89ff554aaf795100"} Jun 08 19:38:15.974476 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:15.974029 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" event={"ID":"72c19e4a-97fb-415d-9299-9930e4a88ee8","Type":"ContainerStarted","Data":"217bd86e999885276e17412242251feac25336f8e64967589337f0c692625ef1"} Jun 08 19:38:15.991535 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:15.991440 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-jw94v" podStartSLOduration=0.777517556 podStartE2EDuration="1.991421647s" totalImagesPullingTime="1.213904091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:15.989634082 +0000 UTC m=+298.310806599" watchObservedRunningTime="2026-06-08 19:38:15.991421647 +0000 UTC m=+298.312594170" Jun 08 19:38:16.000243 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:16.000201 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:17.169614 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.169584 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:17.354702 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.354669 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:17.366349 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.366316 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv"] Jun 08 19:38:17.372247 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.372213 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.375185 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.375153 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 19:38:17.375358 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.375253 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 19:38:17.375488 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.375272 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dgslq\"" Jun 08 19:38:17.381253 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.380051 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv"] Jun 08 19:38:17.397385 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.397365 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d"] Jun 08 19:38:17.401992 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.401972 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.404431 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.404410 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 08 19:38:17.404535 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.404506 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-67h55\"" Jun 08 19:38:17.404837 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.404821 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 08 19:38:17.404919 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.404855 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 08 19:38:17.409313 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.409292 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mnngm"] Jun 08 19:38:17.412795 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.412778 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.413516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.412894 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d"] Jun 08 19:38:17.415284 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.415265 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 19:38:17.415644 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.415629 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 19:38:17.415873 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.415705 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 19:38:17.416870 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.416852 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w8xp7\"" Jun 08 19:38:17.436330 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.436307 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:17.472773 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.472740 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46c79951-8e49-49d3-9f15-f16c4bce5a8b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hf4lv\" (UID: \"46c79951-8e49-49d3-9f15-f16c4bce5a8b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.472773 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.472778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6bdad326-ff55-4df2-9ee6-e641040484c3-root\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.472988 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.472858 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmfqh\" (UniqueName: \"kubernetes.io/projected/3d5be899-73db-44f2-98b8-7ab1c7437a37-kube-api-access-qmfqh\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.472988 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.472889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-tls\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.472988 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.472934 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-textfile\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.472988 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.472958 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d5be899-73db-44f2-98b8-7ab1c7437a37-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.472988 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.472981 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-wtmp\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.473144 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.472996 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bdad326-ff55-4df2-9ee6-e641040484c3-metrics-client-ca\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.473144 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.473012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr5q2\" (UniqueName: \"kubernetes.io/projected/6bdad326-ff55-4df2-9ee6-e641040484c3-kube-api-access-fr5q2\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.473144 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.473064 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d5be899-73db-44f2-98b8-7ab1c7437a37-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.473247 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.473143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-accelerators-collector-config\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.473247 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.473172 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d5be899-73db-44f2-98b8-7ab1c7437a37-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.473247 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.473194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46c79951-8e49-49d3-9f15-f16c4bce5a8b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hf4lv\" (UID: \"46c79951-8e49-49d3-9f15-f16c4bce5a8b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.473247 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.473219 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.473375 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.473270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzj7z\" (UniqueName: \"kubernetes.io/projected/46c79951-8e49-49d3-9f15-f16c4bce5a8b-kube-api-access-lzj7z\") pod \"openshift-state-metrics-65f78d5c66-hf4lv\" (UID: \"46c79951-8e49-49d3-9f15-f16c4bce5a8b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.473375 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.473296 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bdad326-ff55-4df2-9ee6-e641040484c3-sys\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.473375 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.473328 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d5be899-73db-44f2-98b8-7ab1c7437a37-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.473375 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.473365 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d5be899-73db-44f2-98b8-7ab1c7437a37-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.473494 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.473389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46c79951-8e49-49d3-9f15-f16c4bce5a8b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hf4lv\" (UID: \"46c79951-8e49-49d3-9f15-f16c4bce5a8b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.501903 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.501874 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:17.573980 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.573941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfqh\" (UniqueName: \"kubernetes.io/projected/3d5be899-73db-44f2-98b8-7ab1c7437a37-kube-api-access-qmfqh\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.573980 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.573988 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-tls\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.574291 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574018 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-textfile\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.574291 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574056 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d5be899-73db-44f2-98b8-7ab1c7437a37-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.574291 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574083 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-wtmp\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.574291 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bdad326-ff55-4df2-9ee6-e641040484c3-metrics-client-ca\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.574291 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr5q2\" (UniqueName: \"kubernetes.io/projected/6bdad326-ff55-4df2-9ee6-e641040484c3-kube-api-access-fr5q2\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.574291 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d5be899-73db-44f2-98b8-7ab1c7437a37-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.574291 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-accelerators-collector-config\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.574291 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d5be899-73db-44f2-98b8-7ab1c7437a37-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.574291 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574276 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46c79951-8e49-49d3-9f15-f16c4bce5a8b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hf4lv\" (UID: \"46c79951-8e49-49d3-9f15-f16c4bce5a8b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.574747 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.574747 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzj7z\" (UniqueName: \"kubernetes.io/projected/46c79951-8e49-49d3-9f15-f16c4bce5a8b-kube-api-access-lzj7z\") pod \"openshift-state-metrics-65f78d5c66-hf4lv\" (UID: \"46c79951-8e49-49d3-9f15-f16c4bce5a8b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.574747 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bdad326-ff55-4df2-9ee6-e641040484c3-sys\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.574747 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574376 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-wtmp\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.574747 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d5be899-73db-44f2-98b8-7ab1c7437a37-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.574747 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d5be899-73db-44f2-98b8-7ab1c7437a37-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.574747 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46c79951-8e49-49d3-9f15-f16c4bce5a8b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hf4lv\" (UID: \"46c79951-8e49-49d3-9f15-f16c4bce5a8b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.574747 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574522 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46c79951-8e49-49d3-9f15-f16c4bce5a8b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hf4lv\" (UID: \"46c79951-8e49-49d3-9f15-f16c4bce5a8b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.574747 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6bdad326-ff55-4df2-9ee6-e641040484c3-root\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.574747 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.574634 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6bdad326-ff55-4df2-9ee6-e641040484c3-root\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.574747 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:38:17.574724 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 08 19:38:17.575324 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:38:17.574793 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-tls podName:6bdad326-ff55-4df2-9ee6-e641040484c3 nodeName:}" failed. No retries permitted until 2026-06-08 19:38:18.074772277 +0000 UTC m=+300.395944771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-tls") pod "node-exporter-mnngm" (UID: "6bdad326-ff55-4df2-9ee6-e641040484c3") : secret "node-exporter-tls" not found Jun 08 19:38:17.575324 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.575166 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46c79951-8e49-49d3-9f15-f16c4bce5a8b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hf4lv\" (UID: \"46c79951-8e49-49d3-9f15-f16c4bce5a8b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.575324 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.575200 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d5be899-73db-44f2-98b8-7ab1c7437a37-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.575324 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.575272 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-textfile\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.575670 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.575634 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bdad326-ff55-4df2-9ee6-e641040484c3-sys\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.575782 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.575725 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bdad326-ff55-4df2-9ee6-e641040484c3-metrics-client-ca\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.575782 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.575733 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d5be899-73db-44f2-98b8-7ab1c7437a37-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.576074 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.576051 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d5be899-73db-44f2-98b8-7ab1c7437a37-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.576189 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.576165 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-accelerators-collector-config\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.578304 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.578278 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46c79951-8e49-49d3-9f15-f16c4bce5a8b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hf4lv\" (UID: \"46c79951-8e49-49d3-9f15-f16c4bce5a8b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.578395 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.578325 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46c79951-8e49-49d3-9f15-f16c4bce5a8b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hf4lv\" (UID: \"46c79951-8e49-49d3-9f15-f16c4bce5a8b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.578570 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.578551 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.578744 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.578725 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d5be899-73db-44f2-98b8-7ab1c7437a37-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.578816 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.578796 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d5be899-73db-44f2-98b8-7ab1c7437a37-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.582970 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.582945 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzj7z\" (UniqueName: \"kubernetes.io/projected/46c79951-8e49-49d3-9f15-f16c4bce5a8b-kube-api-access-lzj7z\") pod \"openshift-state-metrics-65f78d5c66-hf4lv\" (UID: \"46c79951-8e49-49d3-9f15-f16c4bce5a8b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.583618 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.583598 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmfqh\" (UniqueName: \"kubernetes.io/projected/3d5be899-73db-44f2-98b8-7ab1c7437a37-kube-api-access-qmfqh\") pod \"kube-state-metrics-57bbf8bfb5-8ll4d\" (UID: \"3d5be899-73db-44f2-98b8-7ab1c7437a37\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.584382 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.584353 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr5q2\" (UniqueName: \"kubernetes.io/projected/6bdad326-ff55-4df2-9ee6-e641040484c3-kube-api-access-fr5q2\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:17.598617 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.598589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:17.686461 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.686377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" Jun 08 19:38:17.699638 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.699607 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:17.714983 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.714953 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" Jun 08 19:38:17.799767 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.799685 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:17.838167 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.838136 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv"] Jun 08 19:38:17.841115 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:38:17.841085 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c79951_8e49_49d3_9f15_f16c4bce5a8b.slice/crio-fce0653f4c699dc3b76390cc27e64ed069993c5b13e0dc71c1c75417391cccc0 WatchSource:0}: Error finding container fce0653f4c699dc3b76390cc27e64ed069993c5b13e0dc71c1c75417391cccc0: Status 404 returned error can't find the container with id fce0653f4c699dc3b76390cc27e64ed069993c5b13e0dc71c1c75417391cccc0 Jun 08 19:38:17.857294 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.857269 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d"] Jun 08 19:38:17.861518 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:38:17.861495 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5be899_73db_44f2_98b8_7ab1c7437a37.slice/crio-d8ef4756d7a7e071ce55c7ff876d79f23c34a7888249590d6542ced88387e01a WatchSource:0}: Error finding container d8ef4756d7a7e071ce55c7ff876d79f23c34a7888249590d6542ced88387e01a: Status 404 returned error can't find the container with id d8ef4756d7a7e071ce55c7ff876d79f23c34a7888249590d6542ced88387e01a Jun 08 19:38:17.940483 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.940459 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-twfxs" Jun 08 19:38:17.986458 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.986429 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" event={"ID":"46c79951-8e49-49d3-9f15-f16c4bce5a8b","Type":"ContainerStarted","Data":"bbe52ee50951b94bd45c0345d5a567533f38b2d2fdddc852bc23126cd6613a24"} Jun 08 19:38:17.986573 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.986499 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" event={"ID":"46c79951-8e49-49d3-9f15-f16c4bce5a8b","Type":"ContainerStarted","Data":"81358e11688f2364d3cde075330337f62fc9eb35ae34f1e921e27f0df8d20d16"} Jun 08 19:38:17.986573 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.986528 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" event={"ID":"46c79951-8e49-49d3-9f15-f16c4bce5a8b","Type":"ContainerStarted","Data":"fce0653f4c699dc3b76390cc27e64ed069993c5b13e0dc71c1c75417391cccc0"} Jun 08 19:38:17.987871 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:17.987835 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" event={"ID":"3d5be899-73db-44f2-98b8-7ab1c7437a37","Type":"ContainerStarted","Data":"d8ef4756d7a7e071ce55c7ff876d79f23c34a7888249590d6542ced88387e01a"} Jun 08 19:38:18.045995 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:18.045966 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gj6rg_d241132c-eb3a-4381-8b55-ebec819c514f/ovn-acl-logging/0.log" Jun 08 19:38:18.048804 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:18.048775 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gj6rg_d241132c-eb3a-4381-8b55-ebec819c514f/ovn-acl-logging/0.log" Jun 08 19:38:18.052717 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:18.052694 2579 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 19:38:18.079046 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:18.078919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-tls\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:18.101048 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:18.081182 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6bdad326-ff55-4df2-9ee6-e641040484c3-node-exporter-tls\") pod \"node-exporter-mnngm\" (UID: \"6bdad326-ff55-4df2-9ee6-e641040484c3\") " pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:18.289992 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:18.289913 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:18.328265 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:18.328216 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w8xp7\"" Jun 08 19:38:18.336223 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:18.336195 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mnngm" Jun 08 19:38:18.349469 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:38:18.349440 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bdad326_ff55_4df2_9ee6_e641040484c3.slice/crio-24f09b2f5dac88c22690a64d16f9db50102860f3806d902dc46d1f5976e14307 WatchSource:0}: Error finding container 24f09b2f5dac88c22690a64d16f9db50102860f3806d902dc46d1f5976e14307: Status 404 returned error can't find the container with id 24f09b2f5dac88c22690a64d16f9db50102860f3806d902dc46d1f5976e14307 Jun 08 19:38:18.394278 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:18.394216 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:18.461060 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:18.460986 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:18.994097 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:18.994056 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mnngm" event={"ID":"6bdad326-ff55-4df2-9ee6-e641040484c3","Type":"ContainerStarted","Data":"24f09b2f5dac88c22690a64d16f9db50102860f3806d902dc46d1f5976e14307"} Jun 08 19:38:20.000007 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:19.999966 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" event={"ID":"3d5be899-73db-44f2-98b8-7ab1c7437a37","Type":"ContainerStarted","Data":"9c3ae53accfef3c7ad000f21beecfeca664a753a1b4fd4d85e5164f5be123a7e"} Jun 08 19:38:20.000509 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.000036 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" event={"ID":"3d5be899-73db-44f2-98b8-7ab1c7437a37","Type":"ContainerStarted","Data":"14a16b5920e9257bc29b5331dfeae51814ffa556954a05e0f4e2b957965642af"} Jun 08 19:38:20.000509 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.000068 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" event={"ID":"3d5be899-73db-44f2-98b8-7ab1c7437a37","Type":"ContainerStarted","Data":"8068a5ef25747175bcda633fc6323fd8f1a912b24208f8af14551fe211315048"} Jun 08 19:38:20.002246 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.002199 2579 generic.go:356] "Generic (PLEG): container finished" podID="6bdad326-ff55-4df2-9ee6-e641040484c3" containerID="4866d21df9bd59ded0a42533721916ae474e7c00dff13d710ff6ac8497966b08" exitCode=0 Jun 08 19:38:20.007297 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.002418 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mnngm" event={"ID":"6bdad326-ff55-4df2-9ee6-e641040484c3","Type":"ContainerDied","Data":"4866d21df9bd59ded0a42533721916ae474e7c00dff13d710ff6ac8497966b08"} Jun 08 19:38:20.008887 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.008844 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" event={"ID":"46c79951-8e49-49d3-9f15-f16c4bce5a8b","Type":"ContainerStarted","Data":"983753a970dcf20eda9e2adc93d1b8c1ca8372ebcfb4ebbfd30ff9694a74786b"} Jun 08 19:38:20.023189 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.023141 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-8ll4d" podStartSLOduration=1.35086221 podStartE2EDuration="3.023126315s" totalImagesPullingTime="1.672264105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:20.021115599 +0000 UTC m=+302.342288115" watchObservedRunningTime="2026-06-08 19:38:20.023126315 +0000 UTC m=+302.344298851" Jun 08 19:38:20.047531 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.047433 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hf4lv" podStartSLOduration=1.4940101000000001 podStartE2EDuration="3.047415229s" totalImagesPullingTime="1.553405129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:20.046730051 +0000 UTC m=+302.367902580" watchObservedRunningTime="2026-06-08 19:38:20.047415229 +0000 UTC m=+302.368587746" Jun 08 19:38:20.184311 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.184280 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-f54b5"] Jun 08 19:38:20.187478 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.187453 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-f54b5" Jun 08 19:38:20.189979 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.189958 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 19:38:20.189979 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.189972 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 19:38:20.190158 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.189998 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rwctn\"" Jun 08 19:38:20.199602 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.199573 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:20.200077 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.200056 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-f54b5"] Jun 08 19:38:20.294475 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.294440 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:20.303571 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.303492 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cpdj\" (UniqueName: \"kubernetes.io/projected/a97beeab-236a-4eed-bc89-a7bebe28f8ae-kube-api-access-4cpdj\") pod \"downloads-6657875f97-f54b5\" (UID: \"a97beeab-236a-4eed-bc89-a7bebe28f8ae\") " pod="openshift-console/downloads-6657875f97-f54b5" Jun 08 19:38:20.395790 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.395754 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:20.404916 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.404884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cpdj\" (UniqueName: \"kubernetes.io/projected/a97beeab-236a-4eed-bc89-a7bebe28f8ae-kube-api-access-4cpdj\") pod \"downloads-6657875f97-f54b5\" (UID: \"a97beeab-236a-4eed-bc89-a7bebe28f8ae\") " pod="openshift-console/downloads-6657875f97-f54b5" Jun 08 19:38:20.416442 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.416412 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cpdj\" (UniqueName: \"kubernetes.io/projected/a97beeab-236a-4eed-bc89-a7bebe28f8ae-kube-api-access-4cpdj\") pod \"downloads-6657875f97-f54b5\" (UID: \"a97beeab-236a-4eed-bc89-a7bebe28f8ae\") " pod="openshift-console/downloads-6657875f97-f54b5" Jun 08 19:38:20.476845 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.476810 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:20.477650 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.477611 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g"] Jun 08 19:38:20.481262 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.481242 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.483811 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.483785 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 19:38:20.483920 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.483859 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2gnkums6jj8ni\"" Jun 08 19:38:20.483920 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.483870 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 19:38:20.483920 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.483859 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 19:38:20.484086 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.484022 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 19:38:20.484086 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.484058 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-n6cnc\"" Jun 08 19:38:20.484353 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.484337 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 19:38:20.494740 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.494714 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g"] Jun 08 19:38:20.497284 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.497266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-f54b5" Jun 08 19:38:20.532560 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.532527 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:20.606842 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.606807 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d68b772-2193-4762-8e3d-ed156dd34596-metrics-client-ca\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.606993 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.606876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.606993 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.606900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m72wv\" (UniqueName: \"kubernetes.io/projected/9d68b772-2193-4762-8e3d-ed156dd34596-kube-api-access-m72wv\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.606993 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.606926 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.606993 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.606943 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.606993 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.606972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-grpc-tls\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.607205 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.607002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.607205 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.607073 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-tls\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.634077 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.633787 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-f54b5"] Jun 08 19:38:20.636393 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:38:20.636364 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97beeab_236a_4eed_bc89_a7bebe28f8ae.slice/crio-e637eff38c20d06cfcfbbb888c1cc58510dcad085ad402a9d52633bc456a7b87 WatchSource:0}: Error finding container e637eff38c20d06cfcfbbb888c1cc58510dcad085ad402a9d52633bc456a7b87: Status 404 returned error can't find the container with id e637eff38c20d06cfcfbbb888c1cc58510dcad085ad402a9d52633bc456a7b87 Jun 08 19:38:20.638431 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.638415 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:38:20.685867 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.685841 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:20.707633 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.707605 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-tls\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.707759 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.707685 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d68b772-2193-4762-8e3d-ed156dd34596-metrics-client-ca\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.707759 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.707725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.707759 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.707754 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72wv\" (UniqueName: \"kubernetes.io/projected/9d68b772-2193-4762-8e3d-ed156dd34596-kube-api-access-m72wv\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.707909 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.707892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.707957 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.707926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.708009 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.707956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-grpc-tls\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.708009 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.707998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.708546 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.708520 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d68b772-2193-4762-8e3d-ed156dd34596-metrics-client-ca\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.710796 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.710770 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-tls\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.710905 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.710879 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.711270 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.711252 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.711270 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.711259 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.711444 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.711427 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.711615 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.711597 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9d68b772-2193-4762-8e3d-ed156dd34596-secret-grpc-tls\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.715996 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.715978 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m72wv\" (UniqueName: \"kubernetes.io/projected/9d68b772-2193-4762-8e3d-ed156dd34596-kube-api-access-m72wv\") pod \"thanos-querier-8fcb5f98d-vjj5g\" (UID: \"9d68b772-2193-4762-8e3d-ed156dd34596\") " pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.785437 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.785404 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:20.791445 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.791424 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:20.886564 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.886525 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:20.941052 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.940947 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g"] Jun 08 19:38:20.943480 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:38:20.943455 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d68b772_2193_4762_8e3d_ed156dd34596.slice/crio-0a3617524ddde5e62b8a1c9b1954c8facf488d570c9e40e4989a33cf01d615f8 WatchSource:0}: Error finding container 0a3617524ddde5e62b8a1c9b1954c8facf488d570c9e40e4989a33cf01d615f8: Status 404 returned error can't find the container with id 0a3617524ddde5e62b8a1c9b1954c8facf488d570c9e40e4989a33cf01d615f8 Jun 08 19:38:20.986462 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:20.986427 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:21.014082 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:21.014047 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mnngm" event={"ID":"6bdad326-ff55-4df2-9ee6-e641040484c3","Type":"ContainerStarted","Data":"f962134a11c7811f9f97fa6e164ca5ffbb55f56eb0e40c08701503cfb5d1a11e"} Jun 08 19:38:21.014551 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:21.014114 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mnngm" event={"ID":"6bdad326-ff55-4df2-9ee6-e641040484c3","Type":"ContainerStarted","Data":"511c79ae67791a2c1433360c8472cec5cc6aa39f86d702b1b61f73b29d5d6e4c"} Jun 08 19:38:21.015317 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:21.015295 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-f54b5" event={"ID":"a97beeab-236a-4eed-bc89-a7bebe28f8ae","Type":"ContainerStarted","Data":"e637eff38c20d06cfcfbbb888c1cc58510dcad085ad402a9d52633bc456a7b87"} Jun 08 19:38:21.016428 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:21.016407 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" event={"ID":"9d68b772-2193-4762-8e3d-ed156dd34596","Type":"ContainerStarted","Data":"0a3617524ddde5e62b8a1c9b1954c8facf488d570c9e40e4989a33cf01d615f8"} Jun 08 19:38:21.034989 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:21.034947 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mnngm" podStartSLOduration=2.7648574569999997 podStartE2EDuration="4.034933929s" totalImagesPullingTime="1.187350971s" totalInitContainerRuntime="82.725501ms" isStatefulPod=true podCreationTimestamp="2026-06-08 19:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:21.033445524 +0000 UTC m=+303.354618040" watchObservedRunningTime="2026-06-08 19:38:21.034933929 +0000 UTC m=+303.356106445" Jun 08 19:38:21.086607 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:21.086581 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:21.139419 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:21.139390 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:21.279573 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:21.279532 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:21.896829 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:21.896792 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:22.090779 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:22.090681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:22.201263 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:22.201157 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:22.296464 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:22.296425 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:22.499557 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:22.499479 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:22.601152 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:22.601107 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:23.642759 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:23.642669 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:24.034882 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:24.034789 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" event={"ID":"9d68b772-2193-4762-8e3d-ed156dd34596","Type":"ContainerStarted","Data":"33418cbf0a21f507913fc4aefff5a7b9f606d5b61d2d29e076b36f627f04081c"} Jun 08 19:38:24.034882 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:24.034870 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" event={"ID":"9d68b772-2193-4762-8e3d-ed156dd34596","Type":"ContainerStarted","Data":"896e26a4ad3a2522e1074ed6e1c02032fbaf2f12bb8f1c0f1c259b5964351e49"} Jun 08 19:38:24.035105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:24.034910 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" event={"ID":"9d68b772-2193-4762-8e3d-ed156dd34596","Type":"ContainerStarted","Data":"97cd007ac2692dcda0092b60ca076e5dcb5e1d5aafc35335d74125f097c31d5c"} Jun 08 19:38:24.209930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:24.209899 2579 patch_prober.go:28] interesting pod/image-registry-65fcbb6b89-68qxv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 19:38:24.210027 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:24.209956 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" podUID="a1bc57ce-1262-48c0-abc8-105e94f58ccf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:38:25.044040 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:25.043997 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" event={"ID":"9d68b772-2193-4762-8e3d-ed156dd34596","Type":"ContainerStarted","Data":"2df8b026ce55c1c7f95ecdbb8a89731697601363de817d9cb7007554f5b51408"} Jun 08 19:38:25.044508 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:25.044122 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" event={"ID":"9d68b772-2193-4762-8e3d-ed156dd34596","Type":"ContainerStarted","Data":"12b0d21b72b757cc793dd501706198c67d6e828eb3cf4bf45fc5d7bd2cd0426b"} Jun 08 19:38:25.044508 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:25.044164 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" event={"ID":"9d68b772-2193-4762-8e3d-ed156dd34596","Type":"ContainerStarted","Data":"89f1111410a9c20d0647555bb915f5ad4960de109bd45b3e08486b7d2a4fe168"} Jun 08 19:38:25.044508 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:25.044348 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:25.067366 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:25.067307 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" podStartSLOduration=2.116765881 podStartE2EDuration="5.06728746s" totalImagesPullingTime="2.950521579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:38:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:25.066819374 +0000 UTC m=+307.387991902" watchObservedRunningTime="2026-06-08 19:38:25.06728746 +0000 UTC m=+307.388459977" Jun 08 19:38:25.927688 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:25.927653 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:38:26.081615 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:26.081579 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:26.090921 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:26.090901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:38:26.137665 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:26.137635 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:27.073262 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:27.073209 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:27.127308 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:27.127276 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:27.370406 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:27.370373 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:27.471605 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:27.471571 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:27.554771 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:27.554737 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:28.904043 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.904007 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-785b79ccb4-dhdgq"] Jun 08 19:38:28.910637 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.910616 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:28.913180 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.913156 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 19:38:28.913311 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.913203 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 19:38:28.913311 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.913209 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 19:38:28.914608 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.914303 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 19:38:28.914608 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.914347 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 19:38:28.914608 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.914451 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k726s\"" Jun 08 19:38:28.916205 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.916177 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785b79ccb4-dhdgq"] Jun 08 19:38:28.992098 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.992053 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l69gd\" (UniqueName: \"kubernetes.io/projected/ff391865-aa47-4835-8a9b-56108af6e6f7-kube-api-access-l69gd\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:28.992291 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.992142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-oauth-serving-cert\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:28.992291 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.992173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-service-ca\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:28.992291 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.992208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-console-config\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:28.992436 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.992307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff391865-aa47-4835-8a9b-56108af6e6f7-console-serving-cert\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:28.992436 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:28.992353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff391865-aa47-4835-8a9b-56108af6e6f7-console-oauth-config\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.093701 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.093668 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l69gd\" (UniqueName: \"kubernetes.io/projected/ff391865-aa47-4835-8a9b-56108af6e6f7-kube-api-access-l69gd\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.093884 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.093715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-oauth-serving-cert\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.093884 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.093735 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-service-ca\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.093884 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.093753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-console-config\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.093884 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.093773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff391865-aa47-4835-8a9b-56108af6e6f7-console-serving-cert\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.093884 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.093793 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff391865-aa47-4835-8a9b-56108af6e6f7-console-oauth-config\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.094492 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.094435 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-oauth-serving-cert\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.094593 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.094533 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-console-config\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.094593 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.094539 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-service-ca\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.096126 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.096106 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff391865-aa47-4835-8a9b-56108af6e6f7-console-oauth-config\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.096242 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.096210 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff391865-aa47-4835-8a9b-56108af6e6f7-console-serving-cert\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.102281 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.102260 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l69gd\" (UniqueName: \"kubernetes.io/projected/ff391865-aa47-4835-8a9b-56108af6e6f7-kube-api-access-l69gd\") pod \"console-785b79ccb4-dhdgq\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.221428 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.221334 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:29.360968 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.360945 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785b79ccb4-dhdgq"] Jun 08 19:38:29.363501 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:38:29.363475 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff391865_aa47_4835_8a9b_56108af6e6f7.slice/crio-e70535de90a40d62fa4305deb8892f6aa8b627b1dce64706e19a0d1762aee4ef WatchSource:0}: Error finding container e70535de90a40d62fa4305deb8892f6aa8b627b1dce64706e19a0d1762aee4ef: Status 404 returned error can't find the container with id e70535de90a40d62fa4305deb8892f6aa8b627b1dce64706e19a0d1762aee4ef Jun 08 19:38:29.846516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.846484 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65fcbb6b89-68qxv"] Jun 08 19:38:29.937249 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:29.937199 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:30.037266 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:30.037183 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:30.070583 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:30.070545 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785b79ccb4-dhdgq" event={"ID":"ff391865-aa47-4835-8a9b-56108af6e6f7","Type":"ContainerStarted","Data":"e70535de90a40d62fa4305deb8892f6aa8b627b1dce64706e19a0d1762aee4ef"} Jun 08 19:38:30.143852 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:30.143798 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:30.210544 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:30.210473 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:31.016402 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:31.016362 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:31.057827 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:31.057792 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8fcb5f98d-vjj5g" Jun 08 19:38:31.107971 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:31.107890 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:34.100316 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:34.100273 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:34.164496 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:34.164457 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:37.097040 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:37.096986 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:37.197238 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:37.197189 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:37.297878 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:37.297847 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:39.153623 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:39.153582 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:39.252323 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:39.252278 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:40.120714 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:40.120677 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-f54b5" event={"ID":"a97beeab-236a-4eed-bc89-a7bebe28f8ae","Type":"ContainerStarted","Data":"0b4b7ef605f25a6c44af4e2776d8ab079aa84fb32dd516627d2291dd2e4b7c37"} Jun 08 19:38:40.121140 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:40.121115 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-f54b5" Jun 08 19:38:40.122724 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:40.122691 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785b79ccb4-dhdgq" event={"ID":"ff391865-aa47-4835-8a9b-56108af6e6f7","Type":"ContainerStarted","Data":"0d8ed562e8dadb801d239beafb460b60eed094ce7c843559e78a3363dd6685c2"} Jun 08 19:38:40.132648 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:40.132622 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-f54b5" Jun 08 19:38:40.143159 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:40.143107 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-f54b5" podStartSLOduration=1.3515688510000001 podStartE2EDuration="20.143087152s" totalImagesPullingTime="18.791518301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:38:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:40.141544814 +0000 UTC m=+322.462717330" watchObservedRunningTime="2026-06-08 19:38:40.143087152 +0000 UTC m=+322.464259676" Jun 08 19:38:40.167310 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:40.167251 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-785b79ccb4-dhdgq" podStartSLOduration=2.146108429 podStartE2EDuration="12.167209373s" totalImagesPullingTime="10.021100944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:40.165687876 +0000 UTC m=+322.486860393" watchObservedRunningTime="2026-06-08 19:38:40.167209373 +0000 UTC m=+322.488381889" Jun 08 19:38:41.522515 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:41.522473 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:41.618847 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:41.618813 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:45.065537 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:45.065501 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:45.167638 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:45.167591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:46.273773 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:46.273736 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:46.375011 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:46.374955 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:46.992113 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:46.992082 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:47.068580 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:47.068545 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:47.960733 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:47.960701 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785b79ccb4-dhdgq"] Jun 08 19:38:48.066049 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:48.066011 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:48.121672 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:48.121635 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:48.183261 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:48.183213 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:49.033382 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:49.033343 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:49.090337 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:49.090300 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:49.222416 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:49.222373 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:38:50.397773 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:50.397740 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:50.454217 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:50.454186 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:38:54.873425 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:54.873357 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" podUID="a1bc57ce-1262-48c0-abc8-105e94f58ccf" containerName="registry" containerID="cri-o://60eb71a3042f954bf972ac14dc2ca63ea30c6f9e14cf47bc0ff0164df050cd96" gracePeriod=30 Jun 08 19:38:55.150364 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.150281 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:38:55.187483 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.187452 2579 generic.go:356] "Generic (PLEG): container finished" podID="a1bc57ce-1262-48c0-abc8-105e94f58ccf" containerID="60eb71a3042f954bf972ac14dc2ca63ea30c6f9e14cf47bc0ff0164df050cd96" exitCode=0 Jun 08 19:38:55.187659 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.187500 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" Jun 08 19:38:55.187659 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.187525 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" event={"ID":"a1bc57ce-1262-48c0-abc8-105e94f58ccf","Type":"ContainerDied","Data":"60eb71a3042f954bf972ac14dc2ca63ea30c6f9e14cf47bc0ff0164df050cd96"} Jun 08 19:38:55.187659 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.187603 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fcbb6b89-68qxv" event={"ID":"a1bc57ce-1262-48c0-abc8-105e94f58ccf","Type":"ContainerDied","Data":"5f961c38bc102e3e320e5da386c5ff9a11333cb974316211d65f75b7252a8de5"} Jun 08 19:38:55.187659 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.187631 2579 scope.go:117] "RemoveContainer" containerID="60eb71a3042f954bf972ac14dc2ca63ea30c6f9e14cf47bc0ff0164df050cd96" Jun 08 19:38:55.196075 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.196057 2579 scope.go:117] "RemoveContainer" containerID="60eb71a3042f954bf972ac14dc2ca63ea30c6f9e14cf47bc0ff0164df050cd96" Jun 08 19:38:55.196349 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:38:55.196323 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60eb71a3042f954bf972ac14dc2ca63ea30c6f9e14cf47bc0ff0164df050cd96\": container with ID starting with 60eb71a3042f954bf972ac14dc2ca63ea30c6f9e14cf47bc0ff0164df050cd96 not found: ID does not exist" containerID="60eb71a3042f954bf972ac14dc2ca63ea30c6f9e14cf47bc0ff0164df050cd96" Jun 08 19:38:55.196412 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.196363 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60eb71a3042f954bf972ac14dc2ca63ea30c6f9e14cf47bc0ff0164df050cd96"} err="failed to get container status \"60eb71a3042f954bf972ac14dc2ca63ea30c6f9e14cf47bc0ff0164df050cd96\": rpc error: code = NotFound desc = could not find container \"60eb71a3042f954bf972ac14dc2ca63ea30c6f9e14cf47bc0ff0164df050cd96\": container with ID starting with 60eb71a3042f954bf972ac14dc2ca63ea30c6f9e14cf47bc0ff0164df050cd96 not found: ID does not exist" Jun 08 19:38:55.239807 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.239778 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-bound-sa-token\") pod \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " Jun 08 19:38:55.239914 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.239817 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1bc57ce-1262-48c0-abc8-105e94f58ccf-installation-pull-secrets\") pod \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " Jun 08 19:38:55.239914 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.239857 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6kjn\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-kube-api-access-q6kjn\") pod \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " Jun 08 19:38:55.239914 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.239884 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1bc57ce-1262-48c0-abc8-105e94f58ccf-image-registry-private-configuration\") pod \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " Jun 08 19:38:55.240066 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.239914 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1bc57ce-1262-48c0-abc8-105e94f58ccf-trusted-ca\") pod \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " Jun 08 19:38:55.240066 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.239942 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1bc57ce-1262-48c0-abc8-105e94f58ccf-ca-trust-extracted\") pod \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " Jun 08 19:38:55.240066 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.239979 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") pod \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " Jun 08 19:38:55.240066 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.240005 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-certificates\") pod \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\" (UID: \"a1bc57ce-1262-48c0-abc8-105e94f58ccf\") " Jun 08 19:38:55.240604 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.240456 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1bc57ce-1262-48c0-abc8-105e94f58ccf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a1bc57ce-1262-48c0-abc8-105e94f58ccf" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:38:55.240700 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.240639 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a1bc57ce-1262-48c0-abc8-105e94f58ccf" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:38:55.242469 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.242425 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1bc57ce-1262-48c0-abc8-105e94f58ccf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a1bc57ce-1262-48c0-abc8-105e94f58ccf" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:38:55.242681 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.242645 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1bc57ce-1262-48c0-abc8-105e94f58ccf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a1bc57ce-1262-48c0-abc8-105e94f58ccf" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:38:55.242783 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.242687 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-kube-api-access-q6kjn" (OuterVolumeSpecName: "kube-api-access-q6kjn") pod "a1bc57ce-1262-48c0-abc8-105e94f58ccf" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf"). InnerVolumeSpecName "kube-api-access-q6kjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:38:55.242783 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.242729 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a1bc57ce-1262-48c0-abc8-105e94f58ccf" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:38:55.242783 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.242744 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a1bc57ce-1262-48c0-abc8-105e94f58ccf" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:38:55.248940 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.248915 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1bc57ce-1262-48c0-abc8-105e94f58ccf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a1bc57ce-1262-48c0-abc8-105e94f58ccf" (UID: "a1bc57ce-1262-48c0-abc8-105e94f58ccf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:38:55.341429 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.341400 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-bound-sa-token\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:38:55.341429 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.341425 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1bc57ce-1262-48c0-abc8-105e94f58ccf-installation-pull-secrets\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:38:55.341429 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.341435 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6kjn\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-kube-api-access-q6kjn\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:38:55.341639 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.341446 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1bc57ce-1262-48c0-abc8-105e94f58ccf-image-registry-private-configuration\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:38:55.341639 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.341456 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1bc57ce-1262-48c0-abc8-105e94f58ccf-trusted-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:38:55.341639 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.341464 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1bc57ce-1262-48c0-abc8-105e94f58ccf-ca-trust-extracted\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:38:55.341639 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.341472 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-tls\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:38:55.341639 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.341480 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1bc57ce-1262-48c0-abc8-105e94f58ccf-registry-certificates\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:38:55.509584 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.509556 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65fcbb6b89-68qxv"] Jun 08 19:38:55.514675 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:55.514651 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65fcbb6b89-68qxv"] Jun 08 19:38:56.095570 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:38:56.095538 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1bc57ce-1262-48c0-abc8-105e94f58ccf" path="/var/lib/kubelet/pods/a1bc57ce-1262-48c0-abc8-105e94f58ccf/volumes" Jun 08 19:39:05.403688 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:05.403640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:05.467715 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:05.467688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:07.938156 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:07.938111 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:12.987898 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:12.987834 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-785b79ccb4-dhdgq" podUID="ff391865-aa47-4835-8a9b-56108af6e6f7" containerName="console" containerID="cri-o://0d8ed562e8dadb801d239beafb460b60eed094ce7c843559e78a3363dd6685c2" gracePeriod=15 Jun 08 19:39:13.259086 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.259020 2579 generic.go:356] "Generic (PLEG): container finished" podID="ff391865-aa47-4835-8a9b-56108af6e6f7" containerID="0d8ed562e8dadb801d239beafb460b60eed094ce7c843559e78a3363dd6685c2" exitCode=0 Jun 08 19:39:13.259086 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.259056 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785b79ccb4-dhdgq" event={"ID":"ff391865-aa47-4835-8a9b-56108af6e6f7","Type":"ContainerDied","Data":"0d8ed562e8dadb801d239beafb460b60eed094ce7c843559e78a3363dd6685c2"} Jun 08 19:39:13.259253 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.259094 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785b79ccb4-dhdgq" event={"ID":"ff391865-aa47-4835-8a9b-56108af6e6f7","Type":"ContainerDied","Data":"e70535de90a40d62fa4305deb8892f6aa8b627b1dce64706e19a0d1762aee4ef"} Jun 08 19:39:13.259253 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.259108 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e70535de90a40d62fa4305deb8892f6aa8b627b1dce64706e19a0d1762aee4ef" Jun 08 19:39:13.270185 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.270151 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:39:13.395271 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.395213 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-console-config\") pod \"ff391865-aa47-4835-8a9b-56108af6e6f7\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " Jun 08 19:39:13.395480 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.395287 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff391865-aa47-4835-8a9b-56108af6e6f7-console-oauth-config\") pod \"ff391865-aa47-4835-8a9b-56108af6e6f7\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " Jun 08 19:39:13.395480 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.395314 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-service-ca\") pod \"ff391865-aa47-4835-8a9b-56108af6e6f7\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " Jun 08 19:39:13.395480 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.395353 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff391865-aa47-4835-8a9b-56108af6e6f7-console-serving-cert\") pod \"ff391865-aa47-4835-8a9b-56108af6e6f7\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " Jun 08 19:39:13.395480 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.395379 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l69gd\" (UniqueName: \"kubernetes.io/projected/ff391865-aa47-4835-8a9b-56108af6e6f7-kube-api-access-l69gd\") pod \"ff391865-aa47-4835-8a9b-56108af6e6f7\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " Jun 08 19:39:13.395480 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.395407 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-oauth-serving-cert\") pod \"ff391865-aa47-4835-8a9b-56108af6e6f7\" (UID: \"ff391865-aa47-4835-8a9b-56108af6e6f7\") " Jun 08 19:39:13.395758 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.395694 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-console-config" (OuterVolumeSpecName: "console-config") pod "ff391865-aa47-4835-8a9b-56108af6e6f7" (UID: "ff391865-aa47-4835-8a9b-56108af6e6f7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:39:13.395758 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.395740 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-service-ca" (OuterVolumeSpecName: "service-ca") pod "ff391865-aa47-4835-8a9b-56108af6e6f7" (UID: "ff391865-aa47-4835-8a9b-56108af6e6f7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:39:13.396006 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.395982 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ff391865-aa47-4835-8a9b-56108af6e6f7" (UID: "ff391865-aa47-4835-8a9b-56108af6e6f7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:39:13.397635 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.397610 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff391865-aa47-4835-8a9b-56108af6e6f7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ff391865-aa47-4835-8a9b-56108af6e6f7" (UID: "ff391865-aa47-4835-8a9b-56108af6e6f7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:13.397743 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.397674 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff391865-aa47-4835-8a9b-56108af6e6f7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ff391865-aa47-4835-8a9b-56108af6e6f7" (UID: "ff391865-aa47-4835-8a9b-56108af6e6f7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:13.397743 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.397718 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff391865-aa47-4835-8a9b-56108af6e6f7-kube-api-access-l69gd" (OuterVolumeSpecName: "kube-api-access-l69gd") pod "ff391865-aa47-4835-8a9b-56108af6e6f7" (UID: "ff391865-aa47-4835-8a9b-56108af6e6f7"). InnerVolumeSpecName "kube-api-access-l69gd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:39:13.496069 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.496034 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-console-config\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:39:13.496069 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.496064 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff391865-aa47-4835-8a9b-56108af6e6f7-console-oauth-config\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:39:13.496069 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.496076 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:39:13.496327 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.496085 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff391865-aa47-4835-8a9b-56108af6e6f7-console-serving-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:39:13.496327 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.496094 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l69gd\" (UniqueName: \"kubernetes.io/projected/ff391865-aa47-4835-8a9b-56108af6e6f7-kube-api-access-l69gd\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:39:13.496327 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:13.496104 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff391865-aa47-4835-8a9b-56108af6e6f7-oauth-serving-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:39:14.262983 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:14.262947 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785b79ccb4-dhdgq" Jun 08 19:39:14.280597 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:14.280567 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785b79ccb4-dhdgq"] Jun 08 19:39:14.284772 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:14.284745 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-785b79ccb4-dhdgq"] Jun 08 19:39:16.094586 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:16.094549 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff391865-aa47-4835-8a9b-56108af6e6f7" path="/var/lib/kubelet/pods/ff391865-aa47-4835-8a9b-56108af6e6f7/volumes" Jun 08 19:39:32.055344 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:32.055308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:39:32.057676 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:32.057652 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bb7542c-5411-4674-ae66-49f2a63958c0-metrics-certs\") pod \"network-metrics-daemon-n6d4n\" (UID: \"7bb7542c-5411-4674-ae66-49f2a63958c0\") " pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:39:32.094484 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:32.094457 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kkkgg\"" Jun 08 19:39:32.102644 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:32.102623 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6d4n" Jun 08 19:39:32.236272 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:32.236248 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n6d4n"] Jun 08 19:39:32.238679 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:39:32.238653 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb7542c_5411_4674_ae66_49f2a63958c0.slice/crio-de70a228febf8d485542a9e62fba8c5276f460e84947e81bb5a821fdef617693 WatchSource:0}: Error finding container de70a228febf8d485542a9e62fba8c5276f460e84947e81bb5a821fdef617693: Status 404 returned error can't find the container with id de70a228febf8d485542a9e62fba8c5276f460e84947e81bb5a821fdef617693 Jun 08 19:39:32.340408 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:32.340321 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n6d4n" event={"ID":"7bb7542c-5411-4674-ae66-49f2a63958c0","Type":"ContainerStarted","Data":"de70a228febf8d485542a9e62fba8c5276f460e84947e81bb5a821fdef617693"} Jun 08 19:39:33.347000 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:33.346967 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n6d4n" event={"ID":"7bb7542c-5411-4674-ae66-49f2a63958c0","Type":"ContainerStarted","Data":"3d9703d99ea8c70cbd0ee74d5e107a43eb0902806b49a9302674ccc6ed92c045"} Jun 08 19:39:33.347378 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:33.347024 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n6d4n" event={"ID":"7bb7542c-5411-4674-ae66-49f2a63958c0","Type":"ContainerStarted","Data":"b49714957f84a4af0a8f284c0d36bb8d7233fb27414c800da1243c5400a5ba39"} Jun 08 19:39:33.365194 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:33.365148 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n6d4n" podStartSLOduration=374.450432905 podStartE2EDuration="6m15.365131602s" totalImagesPullingTime="914.698697ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:39:33.363874889 +0000 UTC m=+375.685047407" watchObservedRunningTime="2026-06-08 19:39:33.365131602 +0000 UTC m=+375.686304117" Jun 08 19:39:33.463472 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:33.463394 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:33.520930 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:33.520898 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:36.647499 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:36.647462 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:36.950780 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:36.950683 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:37.256072 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:37.255991 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:37.312356 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:37.312330 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:41.780969 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.780928 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk"] Jun 08 19:39:41.781446 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.781404 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1bc57ce-1262-48c0-abc8-105e94f58ccf" containerName="registry" Jun 08 19:39:41.781446 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.781422 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1bc57ce-1262-48c0-abc8-105e94f58ccf" containerName="registry" Jun 08 19:39:41.781549 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.781451 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff391865-aa47-4835-8a9b-56108af6e6f7" containerName="console" Jun 08 19:39:41.781549 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.781459 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff391865-aa47-4835-8a9b-56108af6e6f7" containerName="console" Jun 08 19:39:41.781549 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.781532 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1bc57ce-1262-48c0-abc8-105e94f58ccf" containerName="registry" Jun 08 19:39:41.781549 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.781544 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff391865-aa47-4835-8a9b-56108af6e6f7" containerName="console" Jun 08 19:39:41.785096 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.785075 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.787889 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.787866 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 08 19:39:41.788007 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.787974 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 08 19:39:41.788086 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.788027 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 08 19:39:41.788086 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.788074 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 08 19:39:41.788504 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.788487 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 08 19:39:41.790547 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.790529 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qlzz6\"" Jun 08 19:39:41.799945 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.799912 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk"] Jun 08 19:39:41.800918 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.800892 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 08 19:39:41.837716 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.837683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a0a23063-4c83-4b85-b749-aaae7e9244ef-secret-telemeter-client\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.837911 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.837727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a23063-4c83-4b85-b749-aaae7e9244ef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.837911 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.837791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0a23063-4c83-4b85-b749-aaae7e9244ef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.837911 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.837830 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a23063-4c83-4b85-b749-aaae7e9244ef-serving-certs-ca-bundle\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.837911 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.837854 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8zmz\" (UniqueName: \"kubernetes.io/projected/a0a23063-4c83-4b85-b749-aaae7e9244ef-kube-api-access-b8zmz\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.837911 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.837879 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a0a23063-4c83-4b85-b749-aaae7e9244ef-federate-client-tls\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.838122 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.837938 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a0a23063-4c83-4b85-b749-aaae7e9244ef-telemeter-client-tls\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.838122 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.837971 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a23063-4c83-4b85-b749-aaae7e9244ef-metrics-client-ca\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.938628 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.938584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a0a23063-4c83-4b85-b749-aaae7e9244ef-secret-telemeter-client\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.938807 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.938642 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a23063-4c83-4b85-b749-aaae7e9244ef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.938807 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.938713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0a23063-4c83-4b85-b749-aaae7e9244ef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.938807 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.938749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a23063-4c83-4b85-b749-aaae7e9244ef-serving-certs-ca-bundle\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.938807 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.938788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8zmz\" (UniqueName: \"kubernetes.io/projected/a0a23063-4c83-4b85-b749-aaae7e9244ef-kube-api-access-b8zmz\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.938971 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.938811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a0a23063-4c83-4b85-b749-aaae7e9244ef-federate-client-tls\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.938971 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.938863 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a0a23063-4c83-4b85-b749-aaae7e9244ef-telemeter-client-tls\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.939088 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.939060 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a23063-4c83-4b85-b749-aaae7e9244ef-metrics-client-ca\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.939597 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.939570 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a23063-4c83-4b85-b749-aaae7e9244ef-serving-certs-ca-bundle\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.939785 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.939647 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a23063-4c83-4b85-b749-aaae7e9244ef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.939889 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.939790 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a23063-4c83-4b85-b749-aaae7e9244ef-metrics-client-ca\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.941425 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.941403 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a0a23063-4c83-4b85-b749-aaae7e9244ef-secret-telemeter-client\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.941516 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.941442 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a0a23063-4c83-4b85-b749-aaae7e9244ef-federate-client-tls\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.941767 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.941744 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0a23063-4c83-4b85-b749-aaae7e9244ef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.941804 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.941757 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a0a23063-4c83-4b85-b749-aaae7e9244ef-telemeter-client-tls\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:41.947697 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:41.947674 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8zmz\" (UniqueName: \"kubernetes.io/projected/a0a23063-4c83-4b85-b749-aaae7e9244ef-kube-api-access-b8zmz\") pod \"telemeter-client-5b9c5b8f44-gbmwk\" (UID: \"a0a23063-4c83-4b85-b749-aaae7e9244ef\") " pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:42.096514 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:42.096428 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" Jun 08 19:39:42.275912 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:42.275876 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk"] Jun 08 19:39:42.278536 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:39:42.278506 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a23063_4c83_4b85_b749_aaae7e9244ef.slice/crio-04dad6efcf3e64139350a7a02f1eca6953b9f5aaac990b8c0a95012b9aa5d202 WatchSource:0}: Error finding container 04dad6efcf3e64139350a7a02f1eca6953b9f5aaac990b8c0a95012b9aa5d202: Status 404 returned error can't find the container with id 04dad6efcf3e64139350a7a02f1eca6953b9f5aaac990b8c0a95012b9aa5d202 Jun 08 19:39:42.381279 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:42.381223 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" event={"ID":"a0a23063-4c83-4b85-b749-aaae7e9244ef","Type":"ContainerStarted","Data":"04dad6efcf3e64139350a7a02f1eca6953b9f5aaac990b8c0a95012b9aa5d202"} Jun 08 19:39:45.397332 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:45.397287 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" event={"ID":"a0a23063-4c83-4b85-b749-aaae7e9244ef","Type":"ContainerStarted","Data":"5165b2512380f11cbb322015d32271410479ab4191ad4d0c4f33538f0e543e4f"} Jun 08 19:39:46.408192 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:46.403346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" event={"ID":"a0a23063-4c83-4b85-b749-aaae7e9244ef","Type":"ContainerStarted","Data":"f60a311f6b3e3e244a5e7e2fb7afbf75a2f745e48aa996e419c6b40e819b5d0b"} Jun 08 19:39:46.408192 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:46.403512 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" event={"ID":"a0a23063-4c83-4b85-b749-aaae7e9244ef","Type":"ContainerStarted","Data":"7d2d2c481679b365c0e02418e39d8dadce437afff9ae09f7ab5d17c056065452"} Jun 08 19:39:46.433899 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:46.433847 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b9c5b8f44-gbmwk" podStartSLOduration=2.306020003 podStartE2EDuration="5.433832939s" totalImagesPullingTime="3.127812936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:39:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:39:46.433684554 +0000 UTC m=+388.754857070" watchObservedRunningTime="2026-06-08 19:39:46.433832939 +0000 UTC m=+388.755005454" Jun 08 19:39:47.146786 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.146745 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86bbd4fc78-tfwrz"] Jun 08 19:39:47.150363 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.150345 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.153814 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.153785 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k726s\"" Jun 08 19:39:47.154747 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.154730 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 19:39:47.154886 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.154860 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 19:39:47.155000 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.154891 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 19:39:47.156022 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.155990 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 19:39:47.157507 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.157490 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 19:39:47.160090 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.160070 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 19:39:47.164155 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.164134 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86bbd4fc78-tfwrz"] Jun 08 19:39:47.222026 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.221995 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:47.287264 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.287217 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-console-config\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.287440 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.287348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-trusted-ca-bundle\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.287440 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.287391 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-oauth-serving-cert\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.287530 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.287435 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8d77905-1991-45e3-aa76-1f6894698a01-console-serving-cert\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.287530 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.287465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8d77905-1991-45e3-aa76-1f6894698a01-console-oauth-config\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.287611 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.287533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-service-ca\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.287611 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.287576 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7b2b\" (UniqueName: \"kubernetes.io/projected/f8d77905-1991-45e3-aa76-1f6894698a01-kube-api-access-f7b2b\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.330927 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.330897 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:47.388148 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.388111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-trusted-ca-bundle\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.388148 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.388152 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-oauth-serving-cert\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.388430 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.388172 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8d77905-1991-45e3-aa76-1f6894698a01-console-serving-cert\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.388430 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.388193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8d77905-1991-45e3-aa76-1f6894698a01-console-oauth-config\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.388430 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.388223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-service-ca\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.388430 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.388275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7b2b\" (UniqueName: \"kubernetes.io/projected/f8d77905-1991-45e3-aa76-1f6894698a01-kube-api-access-f7b2b\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.388430 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.388345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-console-config\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.388935 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.388910 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-oauth-serving-cert\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.389086 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.388962 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-console-config\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.389086 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.389006 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-trusted-ca-bundle\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.389187 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.389167 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-service-ca\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.391070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.391040 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8d77905-1991-45e3-aa76-1f6894698a01-console-oauth-config\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.391182 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.391114 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8d77905-1991-45e3-aa76-1f6894698a01-console-serving-cert\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.396747 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.396727 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7b2b\" (UniqueName: \"kubernetes.io/projected/f8d77905-1991-45e3-aa76-1f6894698a01-kube-api-access-f7b2b\") pod \"console-86bbd4fc78-tfwrz\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.432026 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.431932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:47.461130 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.461103 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:47.591522 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.591486 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86bbd4fc78-tfwrz"] Jun 08 19:39:47.594581 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:39:47.594551 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d77905_1991_45e3_aa76_1f6894698a01.slice/crio-14fe8df78545e129ebb4a53ba9d6f765bb5a0b705938b96e0dcb305866196bd4 WatchSource:0}: Error finding container 14fe8df78545e129ebb4a53ba9d6f765bb5a0b705938b96e0dcb305866196bd4: Status 404 returned error can't find the container with id 14fe8df78545e129ebb4a53ba9d6f765bb5a0b705938b96e0dcb305866196bd4 Jun 08 19:39:47.941697 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.941665 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:47.996985 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:47.996948 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:48.413211 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:48.413171 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bbd4fc78-tfwrz" event={"ID":"f8d77905-1991-45e3-aa76-1f6894698a01","Type":"ContainerStarted","Data":"05d546cd87fd7dc35c5930910b8cd7e000d4669e950e6c57a2bf07536836201f"} Jun 08 19:39:48.413211 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:48.413217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bbd4fc78-tfwrz" event={"ID":"f8d77905-1991-45e3-aa76-1f6894698a01","Type":"ContainerStarted","Data":"14fe8df78545e129ebb4a53ba9d6f765bb5a0b705938b96e0dcb305866196bd4"} Jun 08 19:39:48.432522 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:48.432469 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86bbd4fc78-tfwrz" podStartSLOduration=1.432448822 podStartE2EDuration="1.432448822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:39:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:39:48.432135629 +0000 UTC m=+390.753308145" watchObservedRunningTime="2026-06-08 19:39:48.432448822 +0000 UTC m=+390.753621340" Jun 08 19:39:49.423408 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:49.423378 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:49.483122 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:49.483095 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:57.461794 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:57.461756 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:57.462182 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:57.462077 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:57.466887 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:57.466864 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:58.458878 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:58.458849 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:39:58.610349 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:58.610309 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:58.665587 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:58.665557 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:39:58.715790 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:39:58.715713 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:40:42.069533 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:40:42.069456 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:40:51.908170 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:40:51.908133 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:40:51.965336 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:40:51.965305 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:41:03.843861 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:03.843830 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:41:03.899883 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:03.899846 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:41:20.401129 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:20.401095 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:41:20.503259 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:20.503191 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:41:20.559023 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:20.558984 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:41:31.495759 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:31.495718 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86bbd4fc78-tfwrz"] Jun 08 19:41:31.595734 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:31.595698 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:41:31.696435 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:31.696401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:41:31.748612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:31.748536 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:41:52.611642 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:52.611608 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:41:52.717041 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:52.717009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:41:56.522464 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.522385 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86bbd4fc78-tfwrz" podUID="f8d77905-1991-45e3-aa76-1f6894698a01" containerName="console" containerID="cri-o://05d546cd87fd7dc35c5930910b8cd7e000d4669e950e6c57a2bf07536836201f" gracePeriod=15 Jun 08 19:41:56.765737 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.765712 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:41:56.861825 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.861742 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8d77905-1991-45e3-aa76-1f6894698a01-console-oauth-config\") pod \"f8d77905-1991-45e3-aa76-1f6894698a01\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " Jun 08 19:41:56.861825 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.861798 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-console-config\") pod \"f8d77905-1991-45e3-aa76-1f6894698a01\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " Jun 08 19:41:56.862071 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.861828 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-trusted-ca-bundle\") pod \"f8d77905-1991-45e3-aa76-1f6894698a01\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " Jun 08 19:41:56.862071 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.861847 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-service-ca\") pod \"f8d77905-1991-45e3-aa76-1f6894698a01\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " Jun 08 19:41:56.862071 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.861874 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-oauth-serving-cert\") pod \"f8d77905-1991-45e3-aa76-1f6894698a01\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " Jun 08 19:41:56.862071 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.861894 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7b2b\" (UniqueName: \"kubernetes.io/projected/f8d77905-1991-45e3-aa76-1f6894698a01-kube-api-access-f7b2b\") pod \"f8d77905-1991-45e3-aa76-1f6894698a01\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " Jun 08 19:41:56.862071 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.861950 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8d77905-1991-45e3-aa76-1f6894698a01-console-serving-cert\") pod \"f8d77905-1991-45e3-aa76-1f6894698a01\" (UID: \"f8d77905-1991-45e3-aa76-1f6894698a01\") " Jun 08 19:41:56.862363 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.862341 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-service-ca" (OuterVolumeSpecName: "service-ca") pod "f8d77905-1991-45e3-aa76-1f6894698a01" (UID: "f8d77905-1991-45e3-aa76-1f6894698a01"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:41:56.862419 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.862346 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f8d77905-1991-45e3-aa76-1f6894698a01" (UID: "f8d77905-1991-45e3-aa76-1f6894698a01"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:41:56.862419 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.862376 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f8d77905-1991-45e3-aa76-1f6894698a01" (UID: "f8d77905-1991-45e3-aa76-1f6894698a01"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:41:56.862419 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.862394 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-console-config" (OuterVolumeSpecName: "console-config") pod "f8d77905-1991-45e3-aa76-1f6894698a01" (UID: "f8d77905-1991-45e3-aa76-1f6894698a01"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:41:56.863996 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.863972 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d77905-1991-45e3-aa76-1f6894698a01-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f8d77905-1991-45e3-aa76-1f6894698a01" (UID: "f8d77905-1991-45e3-aa76-1f6894698a01"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:41:56.864163 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.864138 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d77905-1991-45e3-aa76-1f6894698a01-kube-api-access-f7b2b" (OuterVolumeSpecName: "kube-api-access-f7b2b") pod "f8d77905-1991-45e3-aa76-1f6894698a01" (UID: "f8d77905-1991-45e3-aa76-1f6894698a01"). InnerVolumeSpecName "kube-api-access-f7b2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:41:56.864269 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.864249 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d77905-1991-45e3-aa76-1f6894698a01-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f8d77905-1991-45e3-aa76-1f6894698a01" (UID: "f8d77905-1991-45e3-aa76-1f6894698a01"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:41:56.938219 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.938184 2579 generic.go:356] "Generic (PLEG): container finished" podID="f8d77905-1991-45e3-aa76-1f6894698a01" containerID="05d546cd87fd7dc35c5930910b8cd7e000d4669e950e6c57a2bf07536836201f" exitCode=0 Jun 08 19:41:56.938425 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.938260 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bbd4fc78-tfwrz" Jun 08 19:41:56.938425 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.938272 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bbd4fc78-tfwrz" event={"ID":"f8d77905-1991-45e3-aa76-1f6894698a01","Type":"ContainerDied","Data":"05d546cd87fd7dc35c5930910b8cd7e000d4669e950e6c57a2bf07536836201f"} Jun 08 19:41:56.938425 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.938350 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bbd4fc78-tfwrz" event={"ID":"f8d77905-1991-45e3-aa76-1f6894698a01","Type":"ContainerDied","Data":"14fe8df78545e129ebb4a53ba9d6f765bb5a0b705938b96e0dcb305866196bd4"} Jun 08 19:41:56.938425 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.938379 2579 scope.go:117] "RemoveContainer" containerID="05d546cd87fd7dc35c5930910b8cd7e000d4669e950e6c57a2bf07536836201f" Jun 08 19:41:56.948213 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.948194 2579 scope.go:117] "RemoveContainer" containerID="05d546cd87fd7dc35c5930910b8cd7e000d4669e950e6c57a2bf07536836201f" Jun 08 19:41:56.948494 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:41:56.948474 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d546cd87fd7dc35c5930910b8cd7e000d4669e950e6c57a2bf07536836201f\": container with ID starting with 05d546cd87fd7dc35c5930910b8cd7e000d4669e950e6c57a2bf07536836201f not found: ID does not exist" containerID="05d546cd87fd7dc35c5930910b8cd7e000d4669e950e6c57a2bf07536836201f" Jun 08 19:41:56.948535 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.948502 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d546cd87fd7dc35c5930910b8cd7e000d4669e950e6c57a2bf07536836201f"} err="failed to get container status \"05d546cd87fd7dc35c5930910b8cd7e000d4669e950e6c57a2bf07536836201f\": rpc error: code = NotFound desc = could not find container \"05d546cd87fd7dc35c5930910b8cd7e000d4669e950e6c57a2bf07536836201f\": container with ID starting with 05d546cd87fd7dc35c5930910b8cd7e000d4669e950e6c57a2bf07536836201f not found: ID does not exist" Jun 08 19:41:56.959971 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.959949 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86bbd4fc78-tfwrz"] Jun 08 19:41:56.962902 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.962878 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86bbd4fc78-tfwrz"] Jun 08 19:41:56.963258 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.963222 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-console-config\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:41:56.963304 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.963262 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-trusted-ca-bundle\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:41:56.963304 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.963272 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-service-ca\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:41:56.963304 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.963280 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8d77905-1991-45e3-aa76-1f6894698a01-oauth-serving-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:41:56.963304 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.963288 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7b2b\" (UniqueName: \"kubernetes.io/projected/f8d77905-1991-45e3-aa76-1f6894698a01-kube-api-access-f7b2b\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:41:56.963304 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.963300 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8d77905-1991-45e3-aa76-1f6894698a01-console-serving-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:41:56.963469 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:56.963308 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8d77905-1991-45e3-aa76-1f6894698a01-console-oauth-config\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:41:58.099438 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:41:58.099399 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8d77905-1991-45e3-aa76-1f6894698a01" path="/var/lib/kubelet/pods/f8d77905-1991-45e3-aa76-1f6894698a01/volumes" Jun 08 19:42:19.078282 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:19.078250 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:19.404276 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:19.404240 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:22.690300 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:22.690263 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:22.786464 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:22.786419 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:23.158696 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:23.158668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:23.261449 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:23.261415 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:24.030957 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:24.030914 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:24.123291 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:24.123254 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:24.220954 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:24.220917 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:26.287052 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.287018 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-2vp44"] Jun 08 19:42:26.287436 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.287345 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d77905-1991-45e3-aa76-1f6894698a01" containerName="console" Jun 08 19:42:26.287436 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.287357 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d77905-1991-45e3-aa76-1f6894698a01" containerName="console" Jun 08 19:42:26.287436 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.287425 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d77905-1991-45e3-aa76-1f6894698a01" containerName="console" Jun 08 19:42:26.291447 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.291428 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2vp44" Jun 08 19:42:26.294045 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.294009 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 19:42:26.294193 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.294060 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 19:42:26.295065 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.295049 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6tzsg\"" Jun 08 19:42:26.298471 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.298448 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-2vp44"] Jun 08 19:42:26.398305 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.398275 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb92b078-56ed-49fa-839d-bb5997f879f3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-2vp44\" (UID: \"eb92b078-56ed-49fa-839d-bb5997f879f3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2vp44" Jun 08 19:42:26.398482 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.398311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5clng\" (UniqueName: \"kubernetes.io/projected/eb92b078-56ed-49fa-839d-bb5997f879f3-kube-api-access-5clng\") pod \"cert-manager-webhook-7dc76cbb94-2vp44\" (UID: \"eb92b078-56ed-49fa-839d-bb5997f879f3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2vp44" Jun 08 19:42:26.499401 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.499362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb92b078-56ed-49fa-839d-bb5997f879f3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-2vp44\" (UID: \"eb92b078-56ed-49fa-839d-bb5997f879f3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2vp44" Jun 08 19:42:26.499401 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.499401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5clng\" (UniqueName: \"kubernetes.io/projected/eb92b078-56ed-49fa-839d-bb5997f879f3-kube-api-access-5clng\") pod \"cert-manager-webhook-7dc76cbb94-2vp44\" (UID: \"eb92b078-56ed-49fa-839d-bb5997f879f3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2vp44" Jun 08 19:42:26.508324 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.508295 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb92b078-56ed-49fa-839d-bb5997f879f3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-2vp44\" (UID: \"eb92b078-56ed-49fa-839d-bb5997f879f3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2vp44" Jun 08 19:42:26.508612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.508594 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5clng\" (UniqueName: \"kubernetes.io/projected/eb92b078-56ed-49fa-839d-bb5997f879f3-kube-api-access-5clng\") pod \"cert-manager-webhook-7dc76cbb94-2vp44\" (UID: \"eb92b078-56ed-49fa-839d-bb5997f879f3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2vp44" Jun 08 19:42:26.608612 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.608527 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2vp44" Jun 08 19:42:26.737768 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:26.737570 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-2vp44"] Jun 08 19:42:26.740485 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:42:26.740454 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb92b078_56ed_49fa_839d_bb5997f879f3.slice/crio-8c4c373fe1fa65114a141f179391f7736ecce131edf6fd8cc0a4a7c7242e2fbf WatchSource:0}: Error finding container 8c4c373fe1fa65114a141f179391f7736ecce131edf6fd8cc0a4a7c7242e2fbf: Status 404 returned error can't find the container with id 8c4c373fe1fa65114a141f179391f7736ecce131edf6fd8cc0a4a7c7242e2fbf Jun 08 19:42:27.062652 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.062612 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2vp44" event={"ID":"eb92b078-56ed-49fa-839d-bb5997f879f3","Type":"ContainerStarted","Data":"8c4c373fe1fa65114a141f179391f7736ecce131edf6fd8cc0a4a7c7242e2fbf"} Jun 08 19:42:27.526179 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.526138 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:27.610196 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.610148 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz"] Jun 08 19:42:27.613978 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.613954 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz" Jun 08 19:42:27.616723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.616694 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dmfvw\"" Jun 08 19:42:27.622512 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.622486 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz"] Jun 08 19:42:27.708947 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.708913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f223d29-2233-412a-8d22-c0f680737ec7-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-ng5mz\" (UID: \"6f223d29-2233-412a-8d22-c0f680737ec7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz" Jun 08 19:42:27.709147 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.708997 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvph2\" (UniqueName: \"kubernetes.io/projected/6f223d29-2233-412a-8d22-c0f680737ec7-kube-api-access-fvph2\") pod \"cert-manager-cainjector-5d99449ffd-ng5mz\" (UID: \"6f223d29-2233-412a-8d22-c0f680737ec7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz" Jun 08 19:42:27.809914 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.809820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvph2\" (UniqueName: \"kubernetes.io/projected/6f223d29-2233-412a-8d22-c0f680737ec7-kube-api-access-fvph2\") pod \"cert-manager-cainjector-5d99449ffd-ng5mz\" (UID: \"6f223d29-2233-412a-8d22-c0f680737ec7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz" Jun 08 19:42:27.810092 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.809919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f223d29-2233-412a-8d22-c0f680737ec7-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-ng5mz\" (UID: \"6f223d29-2233-412a-8d22-c0f680737ec7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz" Jun 08 19:42:27.819054 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.819018 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f223d29-2233-412a-8d22-c0f680737ec7-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-ng5mz\" (UID: \"6f223d29-2233-412a-8d22-c0f680737ec7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz" Jun 08 19:42:27.819271 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.819221 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvph2\" (UniqueName: \"kubernetes.io/projected/6f223d29-2233-412a-8d22-c0f680737ec7-kube-api-access-fvph2\") pod \"cert-manager-cainjector-5d99449ffd-ng5mz\" (UID: \"6f223d29-2233-412a-8d22-c0f680737ec7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz" Jun 08 19:42:27.910777 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.910739 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:27.927246 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:27.927203 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz" Jun 08 19:42:28.097256 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:28.097217 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz"] Jun 08 19:42:28.098941 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:42:28.098904 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f223d29_2233_412a_8d22_c0f680737ec7.slice/crio-c1c5ac9a230f87c86fa9710d6c0cbb6ab6f184e0a1760e38585fba4b6e3e37a4 WatchSource:0}: Error finding container c1c5ac9a230f87c86fa9710d6c0cbb6ab6f184e0a1760e38585fba4b6e3e37a4: Status 404 returned error can't find the container with id c1c5ac9a230f87c86fa9710d6c0cbb6ab6f184e0a1760e38585fba4b6e3e37a4 Jun 08 19:42:29.075486 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:29.075451 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz" event={"ID":"6f223d29-2233-412a-8d22-c0f680737ec7","Type":"ContainerStarted","Data":"c1c5ac9a230f87c86fa9710d6c0cbb6ab6f184e0a1760e38585fba4b6e3e37a4"} Jun 08 19:42:29.477710 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:29.477671 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:29.579591 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:29.579549 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:30.082332 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:30.082224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2vp44" event={"ID":"eb92b078-56ed-49fa-839d-bb5997f879f3","Type":"ContainerStarted","Data":"f345c5585eb535529b379de68cd94a66bb848979e120053423926fabc4b2022d"} Jun 08 19:42:30.082332 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:30.082327 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2vp44" Jun 08 19:42:30.083885 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:30.083859 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz" event={"ID":"6f223d29-2233-412a-8d22-c0f680737ec7","Type":"ContainerStarted","Data":"fed717953c77869da1c363508e44f1e724310c9747ea34a01e36e503dd99cb49"} Jun 08 19:42:30.105134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:30.105082 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2vp44" podStartSLOduration=1.016229395 podStartE2EDuration="4.105067372s" totalImagesPullingTime="3.088837977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:42:30.103896515 +0000 UTC m=+552.425069032" watchObservedRunningTime="2026-06-08 19:42:30.105067372 +0000 UTC m=+552.426239882" Jun 08 19:42:30.119963 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:30.119914 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ng5mz" podStartSLOduration=1.38724314 podStartE2EDuration="3.119900748s" totalImagesPullingTime="1.732657608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:42:30.118363032 +0000 UTC m=+552.439535553" watchObservedRunningTime="2026-06-08 19:42:30.119900748 +0000 UTC m=+552.441073264" Jun 08 19:42:34.886296 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:34.886262 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:34.986130 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:34.986095 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:35.107503 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:35.107468 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:36.095776 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:36.095749 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2vp44" Jun 08 19:42:40.404950 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:40.404902 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:41.659061 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:41.659025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:43.045250 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:43.045188 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:44.872724 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:44.872692 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-2wgvl"] Jun 08 19:42:44.876064 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:44.876046 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2wgvl" Jun 08 19:42:44.878561 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:44.878543 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-t5v2q\"" Jun 08 19:42:44.886213 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:44.886187 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2wgvl"] Jun 08 19:42:44.961048 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:44.961016 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbx2l\" (UniqueName: \"kubernetes.io/projected/55544d69-851f-424d-baf0-3e2cd2802212-kube-api-access-nbx2l\") pod \"cert-manager-59c77684cc-2wgvl\" (UID: \"55544d69-851f-424d-baf0-3e2cd2802212\") " pod="cert-manager/cert-manager-59c77684cc-2wgvl" Jun 08 19:42:44.961220 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:44.961059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55544d69-851f-424d-baf0-3e2cd2802212-bound-sa-token\") pod \"cert-manager-59c77684cc-2wgvl\" (UID: \"55544d69-851f-424d-baf0-3e2cd2802212\") " pod="cert-manager/cert-manager-59c77684cc-2wgvl" Jun 08 19:42:45.061870 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:45.061826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbx2l\" (UniqueName: \"kubernetes.io/projected/55544d69-851f-424d-baf0-3e2cd2802212-kube-api-access-nbx2l\") pod \"cert-manager-59c77684cc-2wgvl\" (UID: \"55544d69-851f-424d-baf0-3e2cd2802212\") " pod="cert-manager/cert-manager-59c77684cc-2wgvl" Jun 08 19:42:45.062049 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:45.061881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55544d69-851f-424d-baf0-3e2cd2802212-bound-sa-token\") pod \"cert-manager-59c77684cc-2wgvl\" (UID: \"55544d69-851f-424d-baf0-3e2cd2802212\") " pod="cert-manager/cert-manager-59c77684cc-2wgvl" Jun 08 19:42:45.069779 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:45.069752 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbx2l\" (UniqueName: \"kubernetes.io/projected/55544d69-851f-424d-baf0-3e2cd2802212-kube-api-access-nbx2l\") pod \"cert-manager-59c77684cc-2wgvl\" (UID: \"55544d69-851f-424d-baf0-3e2cd2802212\") " pod="cert-manager/cert-manager-59c77684cc-2wgvl" Jun 08 19:42:45.069883 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:45.069790 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55544d69-851f-424d-baf0-3e2cd2802212-bound-sa-token\") pod \"cert-manager-59c77684cc-2wgvl\" (UID: \"55544d69-851f-424d-baf0-3e2cd2802212\") " pod="cert-manager/cert-manager-59c77684cc-2wgvl" Jun 08 19:42:45.185482 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:45.185397 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2wgvl" Jun 08 19:42:45.313098 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:45.313073 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2wgvl"] Jun 08 19:42:45.315711 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:42:45.315681 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55544d69_851f_424d_baf0_3e2cd2802212.slice/crio-a4d8aa6038588f19aa2b04f096ea35dc3794de4f30e6979f8b7f6aea782f1d72 WatchSource:0}: Error finding container a4d8aa6038588f19aa2b04f096ea35dc3794de4f30e6979f8b7f6aea782f1d72: Status 404 returned error can't find the container with id a4d8aa6038588f19aa2b04f096ea35dc3794de4f30e6979f8b7f6aea782f1d72 Jun 08 19:42:46.157503 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:46.157468 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2wgvl" event={"ID":"55544d69-851f-424d-baf0-3e2cd2802212","Type":"ContainerStarted","Data":"3850757d4eddcb4d31a910e1ffa255314337103e2b3f0c23a6bd6ce846b5c8cc"} Jun 08 19:42:46.157503 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:46.157508 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2wgvl" event={"ID":"55544d69-851f-424d-baf0-3e2cd2802212","Type":"ContainerStarted","Data":"a4d8aa6038588f19aa2b04f096ea35dc3794de4f30e6979f8b7f6aea782f1d72"} Jun 08 19:42:46.175140 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:46.175093 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-2wgvl" podStartSLOduration=2.175078183 podStartE2EDuration="2.175078183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:42:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:42:46.173661481 +0000 UTC m=+568.494833998" watchObservedRunningTime="2026-06-08 19:42:46.175078183 +0000 UTC m=+568.496250699" Jun 08 19:42:56.682816 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:56.682762 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:42:56.747052 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:42:56.747017 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:07.161032 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:07.160996 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:07.762100 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:07.762044 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:07.962479 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:07.962451 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:08.108757 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.108675 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2"] Jun 08 19:43:08.112335 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.112305 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.115068 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.115042 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 19:43:08.115354 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.115330 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 19:43:08.115457 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.115426 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 19:43:08.115669 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.115654 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 19:43:08.115798 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.115783 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mxs88\"" Jun 08 19:43:08.130048 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.130023 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2"] Jun 08 19:43:08.137013 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.136985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/60479770-4571-46c3-899a-0e6fd8ac5b62-manifests\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.137107 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.137042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc9j7\" (UniqueName: \"kubernetes.io/projected/60479770-4571-46c3-899a-0e6fd8ac5b62-kube-api-access-dc9j7\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.137107 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.137084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/60479770-4571-46c3-899a-0e6fd8ac5b62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.137183 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.137160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60479770-4571-46c3-899a-0e6fd8ac5b62-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.137250 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.137216 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60479770-4571-46c3-899a-0e6fd8ac5b62-tmp\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.237835 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.237800 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60479770-4571-46c3-899a-0e6fd8ac5b62-tmp\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.238332 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.237844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/60479770-4571-46c3-899a-0e6fd8ac5b62-manifests\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.238332 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.237871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc9j7\" (UniqueName: \"kubernetes.io/projected/60479770-4571-46c3-899a-0e6fd8ac5b62-kube-api-access-dc9j7\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.238332 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.237897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/60479770-4571-46c3-899a-0e6fd8ac5b62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.238332 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.237925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60479770-4571-46c3-899a-0e6fd8ac5b62-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.238332 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.238322 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/60479770-4571-46c3-899a-0e6fd8ac5b62-manifests\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.240202 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.240175 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60479770-4571-46c3-899a-0e6fd8ac5b62-tmp\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.240425 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.240408 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/60479770-4571-46c3-899a-0e6fd8ac5b62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.240466 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.240432 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60479770-4571-46c3-899a-0e6fd8ac5b62-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.243506 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.243480 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:08.245661 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.245642 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc9j7\" (UniqueName: \"kubernetes.io/projected/60479770-4571-46c3-899a-0e6fd8ac5b62-kube-api-access-dc9j7\") pod \"opendatahub-operator-controller-manager-86b897fbc-lfwv2\" (UID: \"60479770-4571-46c3-899a-0e6fd8ac5b62\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.344933 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.344903 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:08.423340 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.423304 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:08.446594 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.446563 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:08.539102 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.539074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:08.562517 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.562482 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2"] Jun 08 19:43:08.566093 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:43:08.566062 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60479770_4571_46c3_899a_0e6fd8ac5b62.slice/crio-ba1d7614c21cf4ba78c7f9d0c3f79373097db2db7d6ad5358eb85060b7ed6b55 WatchSource:0}: Error finding container ba1d7614c21cf4ba78c7f9d0c3f79373097db2db7d6ad5358eb85060b7ed6b55: Status 404 returned error can't find the container with id ba1d7614c21cf4ba78c7f9d0c3f79373097db2db7d6ad5358eb85060b7ed6b55 Jun 08 19:43:08.596975 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.596949 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:08.693542 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:08.693457 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:09.259148 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:09.259109 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" event={"ID":"60479770-4571-46c3-899a-0e6fd8ac5b62","Type":"ContainerStarted","Data":"ba1d7614c21cf4ba78c7f9d0c3f79373097db2db7d6ad5358eb85060b7ed6b55"} Jun 08 19:43:11.247049 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:11.247014 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:11.344695 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:11.344648 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:12.280620 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:12.280578 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" event={"ID":"60479770-4571-46c3-899a-0e6fd8ac5b62","Type":"ContainerStarted","Data":"da19ab5b43730abf27814e138cd9796508c75aec9b5543601003f58bed6a5090"} Jun 08 19:43:13.287484 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:13.287450 2579 generic.go:356] "Generic (PLEG): container finished" podID="60479770-4571-46c3-899a-0e6fd8ac5b62" containerID="da19ab5b43730abf27814e138cd9796508c75aec9b5543601003f58bed6a5090" exitCode=0 Jun 08 19:43:13.287868 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:13.287546 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" event={"ID":"60479770-4571-46c3-899a-0e6fd8ac5b62","Type":"ContainerDied","Data":"da19ab5b43730abf27814e138cd9796508c75aec9b5543601003f58bed6a5090"} Jun 08 19:43:13.725510 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:13.725476 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:13.826035 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:13.825999 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:14.295909 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:14.295873 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" event={"ID":"60479770-4571-46c3-899a-0e6fd8ac5b62","Type":"ContainerStarted","Data":"3838180c310107819c2cdc6cd84f69ffca2689914fcfda8bef7e37a97fd39fd5"} Jun 08 19:43:14.296317 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:14.295995 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:14.321306 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:14.321219 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" podStartSLOduration=1.952927582 podStartE2EDuration="6.321199866s" totalImagesPullingTime="3.29453212s" totalInitContainerRuntime="1.073740164s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:43:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:43:14.319569683 +0000 UTC m=+596.640742199" watchObservedRunningTime="2026-06-08 19:43:14.321199866 +0000 UTC m=+596.642372383" Jun 08 19:43:18.076077 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:18.076050 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gj6rg_d241132c-eb3a-4381-8b55-ebec819c514f/ovn-acl-logging/0.log" Jun 08 19:43:18.077018 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:18.076992 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gj6rg_d241132c-eb3a-4381-8b55-ebec819c514f/ovn-acl-logging/0.log" Jun 08 19:43:23.705603 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:23.705570 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:24.129623 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:24.129587 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:24.231764 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:24.231725 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:25.303099 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:25.303069 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-lfwv2" Jun 08 19:43:26.826752 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:26.826718 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:26.940962 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:26.940921 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:27.712031 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:27.712001 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:27.810241 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:27.810208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:27.906329 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:27.906277 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:28.006980 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.006898 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:28.106480 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.106447 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:28.354111 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.354023 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:28.489691 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.489653 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:28.709572 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.709531 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:28.796397 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.796361 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:28.813959 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.813919 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5"] Jun 08 19:43:28.817521 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.817497 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" Jun 08 19:43:28.819827 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.819803 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 19:43:28.819937 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.819803 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 19:43:28.819937 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.819807 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-drck5\"" Jun 08 19:43:28.827343 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.827317 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5"] Jun 08 19:43:28.932298 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.932263 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9420919a-8d49-476f-84d9-8f1322833cd3-tls-certs\") pod \"kube-auth-proxy-65dcdb9d8c-6c4l5\" (UID: \"9420919a-8d49-476f-84d9-8f1322833cd3\") " pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" Jun 08 19:43:28.932709 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.932388 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9420919a-8d49-476f-84d9-8f1322833cd3-tmp\") pod \"kube-auth-proxy-65dcdb9d8c-6c4l5\" (UID: \"9420919a-8d49-476f-84d9-8f1322833cd3\") " pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" Jun 08 19:43:28.932709 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.932428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdlhx\" (UniqueName: \"kubernetes.io/projected/9420919a-8d49-476f-84d9-8f1322833cd3-kube-api-access-vdlhx\") pod \"kube-auth-proxy-65dcdb9d8c-6c4l5\" (UID: \"9420919a-8d49-476f-84d9-8f1322833cd3\") " pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" Jun 08 19:43:28.952027 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:28.951997 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:29.033189 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:29.033099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9420919a-8d49-476f-84d9-8f1322833cd3-tls-certs\") pod \"kube-auth-proxy-65dcdb9d8c-6c4l5\" (UID: \"9420919a-8d49-476f-84d9-8f1322833cd3\") " pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" Jun 08 19:43:29.033189 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:29.033169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9420919a-8d49-476f-84d9-8f1322833cd3-tmp\") pod \"kube-auth-proxy-65dcdb9d8c-6c4l5\" (UID: \"9420919a-8d49-476f-84d9-8f1322833cd3\") " pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" Jun 08 19:43:29.033439 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:29.033208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdlhx\" (UniqueName: \"kubernetes.io/projected/9420919a-8d49-476f-84d9-8f1322833cd3-kube-api-access-vdlhx\") pod \"kube-auth-proxy-65dcdb9d8c-6c4l5\" (UID: \"9420919a-8d49-476f-84d9-8f1322833cd3\") " pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" Jun 08 19:43:29.033439 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:43:29.033258 2579 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 08 19:43:29.033439 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:43:29.033370 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9420919a-8d49-476f-84d9-8f1322833cd3-tls-certs podName:9420919a-8d49-476f-84d9-8f1322833cd3 nodeName:}" failed. No retries permitted until 2026-06-08 19:43:29.533353843 +0000 UTC m=+611.854526337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9420919a-8d49-476f-84d9-8f1322833cd3-tls-certs") pod "kube-auth-proxy-65dcdb9d8c-6c4l5" (UID: "9420919a-8d49-476f-84d9-8f1322833cd3") : secret "kube-auth-proxy-tls" not found Jun 08 19:43:29.035448 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:29.035424 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9420919a-8d49-476f-84d9-8f1322833cd3-tmp\") pod \"kube-auth-proxy-65dcdb9d8c-6c4l5\" (UID: \"9420919a-8d49-476f-84d9-8f1322833cd3\") " pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" Jun 08 19:43:29.042487 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:29.042467 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdlhx\" (UniqueName: \"kubernetes.io/projected/9420919a-8d49-476f-84d9-8f1322833cd3-kube-api-access-vdlhx\") pod \"kube-auth-proxy-65dcdb9d8c-6c4l5\" (UID: \"9420919a-8d49-476f-84d9-8f1322833cd3\") " pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" Jun 08 19:43:29.324432 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:29.324340 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:29.538938 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:29.538903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9420919a-8d49-476f-84d9-8f1322833cd3-tls-certs\") pod \"kube-auth-proxy-65dcdb9d8c-6c4l5\" (UID: \"9420919a-8d49-476f-84d9-8f1322833cd3\") " pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" Jun 08 19:43:29.541410 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:29.541383 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9420919a-8d49-476f-84d9-8f1322833cd3-tls-certs\") pod \"kube-auth-proxy-65dcdb9d8c-6c4l5\" (UID: \"9420919a-8d49-476f-84d9-8f1322833cd3\") " pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" Jun 08 19:43:29.728419 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:29.728372 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" Jun 08 19:43:29.856884 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:29.856858 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5"] Jun 08 19:43:29.859123 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:43:29.859096 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9420919a_8d49_476f_84d9_8f1322833cd3.slice/crio-da3c9be3696ac81dcbccce289107d53da86bb3a7bce5bd8221194514930ea9c5 WatchSource:0}: Error finding container da3c9be3696ac81dcbccce289107d53da86bb3a7bce5bd8221194514930ea9c5: Status 404 returned error can't find the container with id da3c9be3696ac81dcbccce289107d53da86bb3a7bce5bd8221194514930ea9c5 Jun 08 19:43:29.861004 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:29.860990 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:43:30.376467 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:30.376428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" event={"ID":"9420919a-8d49-476f-84d9-8f1322833cd3","Type":"ContainerStarted","Data":"da3c9be3696ac81dcbccce289107d53da86bb3a7bce5bd8221194514930ea9c5"} Jun 08 19:43:33.395746 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:33.395709 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" event={"ID":"9420919a-8d49-476f-84d9-8f1322833cd3","Type":"ContainerStarted","Data":"d30eabd296de778c076233a8fdd2bb4f0d226f9dc05253fcefbfbf2507cd93f6"} Jun 08 19:43:33.412058 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:33.411996 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65dcdb9d8c-6c4l5" podStartSLOduration=2.262430459 podStartE2EDuration="5.411979532s" totalImagesPullingTime="3.149549073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:43:33.411701705 +0000 UTC m=+615.732874223" watchObservedRunningTime="2026-06-08 19:43:33.411979532 +0000 UTC m=+615.733152048" Jun 08 19:43:37.411745 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.411668 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6"] Jun 08 19:43:37.415506 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.415486 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.419484 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.419460 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:43:37.419484 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.419471 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 19:43:37.419683 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.419487 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 19:43:37.419683 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.419508 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 19:43:37.419683 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.419511 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 19:43:37.419683 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.419552 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-m6tdx\"" Jun 08 19:43:37.424537 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.424517 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6"] Jun 08 19:43:37.511899 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.511867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkw74\" (UniqueName: \"kubernetes.io/projected/98a9609d-c984-446f-bac4-ba1c66409c63-kube-api-access-xkw74\") pod \"lws-controller-manager-5bdd5486f5-w2cr6\" (UID: \"98a9609d-c984-446f-bac4-ba1c66409c63\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.512075 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.511906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/98a9609d-c984-446f-bac4-ba1c66409c63-metrics-cert\") pod \"lws-controller-manager-5bdd5486f5-w2cr6\" (UID: \"98a9609d-c984-446f-bac4-ba1c66409c63\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.512075 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.511991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98a9609d-c984-446f-bac4-ba1c66409c63-cert\") pod \"lws-controller-manager-5bdd5486f5-w2cr6\" (UID: \"98a9609d-c984-446f-bac4-ba1c66409c63\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.512075 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.512056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/98a9609d-c984-446f-bac4-ba1c66409c63-manager-config\") pod \"lws-controller-manager-5bdd5486f5-w2cr6\" (UID: \"98a9609d-c984-446f-bac4-ba1c66409c63\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.612672 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.612632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98a9609d-c984-446f-bac4-ba1c66409c63-cert\") pod \"lws-controller-manager-5bdd5486f5-w2cr6\" (UID: \"98a9609d-c984-446f-bac4-ba1c66409c63\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.612865 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.612702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/98a9609d-c984-446f-bac4-ba1c66409c63-manager-config\") pod \"lws-controller-manager-5bdd5486f5-w2cr6\" (UID: \"98a9609d-c984-446f-bac4-ba1c66409c63\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.612865 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.612752 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkw74\" (UniqueName: \"kubernetes.io/projected/98a9609d-c984-446f-bac4-ba1c66409c63-kube-api-access-xkw74\") pod \"lws-controller-manager-5bdd5486f5-w2cr6\" (UID: \"98a9609d-c984-446f-bac4-ba1c66409c63\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.612865 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.612781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/98a9609d-c984-446f-bac4-ba1c66409c63-metrics-cert\") pod \"lws-controller-manager-5bdd5486f5-w2cr6\" (UID: \"98a9609d-c984-446f-bac4-ba1c66409c63\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.613428 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.613406 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/98a9609d-c984-446f-bac4-ba1c66409c63-manager-config\") pod \"lws-controller-manager-5bdd5486f5-w2cr6\" (UID: \"98a9609d-c984-446f-bac4-ba1c66409c63\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.615150 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.615123 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/98a9609d-c984-446f-bac4-ba1c66409c63-metrics-cert\") pod \"lws-controller-manager-5bdd5486f5-w2cr6\" (UID: \"98a9609d-c984-446f-bac4-ba1c66409c63\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.615368 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.615347 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98a9609d-c984-446f-bac4-ba1c66409c63-cert\") pod \"lws-controller-manager-5bdd5486f5-w2cr6\" (UID: \"98a9609d-c984-446f-bac4-ba1c66409c63\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.629197 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.629174 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkw74\" (UniqueName: \"kubernetes.io/projected/98a9609d-c984-446f-bac4-ba1c66409c63-kube-api-access-xkw74\") pod \"lws-controller-manager-5bdd5486f5-w2cr6\" (UID: \"98a9609d-c984-446f-bac4-ba1c66409c63\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.726283 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.726137 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:37.921069 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:37.921018 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6"] Jun 08 19:43:37.923717 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:43:37.923688 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a9609d_c984_446f_bac4_ba1c66409c63.slice/crio-8ebf7ae815d68f18f1b3c76f76cbe7d6263c96d06ff7adb8b24b23417650c0f7 WatchSource:0}: Error finding container 8ebf7ae815d68f18f1b3c76f76cbe7d6263c96d06ff7adb8b24b23417650c0f7: Status 404 returned error can't find the container with id 8ebf7ae815d68f18f1b3c76f76cbe7d6263c96d06ff7adb8b24b23417650c0f7 Jun 08 19:43:38.419721 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:38.419689 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" event={"ID":"98a9609d-c984-446f-bac4-ba1c66409c63","Type":"ContainerStarted","Data":"8ebf7ae815d68f18f1b3c76f76cbe7d6263c96d06ff7adb8b24b23417650c0f7"} Jun 08 19:43:38.608864 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:38.608827 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:38.695106 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:38.694987 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:39.157293 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:39.157251 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:39.370187 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:39.370137 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:39.871394 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:39.871354 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:39.969802 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:39.969761 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:41.445796 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:41.445760 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" event={"ID":"98a9609d-c984-446f-bac4-ba1c66409c63","Type":"ContainerStarted","Data":"3821c23985716c41db00dd890c3caf0d1f7b25837045e4996425aff34b3b1d4f"} Jun 08 19:43:41.446200 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:41.445840 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:41.483137 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:41.483083 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" podStartSLOduration=1.85302019 podStartE2EDuration="4.483067224s" totalImagesPullingTime="2.630047034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:43:41.481081218 +0000 UTC m=+623.802253746" watchObservedRunningTime="2026-06-08 19:43:41.483067224 +0000 UTC m=+623.804239739" Jun 08 19:43:42.740905 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:42.740869 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:42.841270 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:42.841203 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:46.761361 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:46.761323 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:46.856117 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:46.856083 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:47.915508 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:47.915474 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:48.412911 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:48.412876 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:48.617153 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:48.617117 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:48.837257 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:48.837146 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:49.028472 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:49.028415 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:52.454323 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:52.454294 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-w2cr6" Jun 08 19:43:59.061329 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:59.061290 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:59.157065 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:59.157027 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:59.238026 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:59.237993 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:59.340445 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:59.340364 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:59.450644 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:59.450603 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:43:59.716545 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:43:59.716500 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:03.151204 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:03.151171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:03.218874 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:03.218837 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:03.437686 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:03.437611 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:03.751579 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:03.751505 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:03.825960 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:03.825931 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:04.448329 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:04.448296 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:28.211110 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:28.211039 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:28.400861 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:28.400824 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:28.495390 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:28.495316 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:28.557753 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:28.557721 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:52.118695 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:52.118660 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:55.970784 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:55.970747 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:56.064640 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:56.064602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:56.176643 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:56.176606 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:56.657349 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:56.657295 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:56.750281 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:56.750224 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:58.523559 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:58.523521 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:59.152826 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:59.152789 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:44:59.656837 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:44:59.656808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:01.568505 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:01.568468 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:02.553624 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:02.553592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:02.918274 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:02.918238 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:04.421676 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:04.421643 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:06.768663 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:06.768580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:06.863526 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:06.863487 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:06.964003 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:06.963972 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:07.075323 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:07.075239 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:07.732312 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:07.732277 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:07.834062 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:07.834026 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:11.165297 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:11.165260 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:11.387666 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:11.387625 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:16.929052 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:16.929017 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:17.043191 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.043159 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:17.246997 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.246915 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:17.340895 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.340859 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:17.881672 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.881638 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g"] Jun 08 19:45:17.885042 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.885022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" Jun 08 19:45:17.890289 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.887845 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 08 19:45:17.890289 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.887861 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f7k5b\"" Jun 08 19:45:17.890289 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.889784 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 19:45:17.890289 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.890033 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 08 19:45:17.893476 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.890698 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 19:45:17.894394 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.894356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d29982d0-4238-4a01-8f40-8d8012609c73-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8l8g\" (UID: \"d29982d0-4238-4a01-8f40-8d8012609c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" Jun 08 19:45:17.894506 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.894405 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d29982d0-4238-4a01-8f40-8d8012609c73-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x8l8g\" (UID: \"d29982d0-4238-4a01-8f40-8d8012609c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" Jun 08 19:45:17.894506 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.894442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvq4t\" (UniqueName: \"kubernetes.io/projected/d29982d0-4238-4a01-8f40-8d8012609c73-kube-api-access-dvq4t\") pod \"kuadrant-console-plugin-66b5774985-x8l8g\" (UID: \"d29982d0-4238-4a01-8f40-8d8012609c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" Jun 08 19:45:17.899450 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.899423 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g"] Jun 08 19:45:17.900148 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.900119 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:17.995371 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.995336 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d29982d0-4238-4a01-8f40-8d8012609c73-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8l8g\" (UID: \"d29982d0-4238-4a01-8f40-8d8012609c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" Jun 08 19:45:17.995371 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.995373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d29982d0-4238-4a01-8f40-8d8012609c73-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x8l8g\" (UID: \"d29982d0-4238-4a01-8f40-8d8012609c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" Jun 08 19:45:17.995895 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.995397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvq4t\" (UniqueName: \"kubernetes.io/projected/d29982d0-4238-4a01-8f40-8d8012609c73-kube-api-access-dvq4t\") pod \"kuadrant-console-plugin-66b5774985-x8l8g\" (UID: \"d29982d0-4238-4a01-8f40-8d8012609c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" Jun 08 19:45:17.995895 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:45:17.995493 2579 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 08 19:45:17.995895 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:45:17.995578 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29982d0-4238-4a01-8f40-8d8012609c73-plugin-serving-cert podName:d29982d0-4238-4a01-8f40-8d8012609c73 nodeName:}" failed. No retries permitted until 2026-06-08 19:45:18.49556066 +0000 UTC m=+720.816733153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/d29982d0-4238-4a01-8f40-8d8012609c73-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-x8l8g" (UID: "d29982d0-4238-4a01-8f40-8d8012609c73") : secret "plugin-serving-cert" not found Jun 08 19:45:17.996224 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:17.996204 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d29982d0-4238-4a01-8f40-8d8012609c73-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x8l8g\" (UID: \"d29982d0-4238-4a01-8f40-8d8012609c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" Jun 08 19:45:18.010439 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:18.010419 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 19:45:18.020298 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:18.020280 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 19:45:18.030545 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:18.030521 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvq4t\" (UniqueName: \"kubernetes.io/projected/d29982d0-4238-4a01-8f40-8d8012609c73-kube-api-access-dvq4t\") pod \"kuadrant-console-plugin-66b5774985-x8l8g\" (UID: \"d29982d0-4238-4a01-8f40-8d8012609c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" Jun 08 19:45:18.084407 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:18.084380 2579 scope.go:117] "RemoveContainer" containerID="0d8ed562e8dadb801d239beafb460b60eed094ce7c843559e78a3363dd6685c2" Jun 08 19:45:18.282797 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:18.282695 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:18.497996 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:18.497951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d29982d0-4238-4a01-8f40-8d8012609c73-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8l8g\" (UID: \"d29982d0-4238-4a01-8f40-8d8012609c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" Jun 08 19:45:18.500461 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:18.500443 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d29982d0-4238-4a01-8f40-8d8012609c73-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8l8g\" (UID: \"d29982d0-4238-4a01-8f40-8d8012609c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" Jun 08 19:45:18.505118 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:18.505100 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f7k5b\"" Jun 08 19:45:18.512983 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:18.512961 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" Jun 08 19:45:18.648124 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:18.648101 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g"] Jun 08 19:45:18.650428 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:45:18.650400 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd29982d0_4238_4a01_8f40_8d8012609c73.slice/crio-694bb30470966aba7cef1e138cab5c49b4706d469b37a303d917df49a91134f8 WatchSource:0}: Error finding container 694bb30470966aba7cef1e138cab5c49b4706d469b37a303d917df49a91134f8: Status 404 returned error can't find the container with id 694bb30470966aba7cef1e138cab5c49b4706d469b37a303d917df49a91134f8 Jun 08 19:45:18.903403 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:18.903364 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" event={"ID":"d29982d0-4238-4a01-8f40-8d8012609c73","Type":"ContainerStarted","Data":"694bb30470966aba7cef1e138cab5c49b4706d469b37a303d917df49a91134f8"} Jun 08 19:45:20.185717 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:20.185685 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:20.287528 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:20.287492 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:20.390406 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:20.390366 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:27.165013 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:27.164972 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:27.277825 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:27.277791 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:29.795570 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:29.795488 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:29.908129 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:29.908093 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:33.525503 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:33.525468 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:33.651202 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:33.651171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:34.805798 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:34.805764 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:34.903183 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:34.903142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:35.038437 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:35.038371 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:38.537946 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:38.537909 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:38.745422 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:38.745381 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:48.053723 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:48.053685 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" event={"ID":"d29982d0-4238-4a01-8f40-8d8012609c73","Type":"ContainerStarted","Data":"826142e74b9f769a45593fa490dd18aa6d9c7c42dd1bcbde9bd7df66d1777a3f"} Jun 08 19:45:48.086016 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:48.085962 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8l8g" podStartSLOduration=2.202918149 podStartE2EDuration="31.085943485s" totalImagesPullingTime="28.883025336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:45:48.083103282 +0000 UTC m=+750.404275819" watchObservedRunningTime="2026-06-08 19:45:48.085943485 +0000 UTC m=+750.407116001" Jun 08 19:45:59.127675 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:59.127579 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:45:59.262040 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:45:59.262002 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:03.218981 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:03.218945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:03.667482 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:03.667444 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:03.785390 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:03.785321 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:03.844145 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:03.844110 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:04.522007 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.521976 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-cq266"] Jun 08 19:46:04.543593 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.543563 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-cq266"] Jun 08 19:46:04.543740 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.543683 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cq266" Jun 08 19:46:04.546566 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.546544 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z5vlv\"" Jun 08 19:46:04.553791 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.553771 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:04.621611 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.621580 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j4kx\" (UniqueName: \"kubernetes.io/projected/5945be74-d5f0-4018-ad0a-c8f6632f09ec-kube-api-access-8j4kx\") pod \"authorino-58cd955675-cq266\" (UID: \"5945be74-d5f0-4018-ad0a-c8f6632f09ec\") " pod="kuadrant-system/authorino-58cd955675-cq266" Jun 08 19:46:04.654541 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.654500 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:04.722285 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.722223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j4kx\" (UniqueName: \"kubernetes.io/projected/5945be74-d5f0-4018-ad0a-c8f6632f09ec-kube-api-access-8j4kx\") pod \"authorino-58cd955675-cq266\" (UID: \"5945be74-d5f0-4018-ad0a-c8f6632f09ec\") " pod="kuadrant-system/authorino-58cd955675-cq266" Jun 08 19:46:04.734413 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.734381 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j4kx\" (UniqueName: \"kubernetes.io/projected/5945be74-d5f0-4018-ad0a-c8f6632f09ec-kube-api-access-8j4kx\") pod \"authorino-58cd955675-cq266\" (UID: \"5945be74-d5f0-4018-ad0a-c8f6632f09ec\") " pod="kuadrant-system/authorino-58cd955675-cq266" Jun 08 19:46:04.764111 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.764081 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-28rjf"] Jun 08 19:46:04.767639 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.767625 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-28rjf" Jun 08 19:46:04.775336 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.775314 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-28rjf"] Jun 08 19:46:04.823311 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.823281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7r46\" (UniqueName: \"kubernetes.io/projected/85b3008f-b574-4290-b177-7578079faa14-kube-api-access-p7r46\") pod \"authorino-75d556bd77-28rjf\" (UID: \"85b3008f-b574-4290-b177-7578079faa14\") " pod="kuadrant-system/authorino-75d556bd77-28rjf" Jun 08 19:46:04.853203 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.853172 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cq266" Jun 08 19:46:04.889534 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.889504 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:04.924602 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.924575 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7r46\" (UniqueName: \"kubernetes.io/projected/85b3008f-b574-4290-b177-7578079faa14-kube-api-access-p7r46\") pod \"authorino-75d556bd77-28rjf\" (UID: \"85b3008f-b574-4290-b177-7578079faa14\") " pod="kuadrant-system/authorino-75d556bd77-28rjf" Jun 08 19:46:04.933326 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:04.933303 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7r46\" (UniqueName: \"kubernetes.io/projected/85b3008f-b574-4290-b177-7578079faa14-kube-api-access-p7r46\") pod \"authorino-75d556bd77-28rjf\" (UID: \"85b3008f-b574-4290-b177-7578079faa14\") " pod="kuadrant-system/authorino-75d556bd77-28rjf" Jun 08 19:46:05.013790 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:05.013768 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-cq266"] Jun 08 19:46:05.016764 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:46:05.016738 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5945be74_d5f0_4018_ad0a_c8f6632f09ec.slice/crio-437f10202c391e41fd6611de166502b9bfc90ed044b8f9410cb9250617bcc5fe WatchSource:0}: Error finding container 437f10202c391e41fd6611de166502b9bfc90ed044b8f9410cb9250617bcc5fe: Status 404 returned error can't find the container with id 437f10202c391e41fd6611de166502b9bfc90ed044b8f9410cb9250617bcc5fe Jun 08 19:46:05.078721 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:05.078652 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-28rjf" Jun 08 19:46:05.131591 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:05.131553 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cq266" event={"ID":"5945be74-d5f0-4018-ad0a-c8f6632f09ec","Type":"ContainerStarted","Data":"437f10202c391e41fd6611de166502b9bfc90ed044b8f9410cb9250617bcc5fe"} Jun 08 19:46:05.211921 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:05.211879 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-28rjf"] Jun 08 19:46:05.216153 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:46:05.216126 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85b3008f_b574_4290_b177_7578079faa14.slice/crio-335baed8ffcc5dde4855c837d87f611edb3a508374e75662da2e85a539a654fd WatchSource:0}: Error finding container 335baed8ffcc5dde4855c837d87f611edb3a508374e75662da2e85a539a654fd: Status 404 returned error can't find the container with id 335baed8ffcc5dde4855c837d87f611edb3a508374e75662da2e85a539a654fd Jun 08 19:46:06.142126 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:06.142054 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-28rjf" event={"ID":"85b3008f-b574-4290-b177-7578079faa14","Type":"ContainerStarted","Data":"335baed8ffcc5dde4855c837d87f611edb3a508374e75662da2e85a539a654fd"} Jun 08 19:46:09.158664 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:09.158627 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-28rjf" event={"ID":"85b3008f-b574-4290-b177-7578079faa14","Type":"ContainerStarted","Data":"b52e53de621a29401cee9c216394a7517c536ae8606e7de2c75178dc54688d59"} Jun 08 19:46:09.160210 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:09.160181 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cq266" event={"ID":"5945be74-d5f0-4018-ad0a-c8f6632f09ec","Type":"ContainerStarted","Data":"b8b4d27229dfbfa24ea20ab751076e3e6f9b301e09d365adf1442c0fb511a143"} Jun 08 19:46:09.186092 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:09.186036 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-28rjf" podStartSLOduration=1.768772746 podStartE2EDuration="5.186015621s" totalImagesPullingTime="3.417242875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:46:09.184603671 +0000 UTC m=+771.505776187" watchObservedRunningTime="2026-06-08 19:46:09.186015621 +0000 UTC m=+771.507188140" Jun 08 19:46:09.216645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:09.216583 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-cq266" podStartSLOduration=1.611720295 podStartE2EDuration="5.216561517s" totalImagesPullingTime="3.604841222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:46:09.215115992 +0000 UTC m=+771.536288521" watchObservedRunningTime="2026-06-08 19:46:09.216561517 +0000 UTC m=+771.537734037" Jun 08 19:46:09.278379 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:09.278341 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-cq266"] Jun 08 19:46:11.168877 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:11.168841 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-cq266" podUID="5945be74-d5f0-4018-ad0a-c8f6632f09ec" containerName="authorino" containerID="cri-o://b8b4d27229dfbfa24ea20ab751076e3e6f9b301e09d365adf1442c0fb511a143" gracePeriod=30 Jun 08 19:46:11.419710 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:11.419653 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cq266" Jun 08 19:46:11.484346 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:11.484316 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8j4kx\" (UniqueName: \"kubernetes.io/projected/5945be74-d5f0-4018-ad0a-c8f6632f09ec-kube-api-access-8j4kx\") pod \"5945be74-d5f0-4018-ad0a-c8f6632f09ec\" (UID: \"5945be74-d5f0-4018-ad0a-c8f6632f09ec\") " Jun 08 19:46:11.486532 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:11.486503 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5945be74-d5f0-4018-ad0a-c8f6632f09ec-kube-api-access-8j4kx" (OuterVolumeSpecName: "kube-api-access-8j4kx") pod "5945be74-d5f0-4018-ad0a-c8f6632f09ec" (UID: "5945be74-d5f0-4018-ad0a-c8f6632f09ec"). InnerVolumeSpecName "kube-api-access-8j4kx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:46:11.585253 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:11.585189 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j4kx\" (UniqueName: \"kubernetes.io/projected/5945be74-d5f0-4018-ad0a-c8f6632f09ec-kube-api-access-8j4kx\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:46:12.174777 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:12.174745 2579 generic.go:356] "Generic (PLEG): container finished" podID="5945be74-d5f0-4018-ad0a-c8f6632f09ec" containerID="b8b4d27229dfbfa24ea20ab751076e3e6f9b301e09d365adf1442c0fb511a143" exitCode=0 Jun 08 19:46:12.175210 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:12.174799 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cq266" Jun 08 19:46:12.175210 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:12.174819 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cq266" event={"ID":"5945be74-d5f0-4018-ad0a-c8f6632f09ec","Type":"ContainerDied","Data":"b8b4d27229dfbfa24ea20ab751076e3e6f9b301e09d365adf1442c0fb511a143"} Jun 08 19:46:12.175210 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:12.174849 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cq266" event={"ID":"5945be74-d5f0-4018-ad0a-c8f6632f09ec","Type":"ContainerDied","Data":"437f10202c391e41fd6611de166502b9bfc90ed044b8f9410cb9250617bcc5fe"} Jun 08 19:46:12.175210 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:12.174864 2579 scope.go:117] "RemoveContainer" containerID="b8b4d27229dfbfa24ea20ab751076e3e6f9b301e09d365adf1442c0fb511a143" Jun 08 19:46:12.183328 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:12.183309 2579 scope.go:117] "RemoveContainer" containerID="b8b4d27229dfbfa24ea20ab751076e3e6f9b301e09d365adf1442c0fb511a143" Jun 08 19:46:12.183560 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:46:12.183543 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8b4d27229dfbfa24ea20ab751076e3e6f9b301e09d365adf1442c0fb511a143\": container with ID starting with b8b4d27229dfbfa24ea20ab751076e3e6f9b301e09d365adf1442c0fb511a143 not found: ID does not exist" containerID="b8b4d27229dfbfa24ea20ab751076e3e6f9b301e09d365adf1442c0fb511a143" Jun 08 19:46:12.183597 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:12.183567 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8b4d27229dfbfa24ea20ab751076e3e6f9b301e09d365adf1442c0fb511a143"} err="failed to get container status \"b8b4d27229dfbfa24ea20ab751076e3e6f9b301e09d365adf1442c0fb511a143\": rpc error: code = NotFound desc = could not find container \"b8b4d27229dfbfa24ea20ab751076e3e6f9b301e09d365adf1442c0fb511a143\": container with ID starting with b8b4d27229dfbfa24ea20ab751076e3e6f9b301e09d365adf1442c0fb511a143 not found: ID does not exist" Jun 08 19:46:12.197783 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:12.197749 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-cq266"] Jun 08 19:46:12.211554 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:12.211521 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-cq266"] Jun 08 19:46:13.860305 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:13.860270 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:13.915700 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:13.915670 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:14.096194 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:14.096150 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5945be74-d5f0-4018-ad0a-c8f6632f09ec" path="/var/lib/kubelet/pods/5945be74-d5f0-4018-ad0a-c8f6632f09ec/volumes" Jun 08 19:46:14.949811 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:14.949772 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:15.003609 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:15.003574 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:24.749348 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:24.749317 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:35.295634 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:35.295597 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:35.394586 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:35.394553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:35.543532 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:35.543498 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:59.666337 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:59.666300 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:46:59.769970 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:46:59.769938 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:00.073655 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.073573 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:47:00.073983 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.073970 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5945be74-d5f0-4018-ad0a-c8f6632f09ec" containerName="authorino" Jun 08 19:47:00.074025 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.073985 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5945be74-d5f0-4018-ad0a-c8f6632f09ec" containerName="authorino" Jun 08 19:47:00.074063 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.074056 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5945be74-d5f0-4018-ad0a-c8f6632f09ec" containerName="authorino" Jun 08 19:47:00.078708 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.078692 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 19:47:00.081320 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.081218 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 19:47:00.081420 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.081321 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 19:47:00.082358 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.082335 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-qvdx4\"" Jun 08 19:47:00.082475 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.082335 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 19:47:00.086611 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.086591 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:47:00.233770 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.233737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d8h9\" (UniqueName: \"kubernetes.io/projected/fd2c897d-aefe-4081-b961-6af069958bec-kube-api-access-7d8h9\") pod \"maas-keycloak-0\" (UID: \"fd2c897d-aefe-4081-b961-6af069958bec\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:47:00.334430 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.334337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d8h9\" (UniqueName: \"kubernetes.io/projected/fd2c897d-aefe-4081-b961-6af069958bec-kube-api-access-7d8h9\") pod \"maas-keycloak-0\" (UID: \"fd2c897d-aefe-4081-b961-6af069958bec\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:47:00.343925 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.343895 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d8h9\" (UniqueName: \"kubernetes.io/projected/fd2c897d-aefe-4081-b961-6af069958bec-kube-api-access-7d8h9\") pod \"maas-keycloak-0\" (UID: \"fd2c897d-aefe-4081-b961-6af069958bec\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:47:00.389501 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.389466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 19:47:00.528811 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:00.528766 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:47:00.531633 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:47:00.531605 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd2c897d_aefe_4081_b961_6af069958bec.slice/crio-9b87baf93df0b6dbc77b6a98f27514dda34a5a56639c53848adf97fc17a23863 WatchSource:0}: Error finding container 9b87baf93df0b6dbc77b6a98f27514dda34a5a56639c53848adf97fc17a23863: Status 404 returned error can't find the container with id 9b87baf93df0b6dbc77b6a98f27514dda34a5a56639c53848adf97fc17a23863 Jun 08 19:47:01.407412 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:01.407377 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fd2c897d-aefe-4081-b961-6af069958bec","Type":"ContainerStarted","Data":"9b87baf93df0b6dbc77b6a98f27514dda34a5a56639c53848adf97fc17a23863"} Jun 08 19:47:06.437387 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:06.437336 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fd2c897d-aefe-4081-b961-6af069958bec","Type":"ContainerStarted","Data":"b6b6c13cc4b729f9c2562010553f99917cddc169d901295b46bf369e39cefe10"} Jun 08 19:47:06.456222 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:06.455657 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.071370126 podStartE2EDuration="6.455634912s" totalImagesPullingTime="5.384264786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:47:06.455539089 +0000 UTC m=+828.776711599" watchObservedRunningTime="2026-06-08 19:47:06.455634912 +0000 UTC m=+828.776807429" Jun 08 19:47:07.390455 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:07.390395 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 19:47:07.392414 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:07.392368 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 08 19:47:08.390621 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:08.390573 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 08 19:47:09.390088 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:09.390022 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 08 19:47:10.390371 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:10.390325 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 19:47:10.390888 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:10.390720 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 08 19:47:11.390014 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:11.389964 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 08 19:47:12.390070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:12.390010 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 08 19:47:13.390530 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:13.390464 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 08 19:47:14.390334 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:14.390291 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 08 19:47:15.390308 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:15.390264 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 08 19:47:16.390724 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:16.390671 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 08 19:47:17.390650 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:17.390600 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 08 19:47:18.390670 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:18.390623 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.34:9000/health/started\": dial tcp 10.132.0.34:9000: connect: connection refused" Jun 08 19:47:19.518532 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:19.518489 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 19:47:19.535217 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:19.535167 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:47:29.524648 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:29.524615 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 19:47:30.188466 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.188428 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:30.401925 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.401885 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lfbtj"] Jun 08 19:47:30.408933 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.408897 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lfbtj" Jun 08 19:47:30.413385 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.413357 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lfbtj"] Jun 08 19:47:30.504778 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.504695 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:30.531030 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.530986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqwxq\" (UniqueName: \"kubernetes.io/projected/cef50d3b-e96c-4731-ade5-c47b99f85f14-kube-api-access-xqwxq\") pod \"authorino-5d4b67c446-lfbtj\" (UID: \"cef50d3b-e96c-4731-ade5-c47b99f85f14\") " pod="kuadrant-system/authorino-5d4b67c446-lfbtj" Jun 08 19:47:30.632419 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.632386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqwxq\" (UniqueName: \"kubernetes.io/projected/cef50d3b-e96c-4731-ade5-c47b99f85f14-kube-api-access-xqwxq\") pod \"authorino-5d4b67c446-lfbtj\" (UID: \"cef50d3b-e96c-4731-ade5-c47b99f85f14\") " pod="kuadrant-system/authorino-5d4b67c446-lfbtj" Jun 08 19:47:30.636897 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.636867 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lfbtj"] Jun 08 19:47:30.637185 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:47:30.637159 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xqwxq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-lfbtj" podUID="cef50d3b-e96c-4731-ade5-c47b99f85f14" Jun 08 19:47:30.641242 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.641203 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqwxq\" (UniqueName: \"kubernetes.io/projected/cef50d3b-e96c-4731-ade5-c47b99f85f14-kube-api-access-xqwxq\") pod \"authorino-5d4b67c446-lfbtj\" (UID: \"cef50d3b-e96c-4731-ade5-c47b99f85f14\") " pod="kuadrant-system/authorino-5d4b67c446-lfbtj" Jun 08 19:47:30.669138 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.669109 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fd4f79bdf-ghzs6"] Jun 08 19:47:30.672136 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.672121 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd4f79bdf-ghzs6" Jun 08 19:47:30.681162 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.681137 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fd4f79bdf-ghzs6"] Jun 08 19:47:30.733315 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.733284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld2kk\" (UniqueName: \"kubernetes.io/projected/7099db06-ed6f-40c9-9e29-403118bafec9-kube-api-access-ld2kk\") pod \"authorino-fd4f79bdf-ghzs6\" (UID: \"7099db06-ed6f-40c9-9e29-403118bafec9\") " pod="kuadrant-system/authorino-fd4f79bdf-ghzs6" Jun 08 19:47:30.833827 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.833745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld2kk\" (UniqueName: \"kubernetes.io/projected/7099db06-ed6f-40c9-9e29-403118bafec9-kube-api-access-ld2kk\") pod \"authorino-fd4f79bdf-ghzs6\" (UID: \"7099db06-ed6f-40c9-9e29-403118bafec9\") " pod="kuadrant-system/authorino-fd4f79bdf-ghzs6" Jun 08 19:47:30.843541 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.843518 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld2kk\" (UniqueName: \"kubernetes.io/projected/7099db06-ed6f-40c9-9e29-403118bafec9-kube-api-access-ld2kk\") pod \"authorino-fd4f79bdf-ghzs6\" (UID: \"7099db06-ed6f-40c9-9e29-403118bafec9\") " pod="kuadrant-system/authorino-fd4f79bdf-ghzs6" Jun 08 19:47:30.982432 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:30.982395 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd4f79bdf-ghzs6" Jun 08 19:47:31.115539 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:31.115516 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fd4f79bdf-ghzs6"] Jun 08 19:47:31.117757 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:47:31.117729 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7099db06_ed6f_40c9_9e29_403118bafec9.slice/crio-d8b6666efb9ec340095737907ce6e1533f1d4368d2c5ad410a8b9e025e2cdcc3 WatchSource:0}: Error finding container d8b6666efb9ec340095737907ce6e1533f1d4368d2c5ad410a8b9e025e2cdcc3: Status 404 returned error can't find the container with id d8b6666efb9ec340095737907ce6e1533f1d4368d2c5ad410a8b9e025e2cdcc3 Jun 08 19:47:31.592130 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:31.592051 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd4f79bdf-ghzs6" event={"ID":"7099db06-ed6f-40c9-9e29-403118bafec9","Type":"ContainerStarted","Data":"d8b6666efb9ec340095737907ce6e1533f1d4368d2c5ad410a8b9e025e2cdcc3"} Jun 08 19:47:31.592130 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:31.592069 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lfbtj" Jun 08 19:47:31.599359 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:31.599338 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lfbtj" Jun 08 19:47:31.640030 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:31.640004 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqwxq\" (UniqueName: \"kubernetes.io/projected/cef50d3b-e96c-4731-ade5-c47b99f85f14-kube-api-access-xqwxq\") pod \"cef50d3b-e96c-4731-ade5-c47b99f85f14\" (UID: \"cef50d3b-e96c-4731-ade5-c47b99f85f14\") " Jun 08 19:47:31.642245 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:31.642195 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cef50d3b-e96c-4731-ade5-c47b99f85f14-kube-api-access-xqwxq" (OuterVolumeSpecName: "kube-api-access-xqwxq") pod "cef50d3b-e96c-4731-ade5-c47b99f85f14" (UID: "cef50d3b-e96c-4731-ade5-c47b99f85f14"). InnerVolumeSpecName "kube-api-access-xqwxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:47:31.741608 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:31.741570 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqwxq\" (UniqueName: \"kubernetes.io/projected/cef50d3b-e96c-4731-ade5-c47b99f85f14-kube-api-access-xqwxq\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:47:32.598616 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:32.598576 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd4f79bdf-ghzs6" event={"ID":"7099db06-ed6f-40c9-9e29-403118bafec9","Type":"ContainerStarted","Data":"0cb00868e19368b0341f11547d92c12156faa6a15b82fc3c45b04cd4df5f1360"} Jun 08 19:47:32.598616 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:32.598585 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lfbtj" Jun 08 19:47:32.616833 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:32.616790 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-fd4f79bdf-ghzs6" podStartSLOduration=2.124459418 podStartE2EDuration="2.616775132s" totalImagesPullingTime="492.315714ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:47:32.615146897 +0000 UTC m=+854.936319424" watchObservedRunningTime="2026-06-08 19:47:32.616775132 +0000 UTC m=+854.937947653" Jun 08 19:47:32.645953 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:32.645914 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-28rjf"] Jun 08 19:47:32.646221 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:32.646143 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-28rjf" podUID="85b3008f-b574-4290-b177-7578079faa14" containerName="authorino" containerID="cri-o://b52e53de621a29401cee9c216394a7517c536ae8606e7de2c75178dc54688d59" gracePeriod=30 Jun 08 19:47:32.648740 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:32.648714 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lfbtj"] Jun 08 19:47:32.657531 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:32.657509 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lfbtj"] Jun 08 19:47:32.890266 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:32.890219 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-28rjf" Jun 08 19:47:32.952468 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:32.952437 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7r46\" (UniqueName: \"kubernetes.io/projected/85b3008f-b574-4290-b177-7578079faa14-kube-api-access-p7r46\") pod \"85b3008f-b574-4290-b177-7578079faa14\" (UID: \"85b3008f-b574-4290-b177-7578079faa14\") " Jun 08 19:47:32.954511 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:32.954486 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b3008f-b574-4290-b177-7578079faa14-kube-api-access-p7r46" (OuterVolumeSpecName: "kube-api-access-p7r46") pod "85b3008f-b574-4290-b177-7578079faa14" (UID: "85b3008f-b574-4290-b177-7578079faa14"). InnerVolumeSpecName "kube-api-access-p7r46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:47:33.053802 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:33.053764 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7r46\" (UniqueName: \"kubernetes.io/projected/85b3008f-b574-4290-b177-7578079faa14-kube-api-access-p7r46\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:47:33.604865 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:33.604825 2579 generic.go:356] "Generic (PLEG): container finished" podID="85b3008f-b574-4290-b177-7578079faa14" containerID="b52e53de621a29401cee9c216394a7517c536ae8606e7de2c75178dc54688d59" exitCode=0 Jun 08 19:47:33.604865 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:33.604862 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-28rjf" Jun 08 19:47:33.605370 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:33.604918 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-28rjf" event={"ID":"85b3008f-b574-4290-b177-7578079faa14","Type":"ContainerDied","Data":"b52e53de621a29401cee9c216394a7517c536ae8606e7de2c75178dc54688d59"} Jun 08 19:47:33.605370 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:33.604957 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-28rjf" event={"ID":"85b3008f-b574-4290-b177-7578079faa14","Type":"ContainerDied","Data":"335baed8ffcc5dde4855c837d87f611edb3a508374e75662da2e85a539a654fd"} Jun 08 19:47:33.605370 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:33.604979 2579 scope.go:117] "RemoveContainer" containerID="b52e53de621a29401cee9c216394a7517c536ae8606e7de2c75178dc54688d59" Jun 08 19:47:33.614678 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:33.614659 2579 scope.go:117] "RemoveContainer" containerID="b52e53de621a29401cee9c216394a7517c536ae8606e7de2c75178dc54688d59" Jun 08 19:47:33.614959 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:47:33.614939 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b52e53de621a29401cee9c216394a7517c536ae8606e7de2c75178dc54688d59\": container with ID starting with b52e53de621a29401cee9c216394a7517c536ae8606e7de2c75178dc54688d59 not found: ID does not exist" containerID="b52e53de621a29401cee9c216394a7517c536ae8606e7de2c75178dc54688d59" Jun 08 19:47:33.615010 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:33.614969 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52e53de621a29401cee9c216394a7517c536ae8606e7de2c75178dc54688d59"} err="failed to get container status \"b52e53de621a29401cee9c216394a7517c536ae8606e7de2c75178dc54688d59\": rpc error: code = NotFound desc = could not find container \"b52e53de621a29401cee9c216394a7517c536ae8606e7de2c75178dc54688d59\": container with ID starting with b52e53de621a29401cee9c216394a7517c536ae8606e7de2c75178dc54688d59 not found: ID does not exist" Jun 08 19:47:33.637405 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:33.637378 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-28rjf"] Jun 08 19:47:33.641318 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:33.641298 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-28rjf"] Jun 08 19:47:34.095791 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:34.095758 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85b3008f-b574-4290-b177-7578079faa14" path="/var/lib/kubelet/pods/85b3008f-b574-4290-b177-7578079faa14/volumes" Jun 08 19:47:34.096101 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:34.096088 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cef50d3b-e96c-4731-ade5-c47b99f85f14" path="/var/lib/kubelet/pods/cef50d3b-e96c-4731-ade5-c47b99f85f14/volumes" Jun 08 19:47:36.205208 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.205170 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:36.228387 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.228354 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f96d9445f-qlbrd"] Jun 08 19:47:36.228754 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.228740 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b3008f-b574-4290-b177-7578079faa14" containerName="authorino" Jun 08 19:47:36.228799 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.228756 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b3008f-b574-4290-b177-7578079faa14" containerName="authorino" Jun 08 19:47:36.228840 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.228812 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="85b3008f-b574-4290-b177-7578079faa14" containerName="authorino" Jun 08 19:47:36.233207 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.233187 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f96d9445f-qlbrd" Jun 08 19:47:36.241020 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.240717 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 19:47:36.241608 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.241572 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bsngd\"" Jun 08 19:47:36.241775 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.241755 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 19:47:36.246950 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.246928 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f96d9445f-qlbrd"] Jun 08 19:47:36.306980 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.306946 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:36.362657 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.362627 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:36.380750 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.380721 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a87fba39-a901-46ab-9153-c45f41d24deb-webhook-cert\") pod \"maas-controller-5f96d9445f-qlbrd\" (UID: \"a87fba39-a901-46ab-9153-c45f41d24deb\") " pod="opendatahub/maas-controller-5f96d9445f-qlbrd" Jun 08 19:47:36.380868 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.380762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfn5l\" (UniqueName: \"kubernetes.io/projected/a87fba39-a901-46ab-9153-c45f41d24deb-kube-api-access-vfn5l\") pod \"maas-controller-5f96d9445f-qlbrd\" (UID: \"a87fba39-a901-46ab-9153-c45f41d24deb\") " pod="opendatahub/maas-controller-5f96d9445f-qlbrd" Jun 08 19:47:36.421688 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.421658 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5484ddff6-k8wvj"] Jun 08 19:47:36.425159 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.425140 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5484ddff6-k8wvj" Jun 08 19:47:36.435028 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.434997 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5484ddff6-k8wvj"] Jun 08 19:47:36.481691 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.481601 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6xvq\" (UniqueName: \"kubernetes.io/projected/7836996f-4b88-4cb6-a09f-87c15cc0b3d4-kube-api-access-j6xvq\") pod \"maas-controller-5484ddff6-k8wvj\" (UID: \"7836996f-4b88-4cb6-a09f-87c15cc0b3d4\") " pod="opendatahub/maas-controller-5484ddff6-k8wvj" Jun 08 19:47:36.481691 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.481642 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a87fba39-a901-46ab-9153-c45f41d24deb-webhook-cert\") pod \"maas-controller-5f96d9445f-qlbrd\" (UID: \"a87fba39-a901-46ab-9153-c45f41d24deb\") " pod="opendatahub/maas-controller-5f96d9445f-qlbrd" Jun 08 19:47:36.481912 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.481698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfn5l\" (UniqueName: \"kubernetes.io/projected/a87fba39-a901-46ab-9153-c45f41d24deb-kube-api-access-vfn5l\") pod \"maas-controller-5f96d9445f-qlbrd\" (UID: \"a87fba39-a901-46ab-9153-c45f41d24deb\") " pod="opendatahub/maas-controller-5f96d9445f-qlbrd" Jun 08 19:47:36.481912 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.481751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7836996f-4b88-4cb6-a09f-87c15cc0b3d4-webhook-cert\") pod \"maas-controller-5484ddff6-k8wvj\" (UID: \"7836996f-4b88-4cb6-a09f-87c15cc0b3d4\") " pod="opendatahub/maas-controller-5484ddff6-k8wvj" Jun 08 19:47:36.481912 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:47:36.481759 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 08 19:47:36.481912 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:47:36.481821 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87fba39-a901-46ab-9153-c45f41d24deb-webhook-cert podName:a87fba39-a901-46ab-9153-c45f41d24deb nodeName:}" failed. No retries permitted until 2026-06-08 19:47:36.981801553 +0000 UTC m=+859.302974066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a87fba39-a901-46ab-9153-c45f41d24deb-webhook-cert") pod "maas-controller-5f96d9445f-qlbrd" (UID: "a87fba39-a901-46ab-9153-c45f41d24deb") : secret "maas-controller-webhook-cert" not found Jun 08 19:47:36.490990 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.490962 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfn5l\" (UniqueName: \"kubernetes.io/projected/a87fba39-a901-46ab-9153-c45f41d24deb-kube-api-access-vfn5l\") pod \"maas-controller-5f96d9445f-qlbrd\" (UID: \"a87fba39-a901-46ab-9153-c45f41d24deb\") " pod="opendatahub/maas-controller-5f96d9445f-qlbrd" Jun 08 19:47:36.582512 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.582477 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7836996f-4b88-4cb6-a09f-87c15cc0b3d4-webhook-cert\") pod \"maas-controller-5484ddff6-k8wvj\" (UID: \"7836996f-4b88-4cb6-a09f-87c15cc0b3d4\") " pod="opendatahub/maas-controller-5484ddff6-k8wvj" Jun 08 19:47:36.582700 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.582536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6xvq\" (UniqueName: \"kubernetes.io/projected/7836996f-4b88-4cb6-a09f-87c15cc0b3d4-kube-api-access-j6xvq\") pod \"maas-controller-5484ddff6-k8wvj\" (UID: \"7836996f-4b88-4cb6-a09f-87c15cc0b3d4\") " pod="opendatahub/maas-controller-5484ddff6-k8wvj" Jun 08 19:47:36.582700 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:47:36.582624 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 08 19:47:36.582700 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:47:36.582689 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7836996f-4b88-4cb6-a09f-87c15cc0b3d4-webhook-cert podName:7836996f-4b88-4cb6-a09f-87c15cc0b3d4 nodeName:}" failed. No retries permitted until 2026-06-08 19:47:37.082672833 +0000 UTC m=+859.403845327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7836996f-4b88-4cb6-a09f-87c15cc0b3d4-webhook-cert") pod "maas-controller-5484ddff6-k8wvj" (UID: "7836996f-4b88-4cb6-a09f-87c15cc0b3d4") : secret "maas-controller-webhook-cert" not found Jun 08 19:47:36.599467 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.599446 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6xvq\" (UniqueName: \"kubernetes.io/projected/7836996f-4b88-4cb6-a09f-87c15cc0b3d4-kube-api-access-j6xvq\") pod \"maas-controller-5484ddff6-k8wvj\" (UID: \"7836996f-4b88-4cb6-a09f-87c15cc0b3d4\") " pod="opendatahub/maas-controller-5484ddff6-k8wvj" Jun 08 19:47:36.986784 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.986746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a87fba39-a901-46ab-9153-c45f41d24deb-webhook-cert\") pod \"maas-controller-5f96d9445f-qlbrd\" (UID: \"a87fba39-a901-46ab-9153-c45f41d24deb\") " pod="opendatahub/maas-controller-5f96d9445f-qlbrd" Jun 08 19:47:36.989280 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.989254 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a87fba39-a901-46ab-9153-c45f41d24deb-webhook-cert\") pod \"maas-controller-5f96d9445f-qlbrd\" (UID: \"a87fba39-a901-46ab-9153-c45f41d24deb\") " pod="opendatahub/maas-controller-5f96d9445f-qlbrd" Jun 08 19:47:36.993502 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:36.993472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:37.087655 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:37.087619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7836996f-4b88-4cb6-a09f-87c15cc0b3d4-webhook-cert\") pod \"maas-controller-5484ddff6-k8wvj\" (UID: \"7836996f-4b88-4cb6-a09f-87c15cc0b3d4\") " pod="opendatahub/maas-controller-5484ddff6-k8wvj" Jun 08 19:47:37.090100 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:37.090074 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7836996f-4b88-4cb6-a09f-87c15cc0b3d4-webhook-cert\") pod \"maas-controller-5484ddff6-k8wvj\" (UID: \"7836996f-4b88-4cb6-a09f-87c15cc0b3d4\") " pod="opendatahub/maas-controller-5484ddff6-k8wvj" Jun 08 19:47:37.145216 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:37.145171 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f96d9445f-qlbrd" Jun 08 19:47:37.283505 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:37.283430 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f96d9445f-qlbrd"] Jun 08 19:47:37.286711 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:47:37.286684 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87fba39_a901_46ab_9153_c45f41d24deb.slice/crio-efc32f741699303be469f0268de5fe25091b14015a7eb5d2c62b631e977b1ff1 WatchSource:0}: Error finding container efc32f741699303be469f0268de5fe25091b14015a7eb5d2c62b631e977b1ff1: Status 404 returned error can't find the container with id efc32f741699303be469f0268de5fe25091b14015a7eb5d2c62b631e977b1ff1 Jun 08 19:47:37.338123 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:37.338093 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5484ddff6-k8wvj" Jun 08 19:47:37.479694 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:37.479665 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5484ddff6-k8wvj"] Jun 08 19:47:37.481736 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:47:37.481708 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7836996f_4b88_4cb6_a09f_87c15cc0b3d4.slice/crio-7b7fd4a7fbc610e8f1d3d11fc63c63ae1c8e390abff7b1c00899fe1696cd2fa0 WatchSource:0}: Error finding container 7b7fd4a7fbc610e8f1d3d11fc63c63ae1c8e390abff7b1c00899fe1696cd2fa0: Status 404 returned error can't find the container with id 7b7fd4a7fbc610e8f1d3d11fc63c63ae1c8e390abff7b1c00899fe1696cd2fa0 Jun 08 19:47:37.626902 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:37.626864 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5484ddff6-k8wvj" event={"ID":"7836996f-4b88-4cb6-a09f-87c15cc0b3d4","Type":"ContainerStarted","Data":"7b7fd4a7fbc610e8f1d3d11fc63c63ae1c8e390abff7b1c00899fe1696cd2fa0"} Jun 08 19:47:37.627913 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:37.627882 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f96d9445f-qlbrd" event={"ID":"a87fba39-a901-46ab-9153-c45f41d24deb","Type":"ContainerStarted","Data":"efc32f741699303be469f0268de5fe25091b14015a7eb5d2c62b631e977b1ff1"} Jun 08 19:47:40.116772 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:40.116735 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:40.239938 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:40.239857 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:47:40.647205 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:40.647164 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5484ddff6-k8wvj" event={"ID":"7836996f-4b88-4cb6-a09f-87c15cc0b3d4","Type":"ContainerStarted","Data":"833d6839f053d9ecfcd4eb56432dd3052fc6c613f960cb291ca76e96fbc2e632"} Jun 08 19:47:40.647412 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:40.647244 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5484ddff6-k8wvj" Jun 08 19:47:40.648645 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:40.648622 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f96d9445f-qlbrd" event={"ID":"a87fba39-a901-46ab-9153-c45f41d24deb","Type":"ContainerStarted","Data":"f36a8b75f901d10073c2c026c533e6e55fbcfc335d516bc826348f2b50f2abda"} Jun 08 19:47:40.648765 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:40.648754 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f96d9445f-qlbrd" Jun 08 19:47:40.667132 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:40.667070 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5484ddff6-k8wvj" podStartSLOduration=2.222613036 podStartE2EDuration="4.667051562s" totalImagesPullingTime="2.444438526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:47:40.664950062 +0000 UTC m=+862.986122578" watchObservedRunningTime="2026-06-08 19:47:40.667051562 +0000 UTC m=+862.988224079" Jun 08 19:47:40.685065 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:40.685017 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f96d9445f-qlbrd" podStartSLOduration=2.051358678 podStartE2EDuration="4.685002188s" totalImagesPullingTime="2.63364351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:47:40.683471799 +0000 UTC m=+863.004644316" watchObservedRunningTime="2026-06-08 19:47:40.685002188 +0000 UTC m=+863.006174703" Jun 08 19:47:51.659370 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:51.659336 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f96d9445f-qlbrd" Jun 08 19:47:51.659775 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:51.659638 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5484ddff6-k8wvj" Jun 08 19:47:51.724596 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:51.724562 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f96d9445f-qlbrd"] Jun 08 19:47:51.724780 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:51.724744 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5f96d9445f-qlbrd" podUID="a87fba39-a901-46ab-9153-c45f41d24deb" containerName="manager" containerID="cri-o://f36a8b75f901d10073c2c026c533e6e55fbcfc335d516bc826348f2b50f2abda" gracePeriod=30 Jun 08 19:47:51.973936 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:51.973913 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f96d9445f-qlbrd" Jun 08 19:47:52.120382 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.120352 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a87fba39-a901-46ab-9153-c45f41d24deb-webhook-cert\") pod \"a87fba39-a901-46ab-9153-c45f41d24deb\" (UID: \"a87fba39-a901-46ab-9153-c45f41d24deb\") " Jun 08 19:47:52.120552 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.120452 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfn5l\" (UniqueName: \"kubernetes.io/projected/a87fba39-a901-46ab-9153-c45f41d24deb-kube-api-access-vfn5l\") pod \"a87fba39-a901-46ab-9153-c45f41d24deb\" (UID: \"a87fba39-a901-46ab-9153-c45f41d24deb\") " Jun 08 19:47:52.122518 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.122489 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a87fba39-a901-46ab-9153-c45f41d24deb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a87fba39-a901-46ab-9153-c45f41d24deb" (UID: "a87fba39-a901-46ab-9153-c45f41d24deb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:47:52.122518 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.122509 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a87fba39-a901-46ab-9153-c45f41d24deb-kube-api-access-vfn5l" (OuterVolumeSpecName: "kube-api-access-vfn5l") pod "a87fba39-a901-46ab-9153-c45f41d24deb" (UID: "a87fba39-a901-46ab-9153-c45f41d24deb"). InnerVolumeSpecName "kube-api-access-vfn5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:47:52.221211 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.221130 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfn5l\" (UniqueName: \"kubernetes.io/projected/a87fba39-a901-46ab-9153-c45f41d24deb-kube-api-access-vfn5l\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:47:52.221211 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.221159 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a87fba39-a901-46ab-9153-c45f41d24deb-webhook-cert\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:47:52.712623 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.712586 2579 generic.go:356] "Generic (PLEG): container finished" podID="a87fba39-a901-46ab-9153-c45f41d24deb" containerID="f36a8b75f901d10073c2c026c533e6e55fbcfc335d516bc826348f2b50f2abda" exitCode=0 Jun 08 19:47:52.713059 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.712638 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f96d9445f-qlbrd" Jun 08 19:47:52.713059 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.712677 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f96d9445f-qlbrd" event={"ID":"a87fba39-a901-46ab-9153-c45f41d24deb","Type":"ContainerDied","Data":"f36a8b75f901d10073c2c026c533e6e55fbcfc335d516bc826348f2b50f2abda"} Jun 08 19:47:52.713059 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.712749 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f96d9445f-qlbrd" event={"ID":"a87fba39-a901-46ab-9153-c45f41d24deb","Type":"ContainerDied","Data":"efc32f741699303be469f0268de5fe25091b14015a7eb5d2c62b631e977b1ff1"} Jun 08 19:47:52.713059 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.712789 2579 scope.go:117] "RemoveContainer" containerID="f36a8b75f901d10073c2c026c533e6e55fbcfc335d516bc826348f2b50f2abda" Jun 08 19:47:52.721897 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.721882 2579 scope.go:117] "RemoveContainer" containerID="f36a8b75f901d10073c2c026c533e6e55fbcfc335d516bc826348f2b50f2abda" Jun 08 19:47:52.722132 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:47:52.722115 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f36a8b75f901d10073c2c026c533e6e55fbcfc335d516bc826348f2b50f2abda\": container with ID starting with f36a8b75f901d10073c2c026c533e6e55fbcfc335d516bc826348f2b50f2abda not found: ID does not exist" containerID="f36a8b75f901d10073c2c026c533e6e55fbcfc335d516bc826348f2b50f2abda" Jun 08 19:47:52.722198 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.722144 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f36a8b75f901d10073c2c026c533e6e55fbcfc335d516bc826348f2b50f2abda"} err="failed to get container status \"f36a8b75f901d10073c2c026c533e6e55fbcfc335d516bc826348f2b50f2abda\": rpc error: code = NotFound desc = could not find container \"f36a8b75f901d10073c2c026c533e6e55fbcfc335d516bc826348f2b50f2abda\": container with ID starting with f36a8b75f901d10073c2c026c533e6e55fbcfc335d516bc826348f2b50f2abda not found: ID does not exist" Jun 08 19:47:52.744107 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.744073 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f96d9445f-qlbrd"] Jun 08 19:47:52.747793 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:52.747770 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f96d9445f-qlbrd"] Jun 08 19:47:54.096378 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:47:54.096346 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a87fba39-a901-46ab-9153-c45f41d24deb" path="/var/lib/kubelet/pods/a87fba39-a901-46ab-9153-c45f41d24deb/volumes" Jun 08 19:48:14.094252 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.094149 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:14.662211 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.662172 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-4qt8r"] Jun 08 19:48:14.662602 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.662588 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a87fba39-a901-46ab-9153-c45f41d24deb" containerName="manager" Jun 08 19:48:14.662655 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.662604 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a87fba39-a901-46ab-9153-c45f41d24deb" containerName="manager" Jun 08 19:48:14.662691 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.662683 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a87fba39-a901-46ab-9153-c45f41d24deb" containerName="manager" Jun 08 19:48:14.668625 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.668602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-4qt8r" Jun 08 19:48:14.671314 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.671291 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jhfkh\"" Jun 08 19:48:14.671585 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.671570 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 19:48:14.675276 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.675246 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-4qt8r"] Jun 08 19:48:14.685459 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.685436 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-g8d2t"] Jun 08 19:48:14.689920 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.689900 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" Jun 08 19:48:14.699342 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.699320 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-g8d2t"] Jun 08 19:48:14.704282 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.704253 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czvmz\" (UniqueName: \"kubernetes.io/projected/50213186-d896-4da6-a4b3-4aaa3cb22b60-kube-api-access-czvmz\") pod \"payload-processing-7c6c859784-g8d2t\" (UID: \"50213186-d896-4da6-a4b3-4aaa3cb22b60\") " pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" Jun 08 19:48:14.704376 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.704300 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf85z\" (UniqueName: \"kubernetes.io/projected/9b87d1e0-8cff-4efb-8ea2-5624ae5ad435-kube-api-access-nf85z\") pod \"payload-pre-processing-67d7689b65-4qt8r\" (UID: \"9b87d1e0-8cff-4efb-8ea2-5624ae5ad435\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-4qt8r" Jun 08 19:48:14.805573 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.805538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czvmz\" (UniqueName: \"kubernetes.io/projected/50213186-d896-4da6-a4b3-4aaa3cb22b60-kube-api-access-czvmz\") pod \"payload-processing-7c6c859784-g8d2t\" (UID: \"50213186-d896-4da6-a4b3-4aaa3cb22b60\") " pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" Jun 08 19:48:14.805573 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.805574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf85z\" (UniqueName: \"kubernetes.io/projected/9b87d1e0-8cff-4efb-8ea2-5624ae5ad435-kube-api-access-nf85z\") pod \"payload-pre-processing-67d7689b65-4qt8r\" (UID: \"9b87d1e0-8cff-4efb-8ea2-5624ae5ad435\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-4qt8r" Jun 08 19:48:14.818633 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.818604 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf85z\" (UniqueName: \"kubernetes.io/projected/9b87d1e0-8cff-4efb-8ea2-5624ae5ad435-kube-api-access-nf85z\") pod \"payload-pre-processing-67d7689b65-4qt8r\" (UID: \"9b87d1e0-8cff-4efb-8ea2-5624ae5ad435\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-4qt8r" Jun 08 19:48:14.818890 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.818865 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czvmz\" (UniqueName: \"kubernetes.io/projected/50213186-d896-4da6-a4b3-4aaa3cb22b60-kube-api-access-czvmz\") pod \"payload-processing-7c6c859784-g8d2t\" (UID: \"50213186-d896-4da6-a4b3-4aaa3cb22b60\") " pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" Jun 08 19:48:14.981213 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:14.981130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-4qt8r" Jun 08 19:48:15.000083 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:15.000057 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" Jun 08 19:48:15.128648 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:15.128609 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-4qt8r"] Jun 08 19:48:15.130116 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:48:15.130077 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b87d1e0_8cff_4efb_8ea2_5624ae5ad435.slice/crio-b350535da53f06beef12b11067c303030ee85cf714b01d0e6150b69c228dfe09 WatchSource:0}: Error finding container b350535da53f06beef12b11067c303030ee85cf714b01d0e6150b69c228dfe09: Status 404 returned error can't find the container with id b350535da53f06beef12b11067c303030ee85cf714b01d0e6150b69c228dfe09 Jun 08 19:48:15.155070 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:15.155043 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-g8d2t"] Jun 08 19:48:15.157152 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:48:15.157125 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50213186_d896_4da6_a4b3_4aaa3cb22b60.slice/crio-7b63e2774ffefd609095869c9e815c29a4fce3f299e151c519972b283f13e223 WatchSource:0}: Error finding container 7b63e2774ffefd609095869c9e815c29a4fce3f299e151c519972b283f13e223: Status 404 returned error can't find the container with id 7b63e2774ffefd609095869c9e815c29a4fce3f299e151c519972b283f13e223 Jun 08 19:48:15.273941 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:15.273828 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:15.835129 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:15.835058 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" event={"ID":"50213186-d896-4da6-a4b3-4aaa3cb22b60","Type":"ContainerStarted","Data":"7b63e2774ffefd609095869c9e815c29a4fce3f299e151c519972b283f13e223"} Jun 08 19:48:15.837082 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:15.837046 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-4qt8r" event={"ID":"9b87d1e0-8cff-4efb-8ea2-5624ae5ad435","Type":"ContainerStarted","Data":"b350535da53f06beef12b11067c303030ee85cf714b01d0e6150b69c228dfe09"} Jun 08 19:48:16.843115 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:16.843015 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" event={"ID":"50213186-d896-4da6-a4b3-4aaa3cb22b60","Type":"ContainerStarted","Data":"30c7be0f8a4547da361f4d6f3a6a99cd8418b3aed18ce79a385517a6b23216f3"} Jun 08 19:48:16.843578 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:16.843117 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" Jun 08 19:48:16.844592 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:16.844569 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-4qt8r" event={"ID":"9b87d1e0-8cff-4efb-8ea2-5624ae5ad435","Type":"ContainerStarted","Data":"fd055df1a5513bcd738f8ac7d9ece3f6164809fba9bd1880dcdc9be35e9ca65c"} Jun 08 19:48:16.844690 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:16.844617 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-4qt8r" Jun 08 19:48:16.860902 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:16.860858 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" podStartSLOduration=1.41412113 podStartE2EDuration="2.860846174s" totalImagesPullingTime="1.446725044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:48:16.859364507 +0000 UTC m=+899.180537023" watchObservedRunningTime="2026-06-08 19:48:16.860846174 +0000 UTC m=+899.182018690" Jun 08 19:48:16.875009 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:16.874966 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-4qt8r" podStartSLOduration=1.420760974 podStartE2EDuration="2.874950677s" totalImagesPullingTime="1.454189703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:48:16.873702962 +0000 UTC m=+899.194875479" watchObservedRunningTime="2026-06-08 19:48:16.874950677 +0000 UTC m=+899.196123193" Jun 08 19:48:18.111051 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:18.111022 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gj6rg_d241132c-eb3a-4381-8b55-ebec819c514f/ovn-acl-logging/0.log" Jun 08 19:48:18.111986 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:18.111962 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gj6rg_d241132c-eb3a-4381-8b55-ebec819c514f/ovn-acl-logging/0.log" Jun 08 19:48:25.358943 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:25.358906 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:48:25.361365 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:25.359109 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" containerID="cri-o://b6b6c13cc4b729f9c2562010553f99917cddc169d901295b46bf369e39cefe10" gracePeriod=30 Jun 08 19:48:26.894133 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:26.894100 2579 generic.go:356] "Generic (PLEG): container finished" podID="fd2c897d-aefe-4081-b961-6af069958bec" containerID="b6b6c13cc4b729f9c2562010553f99917cddc169d901295b46bf369e39cefe10" exitCode=143 Jun 08 19:48:26.894517 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:26.894186 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fd2c897d-aefe-4081-b961-6af069958bec","Type":"ContainerDied","Data":"b6b6c13cc4b729f9c2562010553f99917cddc169d901295b46bf369e39cefe10"} Jun 08 19:48:27.409791 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.409767 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 19:48:27.519741 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.519707 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d8h9\" (UniqueName: \"kubernetes.io/projected/fd2c897d-aefe-4081-b961-6af069958bec-kube-api-access-7d8h9\") pod \"fd2c897d-aefe-4081-b961-6af069958bec\" (UID: \"fd2c897d-aefe-4081-b961-6af069958bec\") " Jun 08 19:48:27.521851 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.521827 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd2c897d-aefe-4081-b961-6af069958bec-kube-api-access-7d8h9" (OuterVolumeSpecName: "kube-api-access-7d8h9") pod "fd2c897d-aefe-4081-b961-6af069958bec" (UID: "fd2c897d-aefe-4081-b961-6af069958bec"). InnerVolumeSpecName "kube-api-access-7d8h9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:48:27.620306 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.620266 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d8h9\" (UniqueName: \"kubernetes.io/projected/fd2c897d-aefe-4081-b961-6af069958bec-kube-api-access-7d8h9\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:48:27.851775 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.851695 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" Jun 08 19:48:27.851921 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.851858 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-4qt8r" Jun 08 19:48:27.905349 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.905308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fd2c897d-aefe-4081-b961-6af069958bec","Type":"ContainerDied","Data":"9b87baf93df0b6dbc77b6a98f27514dda34a5a56639c53848adf97fc17a23863"} Jun 08 19:48:27.905349 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.905335 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 19:48:27.905873 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.905376 2579 scope.go:117] "RemoveContainer" containerID="b6b6c13cc4b729f9c2562010553f99917cddc169d901295b46bf369e39cefe10" Jun 08 19:48:27.926409 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.926386 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:48:27.929943 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.929918 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:48:27.950179 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.950146 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:48:27.950695 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.950672 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" Jun 08 19:48:27.950856 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.950841 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" Jun 08 19:48:27.951127 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.951109 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd2c897d-aefe-4081-b961-6af069958bec" containerName="keycloak" Jun 08 19:48:27.955396 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.955377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 19:48:27.958434 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.958413 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 19:48:27.958547 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.958480 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-qvdx4\"" Jun 08 19:48:27.958613 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.958562 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 19:48:27.958698 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.958682 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 19:48:27.958737 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.958715 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 08 19:48:27.963171 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:27.963089 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:48:28.023933 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:28.023899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hsgm\" (UniqueName: \"kubernetes.io/projected/dedc2850-1069-4376-a0fb-9d00e9607534-kube-api-access-7hsgm\") pod \"maas-keycloak-0\" (UID: \"dedc2850-1069-4376-a0fb-9d00e9607534\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:48:28.024094 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:28.023943 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/dedc2850-1069-4376-a0fb-9d00e9607534-test-realms\") pod \"maas-keycloak-0\" (UID: \"dedc2850-1069-4376-a0fb-9d00e9607534\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:48:28.096579 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:28.096543 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd2c897d-aefe-4081-b961-6af069958bec" path="/var/lib/kubelet/pods/fd2c897d-aefe-4081-b961-6af069958bec/volumes" Jun 08 19:48:28.124748 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:28.124724 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hsgm\" (UniqueName: \"kubernetes.io/projected/dedc2850-1069-4376-a0fb-9d00e9607534-kube-api-access-7hsgm\") pod \"maas-keycloak-0\" (UID: \"dedc2850-1069-4376-a0fb-9d00e9607534\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:48:28.124890 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:28.124766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/dedc2850-1069-4376-a0fb-9d00e9607534-test-realms\") pod \"maas-keycloak-0\" (UID: \"dedc2850-1069-4376-a0fb-9d00e9607534\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:48:28.125446 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:28.125426 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/dedc2850-1069-4376-a0fb-9d00e9607534-test-realms\") pod \"maas-keycloak-0\" (UID: \"dedc2850-1069-4376-a0fb-9d00e9607534\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:48:28.133104 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:28.133074 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hsgm\" (UniqueName: \"kubernetes.io/projected/dedc2850-1069-4376-a0fb-9d00e9607534-kube-api-access-7hsgm\") pod \"maas-keycloak-0\" (UID: \"dedc2850-1069-4376-a0fb-9d00e9607534\") " pod="keycloak-system/maas-keycloak-0" Jun 08 19:48:28.266198 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:28.266165 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 19:48:28.408066 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:28.408042 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 19:48:28.410469 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:48:28.410433 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddedc2850_1069_4376_a0fb_9d00e9607534.slice/crio-da6c71648aa11b746eea8d76033665fdc80ff7944edbe88151df7ea127b77394 WatchSource:0}: Error finding container da6c71648aa11b746eea8d76033665fdc80ff7944edbe88151df7ea127b77394: Status 404 returned error can't find the container with id da6c71648aa11b746eea8d76033665fdc80ff7944edbe88151df7ea127b77394 Jun 08 19:48:28.912406 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:28.912374 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dedc2850-1069-4376-a0fb-9d00e9607534","Type":"ContainerStarted","Data":"83b8ad5d6f0a407c10d565906b6f11b94206db887de81d260687096d1078dcfa"} Jun 08 19:48:28.912817 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:28.912421 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dedc2850-1069-4376-a0fb-9d00e9607534","Type":"ContainerStarted","Data":"da6c71648aa11b746eea8d76033665fdc80ff7944edbe88151df7ea127b77394"} Jun 08 19:48:28.932888 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:28.932838 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.592589952 podStartE2EDuration="1.932821984s" totalImagesPullingTime="340.232032ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:48:28.929730258 +0000 UTC m=+911.250902773" watchObservedRunningTime="2026-06-08 19:48:28.932821984 +0000 UTC m=+911.253994500" Jun 08 19:48:29.267260 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:29.267207 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 19:48:29.269066 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:29.269015 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 08 19:48:30.266877 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:30.266811 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 08 19:48:31.266702 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:31.266650 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 08 19:48:32.267021 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:32.266961 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 08 19:48:33.267457 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:33.267402 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 08 19:48:34.267159 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:34.267102 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 08 19:48:35.266886 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:35.266837 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 08 19:48:36.267697 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:36.267582 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 08 19:48:37.266977 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:37.266929 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 08 19:48:38.266666 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:38.266630 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 19:48:38.267085 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:38.266932 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 08 19:48:39.266967 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:39.266914 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 08 19:48:40.267370 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:40.267317 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 08 19:48:41.267034 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:41.266977 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 08 19:48:42.357384 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:42.357342 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 19:48:42.376431 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:42.376381 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:48:52.362147 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:52.362093 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="dedc2850-1069-4376-a0fb-9d00e9607534" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 19:48:53.977513 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:53.977476 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:48:54.078222 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:48:54.078185 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:02.363333 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:49:02.363298 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 19:49:14.531068 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:49:14.530979 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:14.629140 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:49:14.629107 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:22.202151 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:49:22.202117 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:49:43.578214 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:49:43.578128 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:50:06.793942 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:06.793904 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:50:17.477364 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:17.477330 2579 generic.go:356] "Generic (PLEG): container finished" podID="50213186-d896-4da6-a4b3-4aaa3cb22b60" containerID="30c7be0f8a4547da361f4d6f3a6a99cd8418b3aed18ce79a385517a6b23216f3" exitCode=1 Jun 08 19:50:17.477765 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:17.477406 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" event={"ID":"50213186-d896-4da6-a4b3-4aaa3cb22b60","Type":"ContainerDied","Data":"30c7be0f8a4547da361f4d6f3a6a99cd8418b3aed18ce79a385517a6b23216f3"} Jun 08 19:50:17.477765 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:17.477734 2579 scope.go:117] "RemoveContainer" containerID="30c7be0f8a4547da361f4d6f3a6a99cd8418b3aed18ce79a385517a6b23216f3" Jun 08 19:50:17.850389 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:17.850295 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" Jun 08 19:50:18.490554 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:18.490519 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" event={"ID":"50213186-d896-4da6-a4b3-4aaa3cb22b60","Type":"ContainerStarted","Data":"cf269d3f49d2635a860d7a90a0034642d31a10472fc8c178e4a1b26ebf2c179e"} Jun 08 19:50:18.490974 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:18.490646 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" Jun 08 19:50:29.089143 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.089100 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc"] Jun 08 19:50:29.092916 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.092894 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.095887 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.095867 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mfvng\"" Jun 08 19:50:29.096008 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.095900 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 19:50:29.096008 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.095921 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 19:50:29.097116 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.097099 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 08 19:50:29.104024 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.104003 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc"] Jun 08 19:50:29.118827 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.118804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/85e41f63-a0cf-4d33-ac05-85001aab073a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.118942 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.118846 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qvbm\" (UniqueName: \"kubernetes.io/projected/85e41f63-a0cf-4d33-ac05-85001aab073a-kube-api-access-6qvbm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.118942 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.118906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85e41f63-a0cf-4d33-ac05-85001aab073a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.119037 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.118954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85e41f63-a0cf-4d33-ac05-85001aab073a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.119037 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.118993 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85e41f63-a0cf-4d33-ac05-85001aab073a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.119037 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.119033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85e41f63-a0cf-4d33-ac05-85001aab073a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.184100 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.184066 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:50:29.219436 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.219400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85e41f63-a0cf-4d33-ac05-85001aab073a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.219616 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.219473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85e41f63-a0cf-4d33-ac05-85001aab073a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.219616 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.219524 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85e41f63-a0cf-4d33-ac05-85001aab073a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.219616 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.219549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85e41f63-a0cf-4d33-ac05-85001aab073a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.219616 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.219585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/85e41f63-a0cf-4d33-ac05-85001aab073a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.219832 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.219627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qvbm\" (UniqueName: \"kubernetes.io/projected/85e41f63-a0cf-4d33-ac05-85001aab073a-kube-api-access-6qvbm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.219832 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.219822 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85e41f63-a0cf-4d33-ac05-85001aab073a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.219983 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.219963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85e41f63-a0cf-4d33-ac05-85001aab073a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.220042 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.219994 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/85e41f63-a0cf-4d33-ac05-85001aab073a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.221888 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.221868 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85e41f63-a0cf-4d33-ac05-85001aab073a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.222019 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.222002 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85e41f63-a0cf-4d33-ac05-85001aab073a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.228254 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.228211 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qvbm\" (UniqueName: \"kubernetes.io/projected/85e41f63-a0cf-4d33-ac05-85001aab073a-kube-api-access-6qvbm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc\" (UID: \"85e41f63-a0cf-4d33-ac05-85001aab073a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.404557 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.404518 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:29.497871 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.497842 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" Jun 08 19:50:29.544744 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.544714 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc"] Jun 08 19:50:29.547150 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:50:29.547124 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e41f63_a0cf_4d33_ac05_85001aab073a.slice/crio-6e3cc5a9c2e3abb5779a0e733449107359527a1cbf52bdcd433ad0a10df17400 WatchSource:0}: Error finding container 6e3cc5a9c2e3abb5779a0e733449107359527a1cbf52bdcd433ad0a10df17400: Status 404 returned error can't find the container with id 6e3cc5a9c2e3abb5779a0e733449107359527a1cbf52bdcd433ad0a10df17400 Jun 08 19:50:29.549294 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:29.549277 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:50:30.551909 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:30.551866 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" event={"ID":"85e41f63-a0cf-4d33-ac05-85001aab073a","Type":"ContainerStarted","Data":"6e3cc5a9c2e3abb5779a0e733449107359527a1cbf52bdcd433ad0a10df17400"} Jun 08 19:50:33.569991 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:33.569901 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" event={"ID":"85e41f63-a0cf-4d33-ac05-85001aab073a","Type":"ContainerStarted","Data":"f5a5e720f8a04de4a6a7751e7cf7c9757997479d80309f5923c6707b02fbc2ba"} Jun 08 19:50:35.580189 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:35.580155 2579 generic.go:356] "Generic (PLEG): container finished" podID="85e41f63-a0cf-4d33-ac05-85001aab073a" containerID="f5a5e720f8a04de4a6a7751e7cf7c9757997479d80309f5923c6707b02fbc2ba" exitCode=0 Jun 08 19:50:35.580635 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:35.580195 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" event={"ID":"85e41f63-a0cf-4d33-ac05-85001aab073a","Type":"ContainerDied","Data":"f5a5e720f8a04de4a6a7751e7cf7c9757997479d80309f5923c6707b02fbc2ba"} Jun 08 19:50:37.594112 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:37.594074 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" event={"ID":"85e41f63-a0cf-4d33-ac05-85001aab073a","Type":"ContainerStarted","Data":"9436c328fedef501f37a9222eb182dd09818d59018d2a4e7f1db65fd5d48c37f"} Jun 08 19:50:37.614598 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:37.614545 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" podStartSLOduration=2.402769344 podStartE2EDuration="8.614529171s" totalImagesPullingTime="4.839190244s" totalInitContainerRuntime="1.372569583s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:50:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:50:37.611682972 +0000 UTC m=+1039.932855488" watchObservedRunningTime="2026-06-08 19:50:37.614529171 +0000 UTC m=+1039.935701683" Jun 08 19:50:39.405595 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:39.405553 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:39.406067 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:39.405649 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:39.418657 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:39.418634 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:39.617745 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:39.617719 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc" Jun 08 19:50:48.898071 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:50:48.898029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:51:00.380027 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:00.379987 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:51:04.876190 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:04.876151 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt"] Jun 08 19:51:04.895194 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:04.895151 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt"] Jun 08 19:51:04.895377 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:04.895305 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:04.898006 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:04.897981 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 08 19:51:04.907627 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:04.907602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:51:05.046631 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.046592 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1469b3b9-ec4e-4849-a531-24088a1beebd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.046819 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.046650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl2nd\" (UniqueName: \"kubernetes.io/projected/1469b3b9-ec4e-4849-a531-24088a1beebd-kube-api-access-pl2nd\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.046819 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.046671 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1469b3b9-ec4e-4849-a531-24088a1beebd-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.046819 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.046696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1469b3b9-ec4e-4849-a531-24088a1beebd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.046819 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.046742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1469b3b9-ec4e-4849-a531-24088a1beebd-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.046819 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.046788 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1469b3b9-ec4e-4849-a531-24088a1beebd-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.148151 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.148050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1469b3b9-ec4e-4849-a531-24088a1beebd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.148151 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.148127 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl2nd\" (UniqueName: \"kubernetes.io/projected/1469b3b9-ec4e-4849-a531-24088a1beebd-kube-api-access-pl2nd\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.148151 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.148159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1469b3b9-ec4e-4849-a531-24088a1beebd-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.148493 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.148177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1469b3b9-ec4e-4849-a531-24088a1beebd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.148493 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.148209 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1469b3b9-ec4e-4849-a531-24088a1beebd-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.148493 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.148292 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1469b3b9-ec4e-4849-a531-24088a1beebd-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.148642 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.148558 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1469b3b9-ec4e-4849-a531-24088a1beebd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.148642 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.148582 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1469b3b9-ec4e-4849-a531-24088a1beebd-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.148711 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.148666 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1469b3b9-ec4e-4849-a531-24088a1beebd-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.150648 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.150625 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1469b3b9-ec4e-4849-a531-24088a1beebd-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.150798 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.150781 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1469b3b9-ec4e-4849-a531-24088a1beebd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.156567 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.156541 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl2nd\" (UniqueName: \"kubernetes.io/projected/1469b3b9-ec4e-4849-a531-24088a1beebd-kube-api-access-pl2nd\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4w9zt\" (UID: \"1469b3b9-ec4e-4849-a531-24088a1beebd\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.205280 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.205220 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:05.340621 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.340590 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt"] Jun 08 19:51:05.342619 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:51:05.342580 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1469b3b9_ec4e_4849_a531_24088a1beebd.slice/crio-be93eeada11ddae3301c4fcaa0463f929aa08b004a13cd681f267d436c385156 WatchSource:0}: Error finding container be93eeada11ddae3301c4fcaa0463f929aa08b004a13cd681f267d436c385156: Status 404 returned error can't find the container with id be93eeada11ddae3301c4fcaa0463f929aa08b004a13cd681f267d436c385156 Jun 08 19:51:05.748802 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.748671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" event={"ID":"1469b3b9-ec4e-4849-a531-24088a1beebd","Type":"ContainerStarted","Data":"e3e150d3c50ef3a7fdad3e23a4030be96ae1bee8dae85d57f19fc611fd17a143"} Jun 08 19:51:05.748802 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:05.748724 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" event={"ID":"1469b3b9-ec4e-4849-a531-24088a1beebd","Type":"ContainerStarted","Data":"be93eeada11ddae3301c4fcaa0463f929aa08b004a13cd681f267d436c385156"} Jun 08 19:51:07.761548 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:07.761510 2579 generic.go:356] "Generic (PLEG): container finished" podID="1469b3b9-ec4e-4849-a531-24088a1beebd" containerID="e3e150d3c50ef3a7fdad3e23a4030be96ae1bee8dae85d57f19fc611fd17a143" exitCode=0 Jun 08 19:51:07.761938 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:07.761584 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" event={"ID":"1469b3b9-ec4e-4849-a531-24088a1beebd","Type":"ContainerDied","Data":"e3e150d3c50ef3a7fdad3e23a4030be96ae1bee8dae85d57f19fc611fd17a143"} Jun 08 19:51:08.768416 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:08.768378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" event={"ID":"1469b3b9-ec4e-4849-a531-24088a1beebd","Type":"ContainerStarted","Data":"43648f7b720536809e1695c71bda931d0be5f2ce506fd6ac2960792d1d046e79"} Jun 08 19:51:08.789428 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:08.789373 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" podStartSLOduration=3.200426842 podStartE2EDuration="4.789355925s" totalImagesPullingTime="262.446428ms" totalInitContainerRuntime="1.326482655s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:51:08.788586478 +0000 UTC m=+1071.109758994" watchObservedRunningTime="2026-06-08 19:51:08.789355925 +0000 UTC m=+1071.110528441" Jun 08 19:51:15.205743 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:15.205707 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:15.206164 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:15.205765 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:15.218547 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:15.218518 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:15.815306 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:15.815274 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4w9zt" Jun 08 19:51:59.459300 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:59.459263 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65fd8bc764-n9v5b"] Jun 08 19:51:59.462712 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:59.462692 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65fd8bc764-n9v5b" Jun 08 19:51:59.471052 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:59.471029 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65fd8bc764-n9v5b"] Jun 08 19:51:59.543525 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:59.543489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjnhl\" (UniqueName: \"kubernetes.io/projected/900e0e4b-423a-4344-a3fb-5c214e3ee080-kube-api-access-bjnhl\") pod \"authorino-65fd8bc764-n9v5b\" (UID: \"900e0e4b-423a-4344-a3fb-5c214e3ee080\") " pod="kuadrant-system/authorino-65fd8bc764-n9v5b" Jun 08 19:51:59.644568 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:59.644528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjnhl\" (UniqueName: \"kubernetes.io/projected/900e0e4b-423a-4344-a3fb-5c214e3ee080-kube-api-access-bjnhl\") pod \"authorino-65fd8bc764-n9v5b\" (UID: \"900e0e4b-423a-4344-a3fb-5c214e3ee080\") " pod="kuadrant-system/authorino-65fd8bc764-n9v5b" Jun 08 19:51:59.652988 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:59.652956 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjnhl\" (UniqueName: \"kubernetes.io/projected/900e0e4b-423a-4344-a3fb-5c214e3ee080-kube-api-access-bjnhl\") pod \"authorino-65fd8bc764-n9v5b\" (UID: \"900e0e4b-423a-4344-a3fb-5c214e3ee080\") " pod="kuadrant-system/authorino-65fd8bc764-n9v5b" Jun 08 19:51:59.774037 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:59.773949 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65fd8bc764-n9v5b" Jun 08 19:51:59.915595 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:59.915546 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65fd8bc764-n9v5b"] Jun 08 19:51:59.918214 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:51:59.918187 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod900e0e4b_423a_4344_a3fb_5c214e3ee080.slice/crio-fcb1bed63c952135932cd69c01b8a5133b28cd1b6ea3c513b6740958bc207c31 WatchSource:0}: Error finding container fcb1bed63c952135932cd69c01b8a5133b28cd1b6ea3c513b6740958bc207c31: Status 404 returned error can't find the container with id fcb1bed63c952135932cd69c01b8a5133b28cd1b6ea3c513b6740958bc207c31 Jun 08 19:51:59.957749 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:51:59.957708 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:52:00.028736 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:00.028645 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65fd8bc764-n9v5b" event={"ID":"900e0e4b-423a-4344-a3fb-5c214e3ee080","Type":"ContainerStarted","Data":"fcb1bed63c952135932cd69c01b8a5133b28cd1b6ea3c513b6740958bc207c31"} Jun 08 19:52:00.058874 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:00.058840 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:52:01.034688 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:01.034649 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65fd8bc764-n9v5b" event={"ID":"900e0e4b-423a-4344-a3fb-5c214e3ee080","Type":"ContainerStarted","Data":"ceadd07250549c18f9dba67b6415a6d691cd0ab9fcda91683f28a2b403c95dbc"} Jun 08 19:52:01.053834 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:01.053780 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65fd8bc764-n9v5b" podStartSLOduration=1.700406964 podStartE2EDuration="2.053764824s" totalImagesPullingTime="353.35786ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:52:01.052596668 +0000 UTC m=+1123.373769183" watchObservedRunningTime="2026-06-08 19:52:01.053764824 +0000 UTC m=+1123.374937339" Jun 08 19:52:01.080441 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:01.080412 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:52:01.098302 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:01.098273 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fd4f79bdf-ghzs6"] Jun 08 19:52:01.098527 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:01.098502 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-fd4f79bdf-ghzs6" podUID="7099db06-ed6f-40c9-9e29-403118bafec9" containerName="authorino" containerID="cri-o://0cb00868e19368b0341f11547d92c12156faa6a15b82fc3c45b04cd4df5f1360" gracePeriod=30 Jun 08 19:52:01.179425 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:01.179390 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:52:01.356435 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:01.356411 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd4f79bdf-ghzs6" Jun 08 19:52:01.459596 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:01.459566 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld2kk\" (UniqueName: \"kubernetes.io/projected/7099db06-ed6f-40c9-9e29-403118bafec9-kube-api-access-ld2kk\") pod \"7099db06-ed6f-40c9-9e29-403118bafec9\" (UID: \"7099db06-ed6f-40c9-9e29-403118bafec9\") " Jun 08 19:52:01.461594 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:01.461568 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7099db06-ed6f-40c9-9e29-403118bafec9-kube-api-access-ld2kk" (OuterVolumeSpecName: "kube-api-access-ld2kk") pod "7099db06-ed6f-40c9-9e29-403118bafec9" (UID: "7099db06-ed6f-40c9-9e29-403118bafec9"). InnerVolumeSpecName "kube-api-access-ld2kk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:52:01.560456 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:01.560418 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld2kk\" (UniqueName: \"kubernetes.io/projected/7099db06-ed6f-40c9-9e29-403118bafec9-kube-api-access-ld2kk\") on node \"ip-10-0-131-230.ec2.internal\" DevicePath \"\"" Jun 08 19:52:02.043566 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:02.043526 2579 generic.go:356] "Generic (PLEG): container finished" podID="7099db06-ed6f-40c9-9e29-403118bafec9" containerID="0cb00868e19368b0341f11547d92c12156faa6a15b82fc3c45b04cd4df5f1360" exitCode=0 Jun 08 19:52:02.043566 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:02.043567 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd4f79bdf-ghzs6" Jun 08 19:52:02.044105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:02.043581 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd4f79bdf-ghzs6" event={"ID":"7099db06-ed6f-40c9-9e29-403118bafec9","Type":"ContainerDied","Data":"0cb00868e19368b0341f11547d92c12156faa6a15b82fc3c45b04cd4df5f1360"} Jun 08 19:52:02.044105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:02.043638 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd4f79bdf-ghzs6" event={"ID":"7099db06-ed6f-40c9-9e29-403118bafec9","Type":"ContainerDied","Data":"d8b6666efb9ec340095737907ce6e1533f1d4368d2c5ad410a8b9e025e2cdcc3"} Jun 08 19:52:02.044105 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:02.043667 2579 scope.go:117] "RemoveContainer" containerID="0cb00868e19368b0341f11547d92c12156faa6a15b82fc3c45b04cd4df5f1360" Jun 08 19:52:02.053992 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:02.053964 2579 scope.go:117] "RemoveContainer" containerID="0cb00868e19368b0341f11547d92c12156faa6a15b82fc3c45b04cd4df5f1360" Jun 08 19:52:02.054333 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:52:02.054304 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cb00868e19368b0341f11547d92c12156faa6a15b82fc3c45b04cd4df5f1360\": container with ID starting with 0cb00868e19368b0341f11547d92c12156faa6a15b82fc3c45b04cd4df5f1360 not found: ID does not exist" containerID="0cb00868e19368b0341f11547d92c12156faa6a15b82fc3c45b04cd4df5f1360" Jun 08 19:52:02.054422 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:02.054346 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cb00868e19368b0341f11547d92c12156faa6a15b82fc3c45b04cd4df5f1360"} err="failed to get container status \"0cb00868e19368b0341f11547d92c12156faa6a15b82fc3c45b04cd4df5f1360\": rpc error: code = NotFound desc = could not find container \"0cb00868e19368b0341f11547d92c12156faa6a15b82fc3c45b04cd4df5f1360\": container with ID starting with 0cb00868e19368b0341f11547d92c12156faa6a15b82fc3c45b04cd4df5f1360 not found: ID does not exist" Jun 08 19:52:02.076986 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:02.076951 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fd4f79bdf-ghzs6"] Jun 08 19:52:02.084833 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:02.084807 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-fd4f79bdf-ghzs6"] Jun 08 19:52:02.096503 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:02.096477 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7099db06-ed6f-40c9-9e29-403118bafec9" path="/var/lib/kubelet/pods/7099db06-ed6f-40c9-9e29-403118bafec9/volumes" Jun 08 19:52:18.125482 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:18.125447 2579 generic.go:356] "Generic (PLEG): container finished" podID="50213186-d896-4da6-a4b3-4aaa3cb22b60" containerID="cf269d3f49d2635a860d7a90a0034642d31a10472fc8c178e4a1b26ebf2c179e" exitCode=1 Jun 08 19:52:18.125902 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:18.125519 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" event={"ID":"50213186-d896-4da6-a4b3-4aaa3cb22b60","Type":"ContainerDied","Data":"cf269d3f49d2635a860d7a90a0034642d31a10472fc8c178e4a1b26ebf2c179e"} Jun 08 19:52:18.125902 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:18.125580 2579 scope.go:117] "RemoveContainer" containerID="30c7be0f8a4547da361f4d6f3a6a99cd8418b3aed18ce79a385517a6b23216f3" Jun 08 19:52:18.125902 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:18.125849 2579 scope.go:117] "RemoveContainer" containerID="cf269d3f49d2635a860d7a90a0034642d31a10472fc8c178e4a1b26ebf2c179e" Jun 08 19:52:18.126093 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:52:18.126062 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-g8d2t_openshift-ingress(50213186-d896-4da6-a4b3-4aaa3cb22b60)\"" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" podUID="50213186-d896-4da6-a4b3-4aaa3cb22b60" Jun 08 19:52:19.496054 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:19.496008 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" Jun 08 19:52:19.496559 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:19.496479 2579 scope.go:117] "RemoveContainer" containerID="cf269d3f49d2635a860d7a90a0034642d31a10472fc8c178e4a1b26ebf2c179e" Jun 08 19:52:19.496716 ip-10-0-131-230 kubenswrapper[2579]: E0608 19:52:19.496692 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-g8d2t_openshift-ingress(50213186-d896-4da6-a4b3-4aaa3cb22b60)\"" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" podUID="50213186-d896-4da6-a4b3-4aaa3cb22b60" Jun 08 19:52:32.090720 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:32.090684 2579 scope.go:117] "RemoveContainer" containerID="cf269d3f49d2635a860d7a90a0034642d31a10472fc8c178e4a1b26ebf2c179e" Jun 08 19:52:32.202428 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:32.202396 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" event={"ID":"50213186-d896-4da6-a4b3-4aaa3cb22b60","Type":"ContainerStarted","Data":"e21063c2c56960f0e312240d426e67dc0c7cfdd4834d43f96472c33e3eb1250f"} Jun 08 19:52:32.202631 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:32.202610 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" Jun 08 19:52:38.142980 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:38.142899 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65fd8bc764-n9v5b_900e0e4b-423a-4344-a3fb-5c214e3ee080/authorino/0.log" Jun 08 19:52:43.209432 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:43.209397 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-g8d2t" Jun 08 19:52:43.212803 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:43.212786 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5484ddff6-k8wvj_7836996f-4b88-4cb6-a09f-87c15cc0b3d4/manager/0.log" Jun 08 19:52:43.706174 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:43.706146 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b897fbc-lfwv2_60479770-4571-46c3-899a-0e6fd8ac5b62/copy-manifests/0.log" Jun 08 19:52:43.718016 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:43.717992 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b897fbc-lfwv2_60479770-4571-46c3-899a-0e6fd8ac5b62/manager/0.log" Jun 08 19:52:45.301720 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:45.301676 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65fd8bc764-n9v5b_900e0e4b-423a-4344-a3fb-5c214e3ee080/authorino/0.log" Jun 08 19:52:45.663095 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:45.663062 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x8l8g_d29982d0-4238-4a01-8f40-8d8012609c73/kuadrant-console-plugin/0.log" Jun 08 19:52:46.715595 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:46.715562 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65dcdb9d8c-6c4l5_9420919a-8d49-476f-84d9-8f1322833cd3/kube-auth-proxy/0.log" Jun 08 19:52:47.041870 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:47.041756 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4qt8r_9b87d1e0-8cff-4efb-8ea2-5624ae5ad435/payload-pre-processing/0.log" Jun 08 19:52:47.149673 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:47.149644 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-g8d2t_50213186-d896-4da6-a4b3-4aaa3cb22b60/payload-processing/2.log" Jun 08 19:52:47.265673 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:47.265634 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668b985f5-m2skx_10ebd5b9-45a0-4544-85c3-ad58e61e391b/router/0.log" Jun 08 19:52:47.969778 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:47.969734 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc_85e41f63-a0cf-4d33-ac05-85001aab073a/storage-initializer/0.log" Jun 08 19:52:47.976365 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:47.976347 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfbwqc_85e41f63-a0cf-4d33-ac05-85001aab073a/main/0.log" Jun 08 19:52:48.213423 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:48.213394 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-4w9zt_1469b3b9-ec4e-4849-a531-24088a1beebd/storage-initializer/0.log" Jun 08 19:52:48.220200 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:48.220131 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-4w9zt_1469b3b9-ec4e-4849-a531-24088a1beebd/main/0.log" Jun 08 19:52:52.588389 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:52.588348 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:52:52.652710 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:52.652676 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:52:55.790959 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:55.790926 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nxg8x_e7189a06-ddfa-4e70-bbe2-9204fde5bccd/global-pull-secret-syncer/0.log" Jun 08 19:52:55.883715 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:55.883681 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" Jun 08 19:52:55.981393 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:52:55.981361 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-230.ec2.internal_fefb8afd1c16382fd0349c5eb50136cd/haproxy/0.log" Jun 08 19:53:01.645832 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:01.645803 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65fd8bc764-n9v5b_900e0e4b-423a-4344-a3fb-5c214e3ee080/authorino/0.log" Jun 08 19:53:01.818478 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:01.818445 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x8l8g_d29982d0-4238-4a01-8f40-8d8012609c73/kuadrant-console-plugin/0.log" Jun 08 19:53:04.498885 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:04.498852 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-rmnjg_362c0f9b-4d8b-46b2-b4a2-f2f57133f0d4/cluster-monitoring-operator/0.log" Jun 08 19:53:04.547963 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:04.547934 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8ll4d_3d5be899-73db-44f2-98b8-7ab1c7437a37/kube-state-metrics/0.log" Jun 08 19:53:04.621081 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:04.621054 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8ll4d_3d5be899-73db-44f2-98b8-7ab1c7437a37/kube-rbac-proxy-main/0.log" Jun 08 19:53:04.715542 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:04.715512 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-8ll4d_3d5be899-73db-44f2-98b8-7ab1c7437a37/kube-rbac-proxy-self/0.log" Jun 08 19:53:05.151453 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.151418 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mnngm_6bdad326-ff55-4df2-9ee6-e641040484c3/node-exporter/0.log" Jun 08 19:53:05.199552 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.199520 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mnngm_6bdad326-ff55-4df2-9ee6-e641040484c3/kube-rbac-proxy/0.log" Jun 08 19:53:05.262843 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.262816 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mnngm_6bdad326-ff55-4df2-9ee6-e641040484c3/init-textfile/0.log" Jun 08 19:53:05.502901 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.502790 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hf4lv_46c79951-8e49-49d3-9f15-f16c4bce5a8b/kube-rbac-proxy-main/0.log" Jun 08 19:53:05.560449 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.560404 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hf4lv_46c79951-8e49-49d3-9f15-f16c4bce5a8b/kube-rbac-proxy-self/0.log" Jun 08 19:53:05.615333 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.615305 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hf4lv_46c79951-8e49-49d3-9f15-f16c4bce5a8b/openshift-state-metrics/0.log" Jun 08 19:53:05.873750 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.873715 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg"] Jun 08 19:53:05.874116 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.874095 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7099db06-ed6f-40c9-9e29-403118bafec9" containerName="authorino" Jun 08 19:53:05.874168 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.874118 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7099db06-ed6f-40c9-9e29-403118bafec9" containerName="authorino" Jun 08 19:53:05.874209 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.874200 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7099db06-ed6f-40c9-9e29-403118bafec9" containerName="authorino" Jun 08 19:53:05.877407 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.877382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:05.885591 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.885564 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5wcfn\"/\"openshift-service-ca.crt\"" Jun 08 19:53:05.886774 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.886758 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5wcfn\"/\"kube-root-ca.crt\"" Jun 08 19:53:05.886874 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.886760 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5wcfn\"/\"default-dockercfg-kz8xh\"" Jun 08 19:53:05.906404 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.906372 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg"] Jun 08 19:53:05.937134 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.937104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee69e228-82dc-4d64-be9f-f298220f0598-proc\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:05.937279 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.937148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee69e228-82dc-4d64-be9f-f298220f0598-sys\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:05.937333 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.937269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee69e228-82dc-4d64-be9f-f298220f0598-lib-modules\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:05.937333 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.937311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee69e228-82dc-4d64-be9f-f298220f0598-podres\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:05.937333 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:05.937327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m4tz\" (UniqueName: \"kubernetes.io/projected/ee69e228-82dc-4d64-be9f-f298220f0598-kube-api-access-8m4tz\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:06.038032 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.038001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee69e228-82dc-4d64-be9f-f298220f0598-sys\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:06.038263 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.038088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee69e228-82dc-4d64-be9f-f298220f0598-lib-modules\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:06.038263 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.038133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee69e228-82dc-4d64-be9f-f298220f0598-podres\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:06.038263 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.038139 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee69e228-82dc-4d64-be9f-f298220f0598-sys\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:06.038263 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.038157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m4tz\" (UniqueName: \"kubernetes.io/projected/ee69e228-82dc-4d64-be9f-f298220f0598-kube-api-access-8m4tz\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:06.038263 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.038221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee69e228-82dc-4d64-be9f-f298220f0598-proc\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:06.038525 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.038276 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee69e228-82dc-4d64-be9f-f298220f0598-lib-modules\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:06.038525 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.038278 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee69e228-82dc-4d64-be9f-f298220f0598-podres\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:06.038525 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.038337 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee69e228-82dc-4d64-be9f-f298220f0598-proc\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:06.052823 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.052792 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m4tz\" (UniqueName: \"kubernetes.io/projected/ee69e228-82dc-4d64-be9f-f298220f0598-kube-api-access-8m4tz\") pod \"perf-node-gather-daemonset-vclgg\" (UID: \"ee69e228-82dc-4d64-be9f-f298220f0598\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:06.187368 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.187284 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:06.298338 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.298310 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-jw94v_72c19e4a-97fb-415d-9299-9930e4a88ee8/prometheus-operator/0.log" Jun 08 19:53:06.341010 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.340923 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg"] Jun 08 19:53:06.343817 ip-10-0-131-230 kubenswrapper[2579]: W0608 19:53:06.343792 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podee69e228_82dc_4d64_be9f_f298220f0598.slice/crio-ca409d0924ac02271f4fb13b3d537f0cd3213a8fb6d58c8fcb654d6f5f2b2d9a WatchSource:0}: Error finding container ca409d0924ac02271f4fb13b3d537f0cd3213a8fb6d58c8fcb654d6f5f2b2d9a: Status 404 returned error can't find the container with id ca409d0924ac02271f4fb13b3d537f0cd3213a8fb6d58c8fcb654d6f5f2b2d9a Jun 08 19:53:06.368292 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.368263 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" event={"ID":"ee69e228-82dc-4d64-be9f-f298220f0598","Type":"ContainerStarted","Data":"ca409d0924ac02271f4fb13b3d537f0cd3213a8fb6d58c8fcb654d6f5f2b2d9a"} Jun 08 19:53:06.388719 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.388700 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-jw94v_72c19e4a-97fb-415d-9299-9930e4a88ee8/kube-rbac-proxy/0.log" Jun 08 19:53:06.526785 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.526709 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9c5b8f44-gbmwk_a0a23063-4c83-4b85-b749-aaae7e9244ef/telemeter-client/0.log" Jun 08 19:53:06.575890 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.575865 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9c5b8f44-gbmwk_a0a23063-4c83-4b85-b749-aaae7e9244ef/reload/0.log" Jun 08 19:53:06.655182 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.655151 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9c5b8f44-gbmwk_a0a23063-4c83-4b85-b749-aaae7e9244ef/kube-rbac-proxy/0.log" Jun 08 19:53:06.746692 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.746664 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8fcb5f98d-vjj5g_9d68b772-2193-4762-8e3d-ed156dd34596/thanos-query/0.log" Jun 08 19:53:06.814072 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.813987 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8fcb5f98d-vjj5g_9d68b772-2193-4762-8e3d-ed156dd34596/kube-rbac-proxy-web/0.log" Jun 08 19:53:06.878663 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.878639 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8fcb5f98d-vjj5g_9d68b772-2193-4762-8e3d-ed156dd34596/kube-rbac-proxy/0.log" Jun 08 19:53:06.931957 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:06.931929 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8fcb5f98d-vjj5g_9d68b772-2193-4762-8e3d-ed156dd34596/prom-label-proxy/0.log" Jun 08 19:53:07.001998 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:07.001969 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8fcb5f98d-vjj5g_9d68b772-2193-4762-8e3d-ed156dd34596/kube-rbac-proxy-rules/0.log" Jun 08 19:53:07.056135 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:07.056111 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8fcb5f98d-vjj5g_9d68b772-2193-4762-8e3d-ed156dd34596/kube-rbac-proxy-metrics/0.log" Jun 08 19:53:07.374676 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:07.374642 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" event={"ID":"ee69e228-82dc-4d64-be9f-f298220f0598","Type":"ContainerStarted","Data":"ae70fdd6b2e3b2fe7413bfeb52033772cc92e1d8b0b1703d4aa2868ef11bc45f"} Jun 08 19:53:07.374858 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:07.374711 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:07.398746 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:07.398697 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" podStartSLOduration=2.398680815 podStartE2EDuration="2.398680815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:53:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:53:07.397360804 +0000 UTC m=+1189.718533344" watchObservedRunningTime="2026-06-08 19:53:07.398680815 +0000 UTC m=+1189.719853331" Jun 08 19:53:08.273656 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:08.273630 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-blblx_9a53f856-c42c-4d5d-9d1e-aa93d293874c/networking-console-plugin/0.log" Jun 08 19:53:09.696484 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:09.696453 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-f54b5_a97beeab-236a-4eed-bc89-a7bebe28f8ae/download-server/0.log" Jun 08 19:53:10.450657 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:10.450627 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-qs5xk_d1f796d3-db37-40e6-aeda-b4fd5ce7901d/volume-data-source-validator/0.log" Jun 08 19:53:11.852551 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:11.852512 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-twfxs_978c7936-1cc3-4978-b11e-6d67d174c107/dns/0.log" Jun 08 19:53:11.889877 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:11.889854 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-twfxs_978c7936-1cc3-4978-b11e-6d67d174c107/kube-rbac-proxy/0.log" Jun 08 19:53:12.034318 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:12.034286 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k5ngh_2b9c09fa-ad4e-4e6a-9e87-c5e273b49d0c/dns-node-resolver/0.log" Jun 08 19:53:13.073049 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:13.073016 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wgpqd_ed47d3ee-170c-42a6-913f-b808115fe16b/node-ca/0.log" Jun 08 19:53:13.389502 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:13.389474 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-vclgg" Jun 08 19:53:13.815189 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:13.815098 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:53:13.897240 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:13.897187 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7pt67_e504f78f-6fd2-4d1f-b356-000b5e9222e7/konnectivity-agent/0.log" limit=1024 Jun 08 19:53:14.756828 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:14.756791 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65dcdb9d8c-6c4l5_9420919a-8d49-476f-84d9-8f1322833cd3/kube-auth-proxy/0.log" Jun 08 19:53:15.019696 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:15.019670 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4qt8r_9b87d1e0-8cff-4efb-8ea2-5624ae5ad435/payload-pre-processing/0.log" Jun 08 19:53:15.129624 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:15.129594 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-g8d2t_50213186-d896-4da6-a4b3-4aaa3cb22b60/payload-processing/2.log" Jun 08 19:53:15.130163 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:15.130146 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-g8d2t_50213186-d896-4da6-a4b3-4aaa3cb22b60/payload-processing/1.log" Jun 08 19:53:15.194663 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:15.194588 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668b985f5-m2skx_10ebd5b9-45a0-4544-85c3-ad58e61e391b/router/0.log" Jun 08 19:53:16.360130 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:16.360105 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4n9s_7a3537b7-27ae-4d2a-9389-f9781d970489/serve-healthcheck-canary/0.log" Jun 08 19:53:17.815241 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:17.815207 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t8tmq_15d521b7-f984-4e11-8899-ff3e26cb9b25/kube-rbac-proxy/0.log" Jun 08 19:53:17.889738 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:17.889711 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t8tmq_15d521b7-f984-4e11-8899-ff3e26cb9b25/exporter/0.log" Jun 08 19:53:17.930737 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:17.930714 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t8tmq_15d521b7-f984-4e11-8899-ff3e26cb9b25/extractor/0.log" Jun 08 19:53:18.141630 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:18.141604 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gj6rg_d241132c-eb3a-4381-8b55-ebec819c514f/ovn-acl-logging/0.log" Jun 08 19:53:18.144537 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:18.144511 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gj6rg_d241132c-eb3a-4381-8b55-ebec819c514f/ovn-acl-logging/0.log" Jun 08 19:53:20.800800 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:20.800761 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65dcdb9d8c-6c4l5_9420919a-8d49-476f-84d9-8f1322833cd3/kube-auth-proxy/0.log" Jun 08 19:53:20.957851 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:20.957824 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4qt8r_9b87d1e0-8cff-4efb-8ea2-5624ae5ad435/payload-pre-processing/0.log" Jun 08 19:53:20.984521 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:20.984463 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-g8d2t_50213186-d896-4da6-a4b3-4aaa3cb22b60/payload-processing/2.log" Jun 08 19:53:20.985357 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:20.985330 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-g8d2t_50213186-d896-4da6-a4b3-4aaa3cb22b60/payload-processing/1.log" Jun 08 19:53:21.005124 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:21.005103 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668b985f5-m2skx_10ebd5b9-45a0-4544-85c3-ad58e61e391b/router/0.log" Jun 08 19:53:21.455461 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:21.455434 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5484ddff6-k8wvj_7836996f-4b88-4cb6-a09f-87c15cc0b3d4/manager/0.log" Jun 08 19:53:22.270349 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:22.270319 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b897fbc-lfwv2_60479770-4571-46c3-899a-0e6fd8ac5b62/manager/0.log" Jun 08 19:53:22.329395 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:22.329370 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b897fbc-lfwv2_60479770-4571-46c3-899a-0e6fd8ac5b62/copy-manifests/0.log" Jun 08 19:53:22.439251 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:22.439200 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65dcdb9d8c-6c4l5_9420919a-8d49-476f-84d9-8f1322833cd3/kube-auth-proxy/0.log" Jun 08 19:53:22.551772 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:22.551679 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4qt8r_9b87d1e0-8cff-4efb-8ea2-5624ae5ad435/payload-pre-processing/0.log" Jun 08 19:53:22.592668 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:22.592641 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-g8d2t_50213186-d896-4da6-a4b3-4aaa3cb22b60/payload-processing/2.log" Jun 08 19:53:22.593319 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:22.593302 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-g8d2t_50213186-d896-4da6-a4b3-4aaa3cb22b60/payload-processing/1.log" Jun 08 19:53:22.629517 ip-10-0-131-230 kubenswrapper[2579]: I0608 19:53:22.629494 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668b985f5-m2skx_10ebd5b9-45a0-4544-85c3-ad58e61e391b/router/0.log"