Jun 13 03:41:31.940556 ip-10-0-142-184 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 13 03:41:31.940570 ip-10-0-142-184 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 13 03:41:31.940580 ip-10-0-142-184 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 13 03:41:31.940888 ip-10-0-142-184 systemd[1]: Failed to start Kubernetes Kubelet. Jun 13 03:41:42.060801 ip-10-0-142-184 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 13 03:41:42.060818 ip-10-0-142-184 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot acf207e7b66a42c1867e9af849b2bb6b -- Jun 13 03:44:00.388709 ip-10-0-142-184 systemd[1]: Starting Kubernetes Kubelet... Jun 13 03:44:00.850995 ip-10-0-142-184 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 03:44:00.850995 ip-10-0-142-184 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 13 03:44:00.850995 ip-10-0-142-184 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 03:44:00.850995 ip-10-0-142-184 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 13 03:44:00.850995 ip-10-0-142-184 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 03:44:00.852074 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.851962 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 13 03:44:00.858411 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858393 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 03:44:00.858411 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858409 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 03:44:00.858411 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858413 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 03:44:00.858411 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858416 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858421 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858426 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858429 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858432 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858435 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858438 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858441 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858444 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858447 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858450 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858453 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858456 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858459 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858462 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858465 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858468 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858477 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858480 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 03:44:00.858572 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858483 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858486 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858488 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858491 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858495 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858498 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858501 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858503 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858506 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858508 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858510 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858513 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858515 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858519 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858524 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858528 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858532 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858535 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858538 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 03:44:00.859027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858541 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858544 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858547 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858550 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858552 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858555 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858558 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858560 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858563 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858565 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858568 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858571 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858574 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858577 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858579 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858582 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858585 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858587 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858590 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858592 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858595 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 03:44:00.859505 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858597 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858600 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858603 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858605 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858608 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858611 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858613 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858616 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858619 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858621 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858624 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858626 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858630 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858633 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858635 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858638 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858640 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858643 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858645 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858653 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 03:44:00.860020 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858656 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858658 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858661 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858663 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858666 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858668 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858671 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858673 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858676 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858679 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858681 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858684 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858687 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858689 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858692 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858694 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.858697 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860455 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860463 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860467 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 03:44:00.860515 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860470 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860473 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860475 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860478 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860480 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860483 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860485 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860488 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860491 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860493 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860496 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860498 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860507 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860510 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860513 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860515 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860519 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860521 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860524 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860527 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 03:44:00.861083 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860530 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860532 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860535 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860537 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860540 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860543 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860545 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860548 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860551 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860553 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860562 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860565 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860567 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860570 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860573 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860576 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860578 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860581 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860586 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 03:44:00.861632 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860589 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860592 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860595 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860598 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860601 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860603 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860611 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860614 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860616 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860619 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860621 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860624 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860626 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860629 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860632 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860634 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860637 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860639 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860642 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860644 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 03:44:00.862111 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860652 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860655 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860657 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860661 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860664 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860666 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860668 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860672 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860674 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860677 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860679 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860682 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860684 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860687 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860690 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860692 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860695 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860699 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860701 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860710 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 03:44:00.862614 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860713 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860715 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860718 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860720 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860724 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860727 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860730 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860733 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860736 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860738 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860741 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860744 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860747 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860750 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860754 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860758 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.860761 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861185 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861191 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 03:44:00.863113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861194 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861197 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861200 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861203 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861206 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861209 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861212 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861214 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861217 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861219 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861222 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861225 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861227 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861230 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861233 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861235 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861237 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861240 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861242 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861246 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 03:44:00.863598 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861248 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861250 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861253 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861256 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861258 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861260 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861263 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861265 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861268 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861271 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861274 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861276 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861279 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861281 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861284 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861286 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861289 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861291 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861294 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861296 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 03:44:00.864100 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861299 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861301 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861303 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861306 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861308 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861311 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861314 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861316 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861318 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861323 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861326 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861329 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861332 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861335 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861337 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861340 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861342 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861345 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861347 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 03:44:00.864599 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861350 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861352 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861355 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861372 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861375 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861378 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861381 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861383 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861386 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861388 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861391 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861393 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861396 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861398 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861401 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861405 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861408 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861410 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861414 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 03:44:00.865068 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861418 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861420 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861423 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861425 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861428 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861430 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861433 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861437 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861440 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861443 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861445 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861448 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861451 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861454 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861457 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861459 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861462 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861465 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.861467 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861532 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861539 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 13 03:44:00.865546 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861545 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861549 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861553 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861557 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861561 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861565 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861568 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861571 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861574 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861577 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861580 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861583 2562 flags.go:64] FLAG: --cgroup-root="" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861587 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861590 2562 flags.go:64] FLAG: --client-ca-file="" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861593 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861596 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861600 2562 flags.go:64] FLAG: --cluster-domain="" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861603 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861606 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861609 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861613 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861616 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861619 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 13 03:44:00.866076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861622 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861628 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861631 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861634 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861637 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861640 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861643 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861647 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861650 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861653 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861656 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861659 2562 flags.go:64] FLAG: --enable-server="true" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861662 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861666 2562 flags.go:64] FLAG: --event-burst="100" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861669 2562 flags.go:64] FLAG: --event-qps="50" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861672 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861675 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861679 2562 flags.go:64] FLAG: --eviction-hard="" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861683 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861686 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861689 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861692 2562 flags.go:64] FLAG: --eviction-soft="" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861695 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861698 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861701 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 13 03:44:00.866641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861704 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861707 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861709 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861712 2562 flags.go:64] FLAG: --feature-gates="" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861716 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861719 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861722 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861725 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861729 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861732 2562 flags.go:64] FLAG: --help="false" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861735 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-142-184.ec2.internal" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861738 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861741 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861744 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861747 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861750 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861753 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861756 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861759 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861761 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861764 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861767 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861770 2562 flags.go:64] FLAG: --kube-reserved="" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861773 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 13 03:44:00.867275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861777 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861781 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861784 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861786 2562 flags.go:64] FLAG: --lock-file="" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861789 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861792 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861795 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861801 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861803 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861806 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861809 2562 flags.go:64] FLAG: --logging-format="text" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861812 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861815 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861817 2562 flags.go:64] FLAG: --manifest-url="" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861820 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861824 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861828 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861832 2562 flags.go:64] FLAG: --max-pods="110" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861835 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861838 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861841 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861843 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861846 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861849 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861852 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 13 03:44:00.867883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861858 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861862 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861865 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861867 2562 flags.go:64] FLAG: --pod-cidr="" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861870 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861876 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861879 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861883 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861886 2562 flags.go:64] FLAG: --port="10250" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861888 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861891 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0eb5c248ff813fd45" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861894 2562 flags.go:64] FLAG: --qos-reserved="" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861897 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861900 2562 flags.go:64] FLAG: --register-node="true" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861903 2562 flags.go:64] FLAG: --register-with-taints="" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861907 2562 flags.go:64] FLAG: --registry-burst="10" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861909 2562 flags.go:64] FLAG: --registry-qps="5" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861912 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861915 2562 flags.go:64] FLAG: --reserved-memory="" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861918 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861921 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861924 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861927 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861930 2562 flags.go:64] FLAG: --runonce="false" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861933 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 13 03:44:00.868534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861937 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861939 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861942 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861945 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861948 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861951 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861954 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861957 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861960 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861962 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861965 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861968 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861971 2562 flags.go:64] FLAG: --system-cgroups="" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861974 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861981 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861983 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861986 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861990 2562 flags.go:64] FLAG: --tls-min-version="" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861993 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861995 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.861998 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.862001 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.862004 2562 flags.go:64] FLAG: --v="2" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.862008 2562 flags.go:64] FLAG: --version="false" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.862012 2562 flags.go:64] FLAG: --vmodule="" Jun 13 03:44:00.869193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.862015 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.862018 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862142 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862145 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862149 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862151 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862155 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862158 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862160 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862163 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862166 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862168 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862171 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862173 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862176 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862178 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862181 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862184 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862186 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862189 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 03:44:00.869860 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862191 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862195 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862198 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862201 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862203 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862206 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862208 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862210 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862213 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862216 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862219 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862222 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862225 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862227 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862230 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862232 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862235 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862237 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862242 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862244 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 03:44:00.870351 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862247 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862250 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862252 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862255 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862257 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862260 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862262 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862265 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862267 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862270 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862273 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862275 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862278 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862281 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862284 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862287 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862289 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862292 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862294 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 03:44:00.870873 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862298 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862302 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862306 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862310 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862313 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862316 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862319 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862322 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862325 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862327 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862330 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862335 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862338 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862341 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862343 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862347 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862351 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862354 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862356 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 03:44:00.871333 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862372 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862374 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862377 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862380 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862382 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862385 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862387 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862391 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862394 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862396 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862399 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862402 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862404 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862407 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862409 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862412 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862414 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862417 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862420 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862422 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 03:44:00.871815 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862425 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862427 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.862430 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.863421 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.870046 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.870149 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.870167 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.870176 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870232 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870238 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870241 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870244 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870247 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870250 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 03:44:00.872296 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870253 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870256 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870259 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870261 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870264 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870267 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870271 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870274 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870277 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870281 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870283 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870286 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870289 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870292 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870294 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870297 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870300 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870303 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870306 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870308 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 03:44:00.872662 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870311 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870313 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870316 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870319 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870324 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870327 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870330 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870333 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870336 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870338 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870341 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870343 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870346 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870349 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870351 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870354 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870357 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870391 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870394 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 03:44:00.873166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870397 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870400 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870403 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870406 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870408 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870411 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870414 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870416 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870419 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870421 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870424 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870427 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870429 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870432 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870434 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870437 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870440 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870443 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870446 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870448 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 03:44:00.873677 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870451 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870453 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870456 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870459 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870461 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870464 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870466 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870469 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870471 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870474 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870477 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870480 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870482 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870485 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870487 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870490 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870493 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870497 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870500 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870502 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 03:44:00.874170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870505 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870507 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870510 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870513 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870516 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870518 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870521 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870523 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870527 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870530 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870532 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870535 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870537 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870540 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.870545 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 03:44:00.874892 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870650 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870656 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870660 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870663 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870666 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870669 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870672 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870675 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870678 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870681 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870684 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870686 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870689 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870691 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870693 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870696 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870698 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870701 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870704 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 03:44:00.875275 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870707 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870709 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870712 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870714 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870717 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870720 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870722 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870726 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870728 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870731 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870733 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870736 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870738 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870741 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870743 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870746 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870748 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870750 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870753 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870755 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 03:44:00.875820 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870758 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870760 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870763 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870765 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870767 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870770 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870772 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870775 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870777 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870780 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870782 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870784 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870787 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870789 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870792 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870795 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870797 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870800 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870802 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870805 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 03:44:00.876660 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870808 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870810 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870813 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870815 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870818 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870821 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870823 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870826 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870828 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870831 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870833 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870836 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870838 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870841 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870843 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870846 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870849 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870851 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870853 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870856 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 03:44:00.877137 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870858 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870861 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870863 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870866 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870868 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870871 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870873 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870875 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870879 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870882 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870886 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870889 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870892 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870895 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870897 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870900 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870903 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870906 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870908 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 03:44:00.877749 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.870910 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 03:44:00.878216 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.870915 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 03:44:00.878216 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.871006 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 13 03:44:00.878216 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.872980 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 13 03:44:00.878216 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.874540 2562 server.go:1019] "Starting client certificate rotation" Jun 13 03:44:00.878216 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.874661 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 03:44:00.878216 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.874711 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 03:44:00.878216 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.877606 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 03:44:00.879961 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.879938 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 03:44:00.892715 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.892698 2562 log.go:25] "Validated CRI v1 runtime API" Jun 13 03:44:00.895550 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.895538 2562 log.go:25] "Validated CRI v1 image API" Jun 13 03:44:00.897950 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.897930 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 13 03:44:00.901494 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.901474 2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8c971381-cfc1-4245-a975-5db6269a1649:/dev/nvme0n1p4 8e3f5f7f-4d02-4282-a290-70cab902c553:/dev/nvme0n1p3] Jun 13 03:44:00.901569 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.901492 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 13 03:44:00.906749 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.906731 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 03:44:00.906929 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.906817 2562 manager.go:216] Machine: {Timestamp:2026-06-13 03:44:00.905331154 +0000 UTC m=+0.378824898 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100270 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20aea31fa593d5dd99a2994eda30a8 SystemUUID:ec20aea3-1fa5-93d5-dd99-a2994eda30a8 BootID:acf207e7-b66a-42c1-867e-9af849b2bb6b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:87:b1:32:a7:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:87:b1:32:a7:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:44:1c:4b:e1:94 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 13 03:44:00.906929 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.906929 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 13 03:44:00.907076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.907065 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 13 03:44:00.910890 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.910867 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 13 03:44:00.911058 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.910894 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-184.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 13 03:44:00.911611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.911599 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 13 03:44:00.911673 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.911617 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 13 03:44:00.911673 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.911626 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 03:44:00.912473 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.912461 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 03:44:00.913940 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.913928 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 13 03:44:00.916768 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.916755 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 13 03:44:00.916895 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.916884 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 13 03:44:00.916951 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.916921 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 13 03:44:00.916951 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.916942 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 13 03:44:00.917040 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.916961 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 13 03:44:00.917040 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.916976 2562 kubelet.go:398] "Adding apiserver pod source" Jun 13 03:44:00.917040 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.916987 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 13 03:44:00.917311 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.917297 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 03:44:00.917395 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.917320 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 03:44:00.919852 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.919832 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 13 03:44:00.924795 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.924774 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 13 03:44:00.924873 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.924819 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 13 03:44:00.925023 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.925010 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 13 03:44:00.925076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.925027 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 13 03:44:00.925076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.925033 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 13 03:44:00.925076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.925038 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 13 03:44:00.925076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.925046 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 13 03:44:00.925076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.925051 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 13 03:44:00.925705 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.925692 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 13 03:44:00.925705 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.925702 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 13 03:44:00.925792 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.925709 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 13 03:44:00.925792 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.925715 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 13 03:44:00.925792 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.925730 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 13 03:44:00.925792 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.925738 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 13 03:44:00.926531 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.926518 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 13 03:44:00.926531 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.926531 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 13 03:44:00.927117 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:00.927096 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 13 03:44:00.927117 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:00.927097 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 13 03:44:00.928146 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.928131 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-184.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 13 03:44:00.929638 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.929625 2562 server.go:1268] "Started kubelet" Jun 13 03:44:00.929713 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.929696 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 13 03:44:00.929763 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.929707 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 13 03:44:00.929818 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.929760 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 13 03:44:00.930484 ip-10-0-142-184 systemd[1]: Started Kubernetes Kubelet. Jun 13 03:44:00.931614 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.931599 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 13 03:44:00.931670 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.931652 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 13 03:44:00.936502 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.936480 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 13 03:44:00.936502 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.936493 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 13 03:44:00.936657 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:00.936579 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:00.937270 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.937252 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 13 03:44:00.937391 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.937285 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 13 03:44:00.937391 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.937303 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 13 03:44:00.937487 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.937420 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 13 03:44:00.937487 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.937429 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 13 03:44:00.937668 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.937652 2562 factory.go:55] Registering systemd factory Jun 13 03:44:00.937726 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.937693 2562 factory.go:223] Registration of the systemd container factory successfully Jun 13 03:44:00.938019 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.938002 2562 factory.go:153] Registering CRI-O factory Jun 13 03:44:00.938019 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.938021 2562 factory.go:223] Registration of the crio container factory successfully Jun 13 03:44:00.938165 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.938071 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 13 03:44:00.938165 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.938095 2562 factory.go:103] Registering Raw factory Jun 13 03:44:00.938165 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.938109 2562 manager.go:1196] Started watching for new ooms in manager Jun 13 03:44:00.938165 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:00.936580 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-184.ec2.internal.18b88723e91c8be2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-184.ec2.internal,UID:ip-10-0-142-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-184.ec2.internal,},FirstTimestamp:2026-06-13 03:44:00.929598434 +0000 UTC m=+0.403092179,LastTimestamp:2026-06-13 03:44:00.929598434 +0000 UTC m=+0.403092179,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-184.ec2.internal,}" Jun 13 03:44:00.938589 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.938560 2562 manager.go:349] Starting recovery of all containers Jun 13 03:44:00.938802 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:00.938644 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 13 03:44:00.944317 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:00.944283 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 13 03:44:00.946667 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:00.946637 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 13 03:44:00.948767 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:00.948723 2562 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.max": read /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.max: no such device Jun 13 03:44:00.949525 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.949501 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jzctn" Jun 13 03:44:00.950015 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.949985 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 13 03:44:00.950528 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.950463 2562 manager.go:354] Recovery completed Jun 13 03:44:00.954545 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.954527 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jzctn" Jun 13 03:44:00.954810 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.954799 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:00.956593 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.956568 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:00.956663 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.956599 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:00.956663 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.956618 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:00.957094 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.957079 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 13 03:44:00.957094 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.957090 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:00.957094 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.957093 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 13 03:44:00.957193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.957112 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 13 03:44:00.958605 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:00.958235 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-184.ec2.internal.18b88723eab85155 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-184.ec2.internal,UID:ip-10-0-142-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-184.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-184.ec2.internal,},FirstTimestamp:2026-06-13 03:44:00.956584277 +0000 UTC m=+0.430078028,LastTimestamp:2026-06-13 03:44:00.956584277 +0000 UTC m=+0.430078028,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-184.ec2.internal,}" Jun 13 03:44:00.958742 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.958725 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:00.958794 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.958757 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:00.958794 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.958770 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:00.958962 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.958947 2562 policy_none.go:49] "None policy: Start" Jun 13 03:44:00.958962 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.958968 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 13 03:44:00.959061 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.958985 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 13 03:44:00.959851 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:00.959840 2562 policy_none.go:47] "Start" Jun 13 03:44:01.003911 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.003898 2562 manager.go:337] "Starting Device Plugin manager" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.003952 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.003966 2562 server.go:87] "Starting device plugin registration server" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.004206 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.004219 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.004325 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.004438 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.004469 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.006353 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.006409 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.009818 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.009857 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.009875 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.009925 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 13 03:44:01.014274 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.011449 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 03:44:01.105346 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.105271 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:01.106890 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.106873 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:01.106985 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.106903 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:01.106985 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.106919 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:01.106985 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.106946 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.110982 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.110959 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-184.ec2.internal"] Jun 13 03:44:01.111034 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.111029 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:01.111832 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.111815 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:01.111896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.111843 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:01.111896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.111853 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:01.113039 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.113027 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:01.113158 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.113143 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.113195 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.113172 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:01.113747 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.113731 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:01.113796 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.113756 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:01.113796 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.113768 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:01.114401 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.114386 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:01.114465 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.114414 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:01.114465 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.114423 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:01.115406 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.115391 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.115469 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.115414 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 03:44:01.115825 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.115811 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.115883 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.115835 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-184.ec2.internal\": node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:01.116067 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.116055 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientMemory" Jun 13 03:44:01.116134 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.116078 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 03:44:01.116134 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.116087 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeHasSufficientPID" Jun 13 03:44:01.136876 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.136861 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-184.ec2.internal\" not found" node="ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.137940 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.137925 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:01.138552 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.138534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1bd90cee16398774209d73ccb0625fec-config\") pod \"kube-apiserver-proxy-ip-10-0-142-184.ec2.internal\" (UID: \"1bd90cee16398774209d73ccb0625fec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.138600 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.138561 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6953904926e7e025fb3a3ed04bc7d8e1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal\" (UID: \"6953904926e7e025fb3a3ed04bc7d8e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.138600 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.138579 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6953904926e7e025fb3a3ed04bc7d8e1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal\" (UID: \"6953904926e7e025fb3a3ed04bc7d8e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.140739 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.140719 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-184.ec2.internal\" not found" node="ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.238353 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.238320 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:01.239436 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.239409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6953904926e7e025fb3a3ed04bc7d8e1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal\" (UID: \"6953904926e7e025fb3a3ed04bc7d8e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.239546 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.239441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1bd90cee16398774209d73ccb0625fec-config\") pod \"kube-apiserver-proxy-ip-10-0-142-184.ec2.internal\" (UID: \"1bd90cee16398774209d73ccb0625fec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.239546 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.239459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6953904926e7e025fb3a3ed04bc7d8e1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal\" (UID: \"6953904926e7e025fb3a3ed04bc7d8e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.239546 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.239499 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6953904926e7e025fb3a3ed04bc7d8e1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal\" (UID: \"6953904926e7e025fb3a3ed04bc7d8e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.239546 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.239499 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1bd90cee16398774209d73ccb0625fec-config\") pod \"kube-apiserver-proxy-ip-10-0-142-184.ec2.internal\" (UID: \"1bd90cee16398774209d73ccb0625fec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.239684 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.239549 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6953904926e7e025fb3a3ed04bc7d8e1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal\" (UID: \"6953904926e7e025fb3a3ed04bc7d8e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.338697 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.338652 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:01.439349 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.439314 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:01.439349 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.439339 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.444732 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.444715 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-184.ec2.internal" Jun 13 03:44:01.539801 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.539774 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:01.640259 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.640233 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:01.740725 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.740648 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:01.841201 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.841170 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:01.873445 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.873418 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 13 03:44:01.874083 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.873589 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 03:44:01.905551 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:01.905328 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd90cee16398774209d73ccb0625fec.slice/crio-9e11fb4548b1f7cd598750f68257819061aa7bdef81b8a33906ff197cebc65f8 WatchSource:0}: Error finding container 9e11fb4548b1f7cd598750f68257819061aa7bdef81b8a33906ff197cebc65f8: Status 404 returned error can't find the container with id 9e11fb4548b1f7cd598750f68257819061aa7bdef81b8a33906ff197cebc65f8 Jun 13 03:44:01.905795 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:01.905774 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6953904926e7e025fb3a3ed04bc7d8e1.slice/crio-c11b9b09d0876fc74b121bb608ec94b7f2d56d9bcfdc391b7cf4ec509444da37 WatchSource:0}: Error finding container c11b9b09d0876fc74b121bb608ec94b7f2d56d9bcfdc391b7cf4ec509444da37: Status 404 returned error can't find the container with id c11b9b09d0876fc74b121bb608ec94b7f2d56d9bcfdc391b7cf4ec509444da37 Jun 13 03:44:01.912438 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.912423 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 03:44:01.942155 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:01.942136 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:01.958441 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.958419 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-12 03:39:00 +0000 UTC" deadline="2027-12-11 05:30:06.771908715 +0000 UTC" Jun 13 03:44:01.958441 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:01.958441 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13105h46m4.813470276s" Jun 13 03:44:02.014293 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.014204 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-184.ec2.internal" event={"ID":"1bd90cee16398774209d73ccb0625fec","Type":"ContainerStarted","Data":"9e11fb4548b1f7cd598750f68257819061aa7bdef81b8a33906ff197cebc65f8"} Jun 13 03:44:02.015165 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.015144 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal" event={"ID":"6953904926e7e025fb3a3ed04bc7d8e1","Type":"ContainerStarted","Data":"c11b9b09d0876fc74b121bb608ec94b7f2d56d9bcfdc391b7cf4ec509444da37"} Jun 13 03:44:02.042462 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:02.042433 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:02.126928 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.126897 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 03:44:02.143217 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:02.143177 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-184.ec2.internal\" not found" Jun 13 03:44:02.169813 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.169791 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 03:44:02.171699 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.171683 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 03:44:02.237526 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.237498 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal" Jun 13 03:44:02.249306 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.249287 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 03:44:02.250481 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.250467 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-184.ec2.internal" Jun 13 03:44:02.256065 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.256051 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 03:44:02.918377 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.918334 2562 apiserver.go:52] "Watching apiserver" Jun 13 03:44:02.926171 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.926149 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 13 03:44:02.926571 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.926548 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-qj8qf","openshift-ovn-kubernetes/ovnkube-node-j5r49","kube-system/kube-apiserver-proxy-ip-10-0-142-184.ec2.internal","openshift-cluster-node-tuning-operator/tuned-ctwcw","openshift-dns/node-resolver-p6sff","openshift-image-registry/node-ca-gzqcn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal","openshift-multus/network-metrics-daemon-5gtcb","openshift-network-diagnostics/network-check-target-x8x7g","openshift-network-operator/iptables-alerter-cj6lh","kube-system/global-pull-secret-syncer-qkfvr","kube-system/konnectivity-agent-tttnq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt","openshift-multus/multus-additional-cni-plugins-ntktp"] Jun 13 03:44:02.927834 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.927813 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cj6lh" Jun 13 03:44:02.929071 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.929053 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:02.930271 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.930249 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 13 03:44:02.930386 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.930332 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 13 03:44:02.930444 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.930383 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:02.930444 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.930252 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tfsgw\"" Jun 13 03:44:02.930621 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.930385 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 13 03:44:02.931248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.931215 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 13 03:44:02.931354 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.931338 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 13 03:44:02.931456 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.931440 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8s769\"" Jun 13 03:44:02.931531 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.931447 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 13 03:44:02.931833 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.931808 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.932559 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.932539 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 13 03:44:02.932686 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.932671 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 13 03:44:02.932879 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.932866 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 13 03:44:02.933014 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.932998 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hzfj4\"" Jun 13 03:44:02.933104 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.933077 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p6sff" Jun 13 03:44:02.933167 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.933115 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 13 03:44:02.933550 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.933533 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 13 03:44:02.933989 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.933971 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jlb2w\"" Jun 13 03:44:02.934123 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.934106 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 13 03:44:02.934186 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.934169 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 13 03:44:02.934527 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.934508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gzqcn" Jun 13 03:44:02.935238 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.935221 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fsvks\"" Jun 13 03:44:02.935326 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.935242 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 13 03:44:02.935326 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.935273 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 13 03:44:02.938177 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.936475 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 13 03:44:02.938177 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.936870 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 13 03:44:02.938177 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.936897 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 13 03:44:02.938177 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.937096 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9rbs4\"" Jun 13 03:44:02.938177 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.937584 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 13 03:44:02.939383 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.939013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:02.939383 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:02.939104 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:02.940693 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.940672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:02.940791 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:02.940746 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:02.942198 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.942177 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:02.943829 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.943810 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qj8qf" Jun 13 03:44:02.944682 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.944660 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 13 03:44:02.944828 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.944808 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 13 03:44:02.945145 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.945119 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:02.945223 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:02.945204 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:02.945823 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.945806 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 13 03:44:02.945929 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.945819 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 13 03:44:02.945929 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.945873 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 13 03:44:02.946047 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.945807 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 13 03:44:02.946047 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.946020 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fd7vj\"" Jun 13 03:44:02.946230 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.946209 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 13 03:44:02.946306 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.946234 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wcgzk\"" Jun 13 03:44:02.946677 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.946662 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tttnq" Jun 13 03:44:02.949068 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-kubernetes\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.949193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-sys\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.949193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949102 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-sys-fs\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:02.949193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b69f037-b1a8-47bf-b468-b48b84405b26-serviceca\") pod \"node-ca-gzqcn\" (UID: \"9b69f037-b1a8-47bf-b468-b48b84405b26\") " pod="openshift-image-registry/node-ca-gzqcn" Jun 13 03:44:02.949193 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949172 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 13 03:44:02.949453 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949220 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rb5ht\"" Jun 13 03:44:02.949453 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949288 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 13 03:44:02.949553 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949458 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f039be5b-cbfe-4023-bb27-d76a5061dca5-cni-binary-copy\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:02.949553 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-modprobe-d\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.949636 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-run\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.949636 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949597 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-lib-modules\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.949636 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-var-lib-kubelet\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.949771 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949642 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-device-dir\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:02.949771 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949680 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-host\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.949871 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-tuned\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.949871 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949817 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af08c78b-69e1-421a-8df3-73fa59c36e18-tmp-dir\") pod \"node-resolver-p6sff\" (UID: \"af08c78b-69e1-421a-8df3-73fa59c36e18\") " pod="openshift-dns/node-resolver-p6sff" Jun 13 03:44:02.949871 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949843 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3750a584-5758-4334-a6ed-f6c0ddf8d684-iptables-alerter-script\") pod \"iptables-alerter-cj6lh\" (UID: \"3750a584-5758-4334-a6ed-f6c0ddf8d684\") " pod="openshift-network-operator/iptables-alerter-cj6lh" Jun 13 03:44:02.950005 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btczr\" (UniqueName: \"kubernetes.io/projected/f039be5b-cbfe-4023-bb27-d76a5061dca5-kube-api-access-btczr\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:02.950005 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949904 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-systemd\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.950005 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949928 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca7e555c-7668-4e79-b101-202ad8ecc711-tmp\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.950005 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af08c78b-69e1-421a-8df3-73fa59c36e18-hosts-file\") pod \"node-resolver-p6sff\" (UID: \"af08c78b-69e1-421a-8df3-73fa59c36e18\") " pod="openshift-dns/node-resolver-p6sff" Jun 13 03:44:02.950170 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.949994 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:02.950170 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-etc-selinux\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:02.950170 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950074 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt478\" (UniqueName: \"kubernetes.io/projected/9b69f037-b1a8-47bf-b468-b48b84405b26-kube-api-access-wt478\") pod \"node-ca-gzqcn\" (UID: \"9b69f037-b1a8-47bf-b468-b48b84405b26\") " pod="openshift-image-registry/node-ca-gzqcn" Jun 13 03:44:02.950170 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950102 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f039be5b-cbfe-4023-bb27-d76a5061dca5-os-release\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:02.950170 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950128 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f039be5b-cbfe-4023-bb27-d76a5061dca5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:02.950439 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f039be5b-cbfe-4023-bb27-d76a5061dca5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:02.950439 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-sysctl-d\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.950439 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950227 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4z8s\" (UniqueName: \"kubernetes.io/projected/af08c78b-69e1-421a-8df3-73fa59c36e18-kube-api-access-c4z8s\") pod \"node-resolver-p6sff\" (UID: \"af08c78b-69e1-421a-8df3-73fa59c36e18\") " pod="openshift-dns/node-resolver-p6sff" Jun 13 03:44:02.950439 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f039be5b-cbfe-4023-bb27-d76a5061dca5-cnibin\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:02.950439 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-sysctl-conf\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.950439 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-registration-dir\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:02.950439 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950348 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpkd6\" (UniqueName: \"kubernetes.io/projected/8355d9ca-b528-46c3-bff9-556b5b853066-kube-api-access-gpkd6\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:02.950439 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b69f037-b1a8-47bf-b468-b48b84405b26-host\") pod \"node-ca-gzqcn\" (UID: \"9b69f037-b1a8-47bf-b468-b48b84405b26\") " pod="openshift-image-registry/node-ca-gzqcn" Jun 13 03:44:02.950876 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f039be5b-cbfe-4023-bb27-d76a5061dca5-system-cni-dir\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:02.950876 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f039be5b-cbfe-4023-bb27-d76a5061dca5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:02.950876 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950544 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-sysconfig\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.950876 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950580 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8pn8\" (UniqueName: \"kubernetes.io/projected/ca7e555c-7668-4e79-b101-202ad8ecc711-kube-api-access-z8pn8\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:02.950876 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3750a584-5758-4334-a6ed-f6c0ddf8d684-host-slash\") pod \"iptables-alerter-cj6lh\" (UID: \"3750a584-5758-4334-a6ed-f6c0ddf8d684\") " pod="openshift-network-operator/iptables-alerter-cj6lh" Jun 13 03:44:02.950876 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-socket-dir\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:02.950876 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8djqf\" (UniqueName: \"kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf\") pod \"network-check-target-x8x7g\" (UID: \"57ee5806-e368-4391-b4e7-cac42e9ed7e1\") " pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:02.950876 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.950749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vhbp\" (UniqueName: \"kubernetes.io/projected/3750a584-5758-4334-a6ed-f6c0ddf8d684-kube-api-access-9vhbp\") pod \"iptables-alerter-cj6lh\" (UID: \"3750a584-5758-4334-a6ed-f6c0ddf8d684\") " pod="openshift-network-operator/iptables-alerter-cj6lh" Jun 13 03:44:02.951463 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.951441 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 03:44:02.968546 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.968528 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t4bkf" Jun 13 03:44:02.973357 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:02.973323 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t4bkf" Jun 13 03:44:03.038317 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.038284 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 13 03:44:03.051146 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-cni-bin\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.051293 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btczr\" (UniqueName: \"kubernetes.io/projected/f039be5b-cbfe-4023-bb27-d76a5061dca5-kube-api-access-btczr\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.051293 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051183 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-systemd\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.051293 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051206 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca7e555c-7668-4e79-b101-202ad8ecc711-tmp\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.051293 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.051293 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051250 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-etc-selinux\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.051293 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051271 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpkvq\" (UniqueName: \"kubernetes.io/projected/1d288ee1-9260-49b3-a28d-f87148a63eed-kube-api-access-fpkvq\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.051293 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051293 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-var-lib-cni-bin\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-hostroot\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051338 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051342 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt478\" (UniqueName: \"kubernetes.io/projected/9b69f037-b1a8-47bf-b468-b48b84405b26-kube-api-access-wt478\") pod \"node-ca-gzqcn\" (UID: \"9b69f037-b1a8-47bf-b468-b48b84405b26\") " pod="openshift-image-registry/node-ca-gzqcn" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051395 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-systemd\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f039be5b-cbfe-4023-bb27-d76a5061dca5-os-release\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051445 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f039be5b-cbfe-4023-bb27-d76a5061dca5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-sysctl-d\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4z8s\" (UniqueName: \"kubernetes.io/projected/af08c78b-69e1-421a-8df3-73fa59c36e18-kube-api-access-c4z8s\") pod \"node-resolver-p6sff\" (UID: \"af08c78b-69e1-421a-8df3-73fa59c36e18\") " pod="openshift-dns/node-resolver-p6sff" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051502 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f039be5b-cbfe-4023-bb27-d76a5061dca5-os-release\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051518 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpkd6\" (UniqueName: \"kubernetes.io/projected/8355d9ca-b528-46c3-bff9-556b5b853066-kube-api-access-gpkd6\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051544 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9f285c10-8c5a-4b17-a928-14070376cf58-kubelet-config\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051571 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d288ee1-9260-49b3-a28d-f87148a63eed-ovnkube-script-lib\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-os-release\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051615 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts4jg\" (UniqueName: \"kubernetes.io/projected/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-kube-api-access-ts4jg\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051617 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051631 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-sysctl-d\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.051641 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b69f037-b1a8-47bf-b468-b48b84405b26-host\") pod \"node-ca-gzqcn\" (UID: \"9b69f037-b1a8-47bf-b468-b48b84405b26\") " pod="openshift-image-registry/node-ca-gzqcn" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f039be5b-cbfe-4023-bb27-d76a5061dca5-system-cni-dir\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f039be5b-cbfe-4023-bb27-d76a5061dca5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051791 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-sysconfig\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051822 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3750a584-5758-4334-a6ed-f6c0ddf8d684-host-slash\") pod \"iptables-alerter-cj6lh\" (UID: \"3750a584-5758-4334-a6ed-f6c0ddf8d684\") " pod="openshift-network-operator/iptables-alerter-cj6lh" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051875 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-sysconfig\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-run-systemd\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051913 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-multus-cni-dir\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051960 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b69f037-b1a8-47bf-b468-b48b84405b26-host\") pod \"node-ca-gzqcn\" (UID: \"9b69f037-b1a8-47bf-b468-b48b84405b26\") " pod="openshift-image-registry/node-ca-gzqcn" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051975 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3750a584-5758-4334-a6ed-f6c0ddf8d684-host-slash\") pod \"iptables-alerter-cj6lh\" (UID: \"3750a584-5758-4334-a6ed-f6c0ddf8d684\") " pod="openshift-network-operator/iptables-alerter-cj6lh" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.051990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-kubernetes\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052019 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-sys-fs\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-etc-kubernetes\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b69f037-b1a8-47bf-b468-b48b84405b26-serviceca\") pod \"node-ca-gzqcn\" (UID: \"9b69f037-b1a8-47bf-b468-b48b84405b26\") " pod="openshift-image-registry/node-ca-gzqcn" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052096 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-modprobe-d\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.052514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052104 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-kubernetes\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052072 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-sys-fs\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052020 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f039be5b-cbfe-4023-bb27-d76a5061dca5-system-cni-dir\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052147 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-var-lib-kubelet\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052227 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-etc-selinux\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052239 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-device-dir\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052221 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f039be5b-cbfe-4023-bb27-d76a5061dca5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052277 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-var-lib-kubelet\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052287 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f039be5b-cbfe-4023-bb27-d76a5061dca5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhjgs\" (UniqueName: \"kubernetes.io/projected/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-kube-api-access-lhjgs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052343 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-device-dir\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-node-log\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d288ee1-9260-49b3-a28d-f87148a63eed-env-overrides\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-run-multus-certs\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052500 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-host\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052525 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b69f037-b1a8-47bf-b468-b48b84405b26-serviceca\") pod \"node-ca-gzqcn\" (UID: \"9b69f037-b1a8-47bf-b468-b48b84405b26\") " pod="openshift-image-registry/node-ca-gzqcn" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052506 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-modprobe-d\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.053280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-tuned\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052586 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-host\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af08c78b-69e1-421a-8df3-73fa59c36e18-tmp-dir\") pod \"node-resolver-p6sff\" (UID: \"af08c78b-69e1-421a-8df3-73fa59c36e18\") " pod="openshift-dns/node-resolver-p6sff" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3750a584-5758-4334-a6ed-f6c0ddf8d684-iptables-alerter-script\") pod \"iptables-alerter-cj6lh\" (UID: \"3750a584-5758-4334-a6ed-f6c0ddf8d684\") " pod="openshift-network-operator/iptables-alerter-cj6lh" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9f285c10-8c5a-4b17-a928-14070376cf58-dbus\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6d920e6a-30a7-42f0-b28e-7047b0d9f779-konnectivity-ca\") pod \"konnectivity-agent-tttnq\" (UID: \"6d920e6a-30a7-42f0-b28e-7047b0d9f779\") " pod="kube-system/konnectivity-agent-tttnq" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052737 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-systemd-units\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-run-netns\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af08c78b-69e1-421a-8df3-73fa59c36e18-hosts-file\") pod \"node-resolver-p6sff\" (UID: \"af08c78b-69e1-421a-8df3-73fa59c36e18\") " pod="openshift-dns/node-resolver-p6sff" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-log-socket\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-run-ovn-kubernetes\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052862 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af08c78b-69e1-421a-8df3-73fa59c36e18-hosts-file\") pod \"node-resolver-p6sff\" (UID: \"af08c78b-69e1-421a-8df3-73fa59c36e18\") " pod="openshift-dns/node-resolver-p6sff" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d288ee1-9260-49b3-a28d-f87148a63eed-ovnkube-config\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052930 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-multus-socket-dir-parent\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f039be5b-cbfe-4023-bb27-d76a5061dca5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052979 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-etc-openvswitch\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.052999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-run-ovn\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.053958 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d288ee1-9260-49b3-a28d-f87148a63eed-ovn-node-metrics-cert\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-multus-conf-dir\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053057 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f039be5b-cbfe-4023-bb27-d76a5061dca5-cnibin\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-sysctl-conf\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-registration-dir\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053129 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-run-netns\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053139 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-registration-dir\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053173 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f039be5b-cbfe-4023-bb27-d76a5061dca5-cnibin\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8pn8\" (UniqueName: \"kubernetes.io/projected/ca7e555c-7668-4e79-b101-202ad8ecc711-kube-api-access-z8pn8\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053206 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f039be5b-cbfe-4023-bb27-d76a5061dca5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-socket-dir\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-system-cni-dir\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053259 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-sysctl-conf\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053263 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djqf\" (UniqueName: \"kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf\") pod \"network-check-target-x8x7g\" (UID: \"57ee5806-e368-4391-b4e7-cac42e9ed7e1\") " pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vhbp\" (UniqueName: \"kubernetes.io/projected/3750a584-5758-4334-a6ed-f6c0ddf8d684-kube-api-access-9vhbp\") pod \"iptables-alerter-cj6lh\" (UID: \"3750a584-5758-4334-a6ed-f6c0ddf8d684\") " pod="openshift-network-operator/iptables-alerter-cj6lh" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053298 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6d920e6a-30a7-42f0-b28e-7047b0d9f779-agent-certs\") pod \"konnectivity-agent-tttnq\" (UID: \"6d920e6a-30a7-42f0-b28e-7047b0d9f779\") " pod="kube-system/konnectivity-agent-tttnq" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-run-openvswitch\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.054611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-run-k8s-cni-cncf-io\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-var-lib-cni-multus\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-var-lib-kubelet\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053385 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3750a584-5758-4334-a6ed-f6c0ddf8d684-iptables-alerter-script\") pod \"iptables-alerter-cj6lh\" (UID: \"3750a584-5758-4334-a6ed-f6c0ddf8d684\") " pod="openshift-network-operator/iptables-alerter-cj6lh" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053405 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-sys\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053381 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8355d9ca-b528-46c3-bff9-556b5b853066-socket-dir\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053465 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-sys\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-slash\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053600 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-var-lib-openvswitch\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053627 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-cni-netd\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-cnibin\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053665 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af08c78b-69e1-421a-8df3-73fa59c36e18-tmp-dir\") pod \"node-resolver-p6sff\" (UID: \"af08c78b-69e1-421a-8df3-73fa59c36e18\") " pod="openshift-dns/node-resolver-p6sff" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-multus-daemon-config\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053754 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f039be5b-cbfe-4023-bb27-d76a5061dca5-cni-binary-copy\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-run\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-run\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.055229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-lib-modules\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.055770 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-kubelet\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.055770 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.053980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-cni-binary-copy\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.055770 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.054070 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca7e555c-7668-4e79-b101-202ad8ecc711-lib-modules\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.055770 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.054203 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f039be5b-cbfe-4023-bb27-d76a5061dca5-cni-binary-copy\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.055770 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.055155 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca7e555c-7668-4e79-b101-202ad8ecc711-tmp\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.055770 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.055180 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca7e555c-7668-4e79-b101-202ad8ecc711-etc-tuned\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.059956 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.059876 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt478\" (UniqueName: \"kubernetes.io/projected/9b69f037-b1a8-47bf-b468-b48b84405b26-kube-api-access-wt478\") pod \"node-ca-gzqcn\" (UID: \"9b69f037-b1a8-47bf-b468-b48b84405b26\") " pod="openshift-image-registry/node-ca-gzqcn" Jun 13 03:44:03.060133 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.060110 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btczr\" (UniqueName: \"kubernetes.io/projected/f039be5b-cbfe-4023-bb27-d76a5061dca5-kube-api-access-btczr\") pod \"multus-additional-cni-plugins-ntktp\" (UID: \"f039be5b-cbfe-4023-bb27-d76a5061dca5\") " pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.060424 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.060354 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4z8s\" (UniqueName: \"kubernetes.io/projected/af08c78b-69e1-421a-8df3-73fa59c36e18-kube-api-access-c4z8s\") pod \"node-resolver-p6sff\" (UID: \"af08c78b-69e1-421a-8df3-73fa59c36e18\") " pod="openshift-dns/node-resolver-p6sff" Jun 13 03:44:03.060513 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.060449 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:03.060513 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.060471 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:03.060513 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.060484 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8djqf for pod openshift-network-diagnostics/network-check-target-x8x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:03.060628 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.060567 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf podName:57ee5806-e368-4391-b4e7-cac42e9ed7e1 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:03.560545905 +0000 UTC m=+3.034039657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8djqf" (UniqueName: "kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf") pod "network-check-target-x8x7g" (UID: "57ee5806-e368-4391-b4e7-cac42e9ed7e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:03.061703 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.061663 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpkd6\" (UniqueName: \"kubernetes.io/projected/8355d9ca-b528-46c3-bff9-556b5b853066-kube-api-access-gpkd6\") pod \"aws-ebs-csi-driver-node-ssdtt\" (UID: \"8355d9ca-b528-46c3-bff9-556b5b853066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.062531 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.062507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8pn8\" (UniqueName: \"kubernetes.io/projected/ca7e555c-7668-4e79-b101-202ad8ecc711-kube-api-access-z8pn8\") pod \"tuned-ctwcw\" (UID: \"ca7e555c-7668-4e79-b101-202ad8ecc711\") " pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.064501 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.064477 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vhbp\" (UniqueName: \"kubernetes.io/projected/3750a584-5758-4334-a6ed-f6c0ddf8d684-kube-api-access-9vhbp\") pod \"iptables-alerter-cj6lh\" (UID: \"3750a584-5758-4334-a6ed-f6c0ddf8d684\") " pod="openshift-network-operator/iptables-alerter-cj6lh" Jun 13 03:44:03.155003 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.154974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9f285c10-8c5a-4b17-a928-14070376cf58-kubelet-config\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:03.155003 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d288ee1-9260-49b3-a28d-f87148a63eed-ovnkube-script-lib\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.155220 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155020 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-os-release\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.155220 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9f285c10-8c5a-4b17-a928-14070376cf58-kubelet-config\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:03.155220 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts4jg\" (UniqueName: \"kubernetes.io/projected/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-kube-api-access-ts4jg\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.155220 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155195 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-os-release\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.155220 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155207 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:03.155479 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155239 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.155479 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-run-systemd\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.155479 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155345 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.155479 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155405 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-multus-cni-dir\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.155479 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-etc-kubernetes\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.155479 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155452 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-run-systemd\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.155479 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155469 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhjgs\" (UniqueName: \"kubernetes.io/projected/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-kube-api-access-lhjgs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155519 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-node-log\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155545 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d288ee1-9260-49b3-a28d-f87148a63eed-env-overrides\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155546 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-etc-kubernetes\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155554 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-multus-cni-dir\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155552 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-node-log\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155567 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d288ee1-9260-49b3-a28d-f87148a63eed-ovnkube-script-lib\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.155520 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155570 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-run-multus-certs\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155610 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-run-multus-certs\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9f285c10-8c5a-4b17-a928-14070376cf58-dbus\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.155634 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs podName:0b2f1c7f-0403-4a8d-b546-53e9a0cde19a nodeName:}" failed. No retries permitted until 2026-06-13 03:44:03.655617071 +0000 UTC m=+3.129110823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs") pod "network-metrics-daemon-5gtcb" (UID: "0b2f1c7f-0403-4a8d-b546-53e9a0cde19a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155677 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9f285c10-8c5a-4b17-a928-14070376cf58-dbus\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155689 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6d920e6a-30a7-42f0-b28e-7047b0d9f779-konnectivity-ca\") pod \"konnectivity-agent-tttnq\" (UID: \"6d920e6a-30a7-42f0-b28e-7047b0d9f779\") " pod="kube-system/konnectivity-agent-tttnq" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-systemd-units\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-run-netns\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.155799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-log-socket\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155816 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-run-netns\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155821 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-systemd-units\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-run-ovn-kubernetes\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155871 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d288ee1-9260-49b3-a28d-f87148a63eed-ovnkube-config\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-multus-socket-dir-parent\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155903 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-run-ovn-kubernetes\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156148 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6d920e6a-30a7-42f0-b28e-7047b0d9f779-konnectivity-ca\") pod \"konnectivity-agent-tttnq\" (UID: \"6d920e6a-30a7-42f0-b28e-7047b0d9f779\") " pod="kube-system/konnectivity-agent-tttnq" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.155873 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-log-socket\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156293 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-multus-socket-dir-parent\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-etc-openvswitch\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-run-ovn\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156436 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d288ee1-9260-49b3-a28d-f87148a63eed-env-overrides\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d288ee1-9260-49b3-a28d-f87148a63eed-ovn-node-metrics-cert\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156487 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-multus-conf-dir\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156493 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d288ee1-9260-49b3-a28d-f87148a63eed-ovnkube-config\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156494 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-etc-openvswitch\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-run-netns\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.156643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156518 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-run-ovn\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156543 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-multus-conf-dir\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-system-cni-dir\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156584 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-run-netns\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6d920e6a-30a7-42f0-b28e-7047b0d9f779-agent-certs\") pod \"konnectivity-agent-tttnq\" (UID: \"6d920e6a-30a7-42f0-b28e-7047b0d9f779\") " pod="kube-system/konnectivity-agent-tttnq" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156594 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-system-cni-dir\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156623 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-run-openvswitch\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-run-k8s-cni-cncf-io\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-var-lib-cni-multus\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-var-lib-kubelet\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156736 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-run-openvswitch\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-slash\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156802 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-var-lib-kubelet\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156808 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-var-lib-cni-multus\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-var-lib-openvswitch\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-run-k8s-cni-cncf-io\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156854 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-cni-netd\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156857 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-var-lib-openvswitch\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-cnibin\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156906 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-slash\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-multus-daemon-config\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.156921 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156948 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-kubelet\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.156972 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret podName:9f285c10-8c5a-4b17-a928-14070376cf58 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:03.656957535 +0000 UTC m=+3.130451271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret") pod "global-pull-secret-syncer-qkfvr" (UID: "9f285c10-8c5a-4b17-a928-14070376cf58") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156985 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-kubelet\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.156997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-cni-binary-copy\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.157034 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-cni-netd\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.157061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-cni-bin\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.157093 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpkvq\" (UniqueName: \"kubernetes.io/projected/1d288ee1-9260-49b3-a28d-f87148a63eed-kube-api-access-fpkvq\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.157119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-var-lib-cni-bin\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.157138 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-hostroot\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.157181 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-hostroot\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.157205 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d288ee1-9260-49b3-a28d-f87148a63eed-host-cni-bin\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.157398 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-host-var-lib-cni-bin\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.157411 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-multus-daemon-config\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.157896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.157448 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-cnibin\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.158519 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.157492 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-cni-binary-copy\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.158918 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.158899 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d288ee1-9260-49b3-a28d-f87148a63eed-ovn-node-metrics-cert\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.159051 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.159035 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6d920e6a-30a7-42f0-b28e-7047b0d9f779-agent-certs\") pod \"konnectivity-agent-tttnq\" (UID: \"6d920e6a-30a7-42f0-b28e-7047b0d9f779\") " pod="kube-system/konnectivity-agent-tttnq" Jun 13 03:44:03.165138 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.165107 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts4jg\" (UniqueName: \"kubernetes.io/projected/21cdf5eb-ffb9-49bb-8b6e-9096b17cf055-kube-api-access-ts4jg\") pod \"multus-qj8qf\" (UID: \"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055\") " pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.165945 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.165924 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhjgs\" (UniqueName: \"kubernetes.io/projected/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-kube-api-access-lhjgs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:03.166243 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.166219 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpkvq\" (UniqueName: \"kubernetes.io/projected/1d288ee1-9260-49b3-a28d-f87148a63eed-kube-api-access-fpkvq\") pod \"ovnkube-node-j5r49\" (UID: \"1d288ee1-9260-49b3-a28d-f87148a63eed\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.240312 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.240211 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cj6lh" Jun 13 03:44:03.247386 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.247347 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" Jun 13 03:44:03.254059 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.254036 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ntktp" Jun 13 03:44:03.259643 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.259622 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" Jun 13 03:44:03.265747 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.265732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p6sff" Jun 13 03:44:03.271672 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.271637 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gzqcn" Jun 13 03:44:03.278919 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.278901 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:03.285745 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.285727 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qj8qf" Jun 13 03:44:03.290862 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.290847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tttnq" Jun 13 03:44:03.351596 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.351558 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 03:44:03.660703 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.660660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djqf\" (UniqueName: \"kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf\") pod \"network-check-target-x8x7g\" (UID: \"57ee5806-e368-4391-b4e7-cac42e9ed7e1\") " pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:03.660897 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.660714 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:03.660897 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.660766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:03.660897 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.660838 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:03.660897 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.660868 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:03.660897 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.660876 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:03.660897 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.660897 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:03.661138 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.660911 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8djqf for pod openshift-network-diagnostics/network-check-target-x8x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:03.661138 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.660934 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret podName:9f285c10-8c5a-4b17-a928-14070376cf58 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:04.660914002 +0000 UTC m=+4.134407750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret") pod "global-pull-secret-syncer-qkfvr" (UID: "9f285c10-8c5a-4b17-a928-14070376cf58") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:03.661138 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.660953 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf podName:57ee5806-e368-4391-b4e7-cac42e9ed7e1 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:04.660943415 +0000 UTC m=+4.134437150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8djqf" (UniqueName: "kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf") pod "network-check-target-x8x7g" (UID: "57ee5806-e368-4391-b4e7-cac42e9ed7e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:03.661138 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:03.660972 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs podName:0b2f1c7f-0403-4a8d-b546-53e9a0cde19a nodeName:}" failed. No retries permitted until 2026-06-13 03:44:04.660964787 +0000 UTC m=+4.134458519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs") pod "network-metrics-daemon-5gtcb" (UID: "0b2f1c7f-0403-4a8d-b546-53e9a0cde19a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:03.919319 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:03.919265 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d920e6a_30a7_42f0_b28e_7047b0d9f779.slice/crio-709fe104afa7cd160095fa6b74290943c742f772e6fc9c1485f83a72a3a7c2a4 WatchSource:0}: Error finding container 709fe104afa7cd160095fa6b74290943c742f772e6fc9c1485f83a72a3a7c2a4: Status 404 returned error can't find the container with id 709fe104afa7cd160095fa6b74290943c742f772e6fc9c1485f83a72a3a7c2a4 Jun 13 03:44:03.919795 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:03.919770 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3750a584_5758_4334_a6ed_f6c0ddf8d684.slice/crio-005d239506059a8c55dad3ea2ee2893730729ef9b9a84f955d3336a706a2c1b3 WatchSource:0}: Error finding container 005d239506059a8c55dad3ea2ee2893730729ef9b9a84f955d3336a706a2c1b3: Status 404 returned error can't find the container with id 005d239506059a8c55dad3ea2ee2893730729ef9b9a84f955d3336a706a2c1b3 Jun 13 03:44:03.924138 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:03.924112 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf08c78b_69e1_421a_8df3_73fa59c36e18.slice/crio-afeab895d25838ea2ee70ff60738ef6afe8e8c8532149c000522afe4c9401db0 WatchSource:0}: Error finding container afeab895d25838ea2ee70ff60738ef6afe8e8c8532149c000522afe4c9401db0: Status 404 returned error can't find the container with id afeab895d25838ea2ee70ff60738ef6afe8e8c8532149c000522afe4c9401db0 Jun 13 03:44:03.924625 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:03.924604 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8355d9ca_b528_46c3_bff9_556b5b853066.slice/crio-ea16075096f176c5a0a0eec0397cfc2d88c365705655c45521e9eca4f6704649 WatchSource:0}: Error finding container ea16075096f176c5a0a0eec0397cfc2d88c365705655c45521e9eca4f6704649: Status 404 returned error can't find the container with id ea16075096f176c5a0a0eec0397cfc2d88c365705655c45521e9eca4f6704649 Jun 13 03:44:03.925593 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:03.925506 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cdf5eb_ffb9_49bb_8b6e_9096b17cf055.slice/crio-43f5f53b54d306c2cf3af8189d61bb59af00c3e80dfbc97a64769c842b846812 WatchSource:0}: Error finding container 43f5f53b54d306c2cf3af8189d61bb59af00c3e80dfbc97a64769c842b846812: Status 404 returned error can't find the container with id 43f5f53b54d306c2cf3af8189d61bb59af00c3e80dfbc97a64769c842b846812 Jun 13 03:44:03.932302 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:03.932090 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d288ee1_9260_49b3_a28d_f87148a63eed.slice/crio-3751aca827ba0f354687db9f62b6640fe407c9276fb70cff29aa52af0d016ec9 WatchSource:0}: Error finding container 3751aca827ba0f354687db9f62b6640fe407c9276fb70cff29aa52af0d016ec9: Status 404 returned error can't find the container with id 3751aca827ba0f354687db9f62b6640fe407c9276fb70cff29aa52af0d016ec9 Jun 13 03:44:03.976411 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.976340 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 03:39:02 +0000 UTC" deadline="2028-02-28 02:34:56.619543156 +0000 UTC" Jun 13 03:44:03.976411 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:03.976409 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14998h50m52.643139146s" Jun 13 03:44:04.019307 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.019281 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tttnq" event={"ID":"6d920e6a-30a7-42f0-b28e-7047b0d9f779","Type":"ContainerStarted","Data":"709fe104afa7cd160095fa6b74290943c742f772e6fc9c1485f83a72a3a7c2a4"} Jun 13 03:44:04.021200 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.021172 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-184.ec2.internal" event={"ID":"1bd90cee16398774209d73ccb0625fec","Type":"ContainerStarted","Data":"038df85dd14ea9d7db22c10bf2b1f5ef98aab6ce38cb259ca5fef2b41f8698ec"} Jun 13 03:44:04.023099 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.023078 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" event={"ID":"8355d9ca-b528-46c3-bff9-556b5b853066","Type":"ContainerStarted","Data":"ea16075096f176c5a0a0eec0397cfc2d88c365705655c45521e9eca4f6704649"} Jun 13 03:44:04.025707 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.025669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ntktp" event={"ID":"f039be5b-cbfe-4023-bb27-d76a5061dca5","Type":"ContainerStarted","Data":"82e916f64f7a027906149a1ad65d32ab67dc13d6585b892de2679c975301e6c6"} Jun 13 03:44:04.026722 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.026702 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qj8qf" event={"ID":"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055","Type":"ContainerStarted","Data":"43f5f53b54d306c2cf3af8189d61bb59af00c3e80dfbc97a64769c842b846812"} Jun 13 03:44:04.027779 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.027760 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p6sff" event={"ID":"af08c78b-69e1-421a-8df3-73fa59c36e18","Type":"ContainerStarted","Data":"afeab895d25838ea2ee70ff60738ef6afe8e8c8532149c000522afe4c9401db0"} Jun 13 03:44:04.028749 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.028728 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cj6lh" event={"ID":"3750a584-5758-4334-a6ed-f6c0ddf8d684","Type":"ContainerStarted","Data":"005d239506059a8c55dad3ea2ee2893730729ef9b9a84f955d3336a706a2c1b3"} Jun 13 03:44:04.033211 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.033191 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" event={"ID":"1d288ee1-9260-49b3-a28d-f87148a63eed","Type":"ContainerStarted","Data":"3751aca827ba0f354687db9f62b6640fe407c9276fb70cff29aa52af0d016ec9"} Jun 13 03:44:04.034491 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.034438 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-184.ec2.internal" podStartSLOduration=2.034425829 podStartE2EDuration="2.034425829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:04.034245241 +0000 UTC m=+3.507739007" watchObservedRunningTime="2026-06-13 03:44:04.034425829 +0000 UTC m=+3.507919582" Jun 13 03:44:04.037176 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.037148 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gzqcn" event={"ID":"9b69f037-b1a8-47bf-b468-b48b84405b26","Type":"ContainerStarted","Data":"1aa6381bd5d5ebe5fe516f4b9549c4c9230ba2984bcd383e6709a957ac393493"} Jun 13 03:44:04.038482 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.038459 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" event={"ID":"ca7e555c-7668-4e79-b101-202ad8ecc711","Type":"ContainerStarted","Data":"5771fd63e5740d985d0b69d4d783371cf3649599c2bd463f18f8154ea6e59b7c"} Jun 13 03:44:04.669173 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.669134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djqf\" (UniqueName: \"kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf\") pod \"network-check-target-x8x7g\" (UID: \"57ee5806-e368-4391-b4e7-cac42e9ed7e1\") " pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:04.669349 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.669193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:04.669349 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.669247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:04.669558 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:04.669407 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:04.669558 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:04.669469 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs podName:0b2f1c7f-0403-4a8d-b546-53e9a0cde19a nodeName:}" failed. No retries permitted until 2026-06-13 03:44:06.669451449 +0000 UTC m=+6.142945203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs") pod "network-metrics-daemon-5gtcb" (UID: "0b2f1c7f-0403-4a8d-b546-53e9a0cde19a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:04.669558 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:04.669474 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:04.669558 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:04.669491 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:04.669558 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:04.669502 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8djqf for pod openshift-network-diagnostics/network-check-target-x8x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:04.669558 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:04.669536 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf podName:57ee5806-e368-4391-b4e7-cac42e9ed7e1 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:06.669525026 +0000 UTC m=+6.143018778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8djqf" (UniqueName: "kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf") pod "network-check-target-x8x7g" (UID: "57ee5806-e368-4391-b4e7-cac42e9ed7e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:04.669558 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:04.669545 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:04.669935 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:04.669617 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret podName:9f285c10-8c5a-4b17-a928-14070376cf58 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:06.669591961 +0000 UTC m=+6.143085695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret") pod "global-pull-secret-syncer-qkfvr" (UID: "9f285c10-8c5a-4b17-a928-14070376cf58") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:04.977457 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.977371 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 03:39:02 +0000 UTC" deadline="2027-12-31 22:31:44.221951618 +0000 UTC" Jun 13 03:44:04.977457 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:04.977412 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13602h47m39.244544622s" Jun 13 03:44:05.012420 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:05.012390 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:05.012581 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:05.012529 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:05.012913 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:05.012892 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:05.013021 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:05.012988 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:05.013112 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:05.013045 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:05.013162 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:05.013117 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:05.061851 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:05.060780 2562 generic.go:356] "Generic (PLEG): container finished" podID="6953904926e7e025fb3a3ed04bc7d8e1" containerID="b5243401a3ae1b9944ad811c690816ea1f8ce170fe3090ca8474e00a5c76d575" exitCode=0 Jun 13 03:44:05.061851 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:05.061649 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal" event={"ID":"6953904926e7e025fb3a3ed04bc7d8e1","Type":"ContainerDied","Data":"b5243401a3ae1b9944ad811c690816ea1f8ce170fe3090ca8474e00a5c76d575"} Jun 13 03:44:06.085418 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:06.085374 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal" event={"ID":"6953904926e7e025fb3a3ed04bc7d8e1","Type":"ContainerStarted","Data":"6eb075dabde607ceded4e72fb0f2c9c247355d13ea9a384b36a6cb64cc989f67"} Jun 13 03:44:06.686118 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:06.685122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:06.686118 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:06.685198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djqf\" (UniqueName: \"kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf\") pod \"network-check-target-x8x7g\" (UID: \"57ee5806-e368-4391-b4e7-cac42e9ed7e1\") " pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:06.686118 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:06.685231 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:06.686118 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:06.685416 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:06.686118 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:06.685477 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret podName:9f285c10-8c5a-4b17-a928-14070376cf58 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:10.685459174 +0000 UTC m=+10.158952908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret") pod "global-pull-secret-syncer-qkfvr" (UID: "9f285c10-8c5a-4b17-a928-14070376cf58") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:06.686118 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:06.685851 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:06.686118 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:06.685896 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs podName:0b2f1c7f-0403-4a8d-b546-53e9a0cde19a nodeName:}" failed. No retries permitted until 2026-06-13 03:44:10.685882079 +0000 UTC m=+10.159375814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs") pod "network-metrics-daemon-5gtcb" (UID: "0b2f1c7f-0403-4a8d-b546-53e9a0cde19a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:06.686118 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:06.685971 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:06.686118 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:06.685987 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:06.686118 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:06.685998 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8djqf for pod openshift-network-diagnostics/network-check-target-x8x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:06.686118 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:06.686031 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf podName:57ee5806-e368-4391-b4e7-cac42e9ed7e1 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:10.68602045 +0000 UTC m=+10.159514187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8djqf" (UniqueName: "kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf") pod "network-check-target-x8x7g" (UID: "57ee5806-e368-4391-b4e7-cac42e9ed7e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:07.011386 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:07.011040 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:07.011386 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:07.011071 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:07.011386 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:07.011192 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:07.011640 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:07.011397 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:07.011640 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:07.011510 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:07.011640 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:07.011604 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:09.011136 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:09.011071 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:09.011136 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:09.011104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:09.011672 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:09.011071 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:09.011672 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:09.011207 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:09.011672 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:09.011289 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:09.011672 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:09.011398 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:10.719698 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:10.719459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djqf\" (UniqueName: \"kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf\") pod \"network-check-target-x8x7g\" (UID: \"57ee5806-e368-4391-b4e7-cac42e9ed7e1\") " pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:10.719698 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:10.719513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:10.719698 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:10.719563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:10.719698 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:10.719673 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:10.719698 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:10.719680 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:10.719698 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:10.719709 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:10.720426 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:10.719727 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8djqf for pod openshift-network-diagnostics/network-check-target-x8x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:10.720426 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:10.719679 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:10.720426 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:10.719764 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret podName:9f285c10-8c5a-4b17-a928-14070376cf58 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:18.719743812 +0000 UTC m=+18.193237558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret") pod "global-pull-secret-syncer-qkfvr" (UID: "9f285c10-8c5a-4b17-a928-14070376cf58") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:10.720426 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:10.719814 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf podName:57ee5806-e368-4391-b4e7-cac42e9ed7e1 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:18.71979793 +0000 UTC m=+18.193291667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8djqf" (UniqueName: "kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf") pod "network-check-target-x8x7g" (UID: "57ee5806-e368-4391-b4e7-cac42e9ed7e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:10.720426 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:10.719829 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs podName:0b2f1c7f-0403-4a8d-b546-53e9a0cde19a nodeName:}" failed. No retries permitted until 2026-06-13 03:44:18.719822284 +0000 UTC m=+18.193316015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs") pod "network-metrics-daemon-5gtcb" (UID: "0b2f1c7f-0403-4a8d-b546-53e9a0cde19a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:11.016069 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:11.015760 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:11.016069 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:11.016019 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:11.016069 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:11.016066 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:11.016308 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:11.016155 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:11.016385 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:11.016327 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:11.016443 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:11.016380 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:13.011488 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:13.011450 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:13.011937 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:13.011581 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:13.011994 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:13.011957 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:13.012073 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:13.012052 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:13.012229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:13.012198 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:13.012351 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:13.012325 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:15.010750 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:15.010716 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:15.010750 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:15.010741 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:15.011214 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:15.010741 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:15.011214 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:15.010848 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:15.011214 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:15.010921 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:15.011214 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:15.011037 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:17.010816 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:17.010773 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:17.010816 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:17.010815 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:17.011326 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:17.010778 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:17.011326 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:17.010898 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:17.011326 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:17.010982 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:17.011326 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:17.011079 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:18.777266 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:18.777228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djqf\" (UniqueName: \"kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf\") pod \"network-check-target-x8x7g\" (UID: \"57ee5806-e368-4391-b4e7-cac42e9ed7e1\") " pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:18.777266 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:18.777274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:18.777813 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:18.777310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:18.777813 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:18.777427 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:18.777813 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:18.777480 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs podName:0b2f1c7f-0403-4a8d-b546-53e9a0cde19a nodeName:}" failed. No retries permitted until 2026-06-13 03:44:34.77746722 +0000 UTC m=+34.250960952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs") pod "network-metrics-daemon-5gtcb" (UID: "0b2f1c7f-0403-4a8d-b546-53e9a0cde19a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:18.777813 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:18.777427 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:18.777813 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:18.777561 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret podName:9f285c10-8c5a-4b17-a928-14070376cf58 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:34.777547541 +0000 UTC m=+34.251041272 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret") pod "global-pull-secret-syncer-qkfvr" (UID: "9f285c10-8c5a-4b17-a928-14070376cf58") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:18.777813 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:18.777428 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:18.777813 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:18.777582 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:18.777813 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:18.777592 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8djqf for pod openshift-network-diagnostics/network-check-target-x8x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:18.777813 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:18.777615 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf podName:57ee5806-e368-4391-b4e7-cac42e9ed7e1 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:34.777608801 +0000 UTC m=+34.251102532 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8djqf" (UniqueName: "kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf") pod "network-check-target-x8x7g" (UID: "57ee5806-e368-4391-b4e7-cac42e9ed7e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:19.010798 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:19.010766 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:19.010798 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:19.010787 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:19.011071 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:19.010766 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:19.011071 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:19.010894 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:19.011071 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:19.010971 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:19.011071 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:19.011057 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:21.013463 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:21.013427 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:21.013463 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:21.013447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:21.013929 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:21.013546 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:21.013929 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:21.013563 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:21.013929 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:21.013653 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:21.013929 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:21.013743 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:23.013265 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.013118 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:23.013868 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.013179 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:23.013868 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:23.013337 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:23.013868 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:23.013431 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:23.013868 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.013177 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:23.013868 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:23.013489 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:23.122875 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.122848 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tttnq" event={"ID":"6d920e6a-30a7-42f0-b28e-7047b0d9f779","Type":"ContainerStarted","Data":"826626d3018a777155c22b8930db75f866adc42765d33ead1594bfc3078872a0"} Jun 13 03:44:23.124327 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.124302 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" event={"ID":"8355d9ca-b528-46c3-bff9-556b5b853066","Type":"ContainerStarted","Data":"448f7b73fc8192c3267bc8ab4551d898ea02b2fcae3afd6f304168ffdd97286a"} Jun 13 03:44:23.125793 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.125772 2562 generic.go:356] "Generic (PLEG): container finished" podID="f039be5b-cbfe-4023-bb27-d76a5061dca5" containerID="9226aec2b170b1c26aee30f16aba88eabb613a51389e7756b308051ae271c129" exitCode=0 Jun 13 03:44:23.125886 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.125833 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ntktp" event={"ID":"f039be5b-cbfe-4023-bb27-d76a5061dca5","Type":"ContainerDied","Data":"9226aec2b170b1c26aee30f16aba88eabb613a51389e7756b308051ae271c129"} Jun 13 03:44:23.128516 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.128404 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qj8qf" event={"ID":"21cdf5eb-ffb9-49bb-8b6e-9096b17cf055","Type":"ContainerStarted","Data":"8c815cc4c5ce79e0b6ab33c8b6e261a5740a5ea127ab87b08707e7d4f636e191"} Jun 13 03:44:23.131182 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.131159 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p6sff" event={"ID":"af08c78b-69e1-421a-8df3-73fa59c36e18","Type":"ContainerStarted","Data":"23d75285f5c090b2a046fd4c17b6d7f838d3e4cb450650751f98e38f256f5404"} Jun 13 03:44:23.133590 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.133570 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 03:44:23.133896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.133876 2562 generic.go:356] "Generic (PLEG): container finished" podID="1d288ee1-9260-49b3-a28d-f87148a63eed" containerID="3e6b2a099cf552374597a77f4ea406db219da018c76f76acc592f918d8ae4fc0" exitCode=1 Jun 13 03:44:23.133969 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.133944 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" event={"ID":"1d288ee1-9260-49b3-a28d-f87148a63eed","Type":"ContainerStarted","Data":"442a310793606921ea7ae76e64941a238599eea866bfa314c14c7bdad29342b2"} Jun 13 03:44:23.134030 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.134014 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" event={"ID":"1d288ee1-9260-49b3-a28d-f87148a63eed","Type":"ContainerStarted","Data":"539aad4ccc4b48768768f545b8ce53ba5bceef050bb1fe30605573098f29ac1f"} Jun 13 03:44:23.134081 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.134069 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" event={"ID":"1d288ee1-9260-49b3-a28d-f87148a63eed","Type":"ContainerStarted","Data":"001e70dc38db393e6fbbe6f4f265ad9c36262d830c246db960fd9e599eba2b25"} Jun 13 03:44:23.134130 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.134118 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" event={"ID":"1d288ee1-9260-49b3-a28d-f87148a63eed","Type":"ContainerDied","Data":"3e6b2a099cf552374597a77f4ea406db219da018c76f76acc592f918d8ae4fc0"} Jun 13 03:44:23.134175 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.134154 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" event={"ID":"1d288ee1-9260-49b3-a28d-f87148a63eed","Type":"ContainerStarted","Data":"f46e292ac8c9d19fa4effc0f72fe795fc68abb7dbef6a9aa313de6f65e74bdb2"} Jun 13 03:44:23.135252 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.135231 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gzqcn" event={"ID":"9b69f037-b1a8-47bf-b468-b48b84405b26","Type":"ContainerStarted","Data":"7af26b0f8cb41c183256ceb5e3b30150c6b91d2e877233ac2114ca836db3a02d"} Jun 13 03:44:23.136427 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.136408 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" event={"ID":"ca7e555c-7668-4e79-b101-202ad8ecc711","Type":"ContainerStarted","Data":"49ae0a0f3943ebe3c2223f0774f52046eeb0573894a4cfa34ad0baa23650a13d"} Jun 13 03:44:23.137844 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.137810 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-184.ec2.internal" podStartSLOduration=21.137799825 podStartE2EDuration="21.137799825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:06.101093408 +0000 UTC m=+5.574587161" watchObservedRunningTime="2026-06-13 03:44:23.137799825 +0000 UTC m=+22.611293577" Jun 13 03:44:23.138000 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.137981 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tttnq" podStartSLOduration=3.927772654 podStartE2EDuration="22.137976489s" totalImagesPullingTime="18.210203835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:23.137432852 +0000 UTC m=+22.610926618" watchObservedRunningTime="2026-06-13 03:44:23.137976489 +0000 UTC m=+22.611470243" Jun 13 03:44:23.172337 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.172281 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ctwcw" podStartSLOduration=3.6219844820000002 podStartE2EDuration="22.172259642s" totalImagesPullingTime="18.55027516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:23.171597924 +0000 UTC m=+22.645091677" watchObservedRunningTime="2026-06-13 03:44:23.172259642 +0000 UTC m=+22.645753398" Jun 13 03:44:23.186972 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.186929 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p6sff" podStartSLOduration=3.64871724 podStartE2EDuration="22.186913303s" totalImagesPullingTime="18.538196063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:23.186469385 +0000 UTC m=+22.659963137" watchObservedRunningTime="2026-06-13 03:44:23.186913303 +0000 UTC m=+22.660407056" Jun 13 03:44:23.205489 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.205445 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gzqcn" podStartSLOduration=3.660478194 podStartE2EDuration="22.205430548s" totalImagesPullingTime="18.544952354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:23.205052142 +0000 UTC m=+22.678545923" watchObservedRunningTime="2026-06-13 03:44:23.205430548 +0000 UTC m=+22.678924355" Jun 13 03:44:23.223802 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.223541 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qj8qf" podStartSLOduration=3.6379430790000002 podStartE2EDuration="22.223527062s" totalImagesPullingTime="18.585583983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:23.223434394 +0000 UTC m=+22.696928167" watchObservedRunningTime="2026-06-13 03:44:23.223527062 +0000 UTC m=+22.697020815" Jun 13 03:44:23.876083 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:23.876061 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tttnq" Jun 13 03:44:24.067623 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:24.067604 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 13 03:44:24.140985 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:24.140954 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" event={"ID":"8355d9ca-b528-46c3-bff9-556b5b853066","Type":"ContainerStarted","Data":"ed23ca92cb1ec4a971fe613baf0c64b69a77b8081d2339e1fed45556b1999b89"} Jun 13 03:44:24.142524 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:24.142491 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cj6lh" event={"ID":"3750a584-5758-4334-a6ed-f6c0ddf8d684","Type":"ContainerStarted","Data":"604cb144bc3c2d9fa7310fa601b3a71168e29251e2724517e7c343c836904b38"} Jun 13 03:44:24.145501 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:24.145483 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 03:44:24.145970 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:24.145943 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" event={"ID":"1d288ee1-9260-49b3-a28d-f87148a63eed","Type":"ContainerStarted","Data":"cc4b2f39329c0c70cae4bff24f43eb32c676b57bce7579f5c0d6f7d3f7b8f233"} Jun 13 03:44:24.155903 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:24.155863 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cj6lh" podStartSLOduration=4.596755238 podStartE2EDuration="23.15584889s" totalImagesPullingTime="18.559093652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:24.155449296 +0000 UTC m=+23.628943064" watchObservedRunningTime="2026-06-13 03:44:24.15584889 +0000 UTC m=+23.629342643" Jun 13 03:44:24.729272 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:24.729238 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tttnq" Jun 13 03:44:24.729961 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:24.729931 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tttnq" Jun 13 03:44:25.010808 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:25.010732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:25.010808 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:25.010764 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:25.011008 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:25.010734 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:25.011008 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:25.010859 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:25.011008 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:25.010932 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:25.011164 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:25.011003 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:25.019268 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:25.019186 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-13T03:44:24.067620983Z","UUID":"5f1eaf3b-ff00-4d78-93df-52c97aba5499","Handler":null,"Name":"","Endpoint":""} Jun 13 03:44:25.020960 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:25.020936 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 13 03:44:25.021083 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:25.020979 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 13 03:44:25.148699 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:25.148674 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tttnq" Jun 13 03:44:26.153330 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:26.153261 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" event={"ID":"8355d9ca-b528-46c3-bff9-556b5b853066","Type":"ContainerStarted","Data":"40f9ce68f57f6c6db65d73c74d579ec1f31d798e000526ee4ff0eae4e1f16139"} Jun 13 03:44:26.156780 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:26.156758 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 03:44:26.157253 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:26.157230 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" event={"ID":"1d288ee1-9260-49b3-a28d-f87148a63eed","Type":"ContainerStarted","Data":"e232ca2750588512f317d51acf9fc58c3516a64fd218263d3c3568a0092e62a1"} Jun 13 03:44:26.170323 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:26.170288 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssdtt" podStartSLOduration=8.588342558 podStartE2EDuration="25.170272133s" totalImagesPullingTime="16.581929575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:26.169135409 +0000 UTC m=+25.642629162" watchObservedRunningTime="2026-06-13 03:44:26.170272133 +0000 UTC m=+25.643765887" Jun 13 03:44:27.010611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:27.010576 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:27.010789 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:27.010702 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:27.010789 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:27.010718 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:27.010789 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:27.010737 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:27.010949 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:27.010845 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:27.010949 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:27.010924 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:28.166022 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:28.165797 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 03:44:28.167018 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:28.166398 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" event={"ID":"1d288ee1-9260-49b3-a28d-f87148a63eed","Type":"ContainerStarted","Data":"c92f1b73b2de3e0b73fd4f21fad7dbcbdcb02903ba9cf94922115f11e7cb2dd6"} Jun 13 03:44:28.167018 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:28.166687 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:28.167018 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:28.166775 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:28.167018 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:28.166959 2562 scope.go:117] "RemoveContainer" containerID="3e6b2a099cf552374597a77f4ea406db219da018c76f76acc592f918d8ae4fc0" Jun 13 03:44:28.182152 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:28.182132 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:29.010790 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:29.010762 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:29.010790 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:29.010775 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:29.011025 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:29.010762 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:29.011025 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:29.010865 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:29.011025 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:29.010931 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:29.011168 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:29.011036 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:29.172284 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:29.172261 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 03:44:29.172731 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:29.172642 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" event={"ID":"1d288ee1-9260-49b3-a28d-f87148a63eed","Type":"ContainerStarted","Data":"a59883fc501d6bb85ccd85e30fc8b88fcc1451f98fb93d44dc5e1bcf38a05e16"} Jun 13 03:44:29.172837 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:29.172818 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:29.174530 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:29.174507 2562 generic.go:356] "Generic (PLEG): container finished" podID="f039be5b-cbfe-4023-bb27-d76a5061dca5" containerID="bcbba01e50a6dcaa797292c62bcafb6057f30775f6c39b5d0ea00977706e651d" exitCode=0 Jun 13 03:44:29.174633 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:29.174547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ntktp" event={"ID":"f039be5b-cbfe-4023-bb27-d76a5061dca5","Type":"ContainerDied","Data":"bcbba01e50a6dcaa797292c62bcafb6057f30775f6c39b5d0ea00977706e651d"} Jun 13 03:44:29.188917 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:29.188899 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:44:29.201399 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:29.201346 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" podStartSLOduration=9.579470818 podStartE2EDuration="28.201334904s" totalImagesPullingTime="18.621864086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:29.200900657 +0000 UTC m=+28.674394410" watchObservedRunningTime="2026-06-13 03:44:29.201334904 +0000 UTC m=+28.674828656" Jun 13 03:44:30.258405 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:30.258377 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x8x7g"] Jun 13 03:44:30.258741 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:30.258480 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:30.258741 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:30.258555 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:30.261486 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:30.261461 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5gtcb"] Jun 13 03:44:30.261593 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:30.261567 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:30.261670 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:30.261652 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:30.272019 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:30.271996 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qkfvr"] Jun 13 03:44:30.272142 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:30.272093 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:30.272227 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:30.272208 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:31.180220 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:31.180189 2562 generic.go:356] "Generic (PLEG): container finished" podID="f039be5b-cbfe-4023-bb27-d76a5061dca5" containerID="a3fb8b912288ac02c2d681e68c8e55b5747ee18f26325a4ad779bd24810a5b7b" exitCode=0 Jun 13 03:44:31.180424 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:31.180255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ntktp" event={"ID":"f039be5b-cbfe-4023-bb27-d76a5061dca5","Type":"ContainerDied","Data":"a3fb8b912288ac02c2d681e68c8e55b5747ee18f26325a4ad779bd24810a5b7b"} Jun 13 03:44:32.010859 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:32.010830 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:32.010859 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:32.010851 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:32.011602 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:32.010840 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:32.011602 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:32.010951 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:32.011602 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:32.011065 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:32.011602 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:32.011151 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:32.184996 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:32.184972 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ntktp" event={"ID":"f039be5b-cbfe-4023-bb27-d76a5061dca5","Type":"ContainerStarted","Data":"16f62b26205c26913b584e3bcce1acb1228ba041b2b399bbb1ab6ebdef2d9e93"} Jun 13 03:44:33.189681 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:33.189648 2562 generic.go:356] "Generic (PLEG): container finished" podID="f039be5b-cbfe-4023-bb27-d76a5061dca5" containerID="16f62b26205c26913b584e3bcce1acb1228ba041b2b399bbb1ab6ebdef2d9e93" exitCode=0 Jun 13 03:44:33.190034 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:33.189702 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ntktp" event={"ID":"f039be5b-cbfe-4023-bb27-d76a5061dca5","Type":"ContainerDied","Data":"16f62b26205c26913b584e3bcce1acb1228ba041b2b399bbb1ab6ebdef2d9e93"} Jun 13 03:44:34.010935 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:34.010855 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:34.010935 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:34.010882 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:34.011116 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:34.010971 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkfvr" podUID="9f285c10-8c5a-4b17-a928-14070376cf58" Jun 13 03:44:34.011116 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:34.011029 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:34.011183 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:34.011117 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:44:34.011183 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:34.011175 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x8x7g" podUID="57ee5806-e368-4391-b4e7-cac42e9ed7e1" Jun 13 03:44:34.796275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:34.796240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djqf\" (UniqueName: \"kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf\") pod \"network-check-target-x8x7g\" (UID: \"57ee5806-e368-4391-b4e7-cac42e9ed7e1\") " pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:34.796735 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:34.796296 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:34.796735 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:34.796333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:34.796735 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:34.796389 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 03:44:34.796735 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:34.796412 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 03:44:34.796735 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:34.796424 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8djqf for pod openshift-network-diagnostics/network-check-target-x8x7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:34.796735 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:34.796447 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:34.796735 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:34.796456 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:34.796735 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:34.796486 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf podName:57ee5806-e368-4391-b4e7-cac42e9ed7e1 nodeName:}" failed. No retries permitted until 2026-06-13 03:45:06.796468345 +0000 UTC m=+66.269962079 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8djqf" (UniqueName: "kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf") pod "network-check-target-x8x7g" (UID: "57ee5806-e368-4391-b4e7-cac42e9ed7e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 03:44:34.796735 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:34.796510 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret podName:9f285c10-8c5a-4b17-a928-14070376cf58 nodeName:}" failed. No retries permitted until 2026-06-13 03:45:06.796492857 +0000 UTC m=+66.269986592 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret") pod "global-pull-secret-syncer-qkfvr" (UID: "9f285c10-8c5a-4b17-a928-14070376cf58") : object "kube-system"/"original-pull-secret" not registered Jun 13 03:44:34.796735 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:34.796529 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs podName:0b2f1c7f-0403-4a8d-b546-53e9a0cde19a nodeName:}" failed. No retries permitted until 2026-06-13 03:45:06.796520125 +0000 UTC m=+66.270013855 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs") pod "network-metrics-daemon-5gtcb" (UID: "0b2f1c7f-0403-4a8d-b546-53e9a0cde19a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 03:44:35.284167 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.284010 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-184.ec2.internal" event="NodeReady" Jun 13 03:44:35.284396 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.284245 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 13 03:44:35.316939 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.316746 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6689668959-dbhfg"] Jun 13 03:44:35.320678 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.320658 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.322998 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.322944 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 13 03:44:35.322998 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.322954 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 13 03:44:35.323162 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.323090 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wrg5q\"" Jun 13 03:44:35.323249 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.323234 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 13 03:44:35.330579 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.330558 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 13 03:44:35.339054 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.338582 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6689668959-dbhfg"] Jun 13 03:44:35.339696 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.339584 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6hg4s"] Jun 13 03:44:35.345440 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.345423 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5sz5d"] Jun 13 03:44:35.345580 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.345551 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:35.348798 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.348394 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 13 03:44:35.348798 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.348526 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-stzhf\"" Jun 13 03:44:35.348798 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.348398 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 13 03:44:35.355161 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.355045 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5sz5d"] Jun 13 03:44:35.355260 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.355167 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5sz5d" Jun 13 03:44:35.357356 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.357297 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6hg4s"] Jun 13 03:44:35.357649 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.357623 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9h2wn\"" Jun 13 03:44:35.357740 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.357704 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 13 03:44:35.357928 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.357911 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 13 03:44:35.358015 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.357964 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 13 03:44:35.401775 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.401747 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.401891 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.401787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp6p2\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-kube-api-access-sp6p2\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.401891 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.401858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b252320-ad5b-4490-bcd3-dc01e9179b81-trusted-ca\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.402022 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.401888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b252320-ad5b-4490-bcd3-dc01e9179b81-image-registry-private-configuration\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.402022 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.401917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-bound-sa-token\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.402022 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.401964 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b252320-ad5b-4490-bcd3-dc01e9179b81-ca-trust-extracted\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.402022 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.402000 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-certificates\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.402241 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.402047 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b252320-ad5b-4490-bcd3-dc01e9179b81-installation-pull-secrets\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.488043 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.487992 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tttnq_6d920e6a-30a7-42f0-b28e-7047b0d9f779/konnectivity-agent/0.log" limit=1024 Jun 13 03:44:35.503283 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.503255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.503439 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.503293 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp6p2\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-kube-api-access-sp6p2\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.503439 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.503345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:35.503439 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.503410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25d12dad-debe-46e1-9e8a-5bc09754f000-config-volume\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:35.503439 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.503437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b252320-ad5b-4490-bcd3-dc01e9179b81-trusted-ca\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.503662 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:35.503437 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:44:35.503662 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:35.503481 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689668959-dbhfg: secret "image-registry-tls" not found Jun 13 03:44:35.503662 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.503457 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/071690c8-fde4-4021-9197-658b91d47206-cert\") pod \"ingress-canary-5sz5d\" (UID: \"071690c8-fde4-4021-9197-658b91d47206\") " pod="openshift-ingress-canary/ingress-canary-5sz5d" Jun 13 03:44:35.503662 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:35.503542 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls podName:9b252320-ad5b-4490-bcd3-dc01e9179b81 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:36.003522634 +0000 UTC m=+35.477016387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls") pod "image-registry-6689668959-dbhfg" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81") : secret "image-registry-tls" not found Jun 13 03:44:35.503864 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.503668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b252320-ad5b-4490-bcd3-dc01e9179b81-image-registry-private-configuration\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.503864 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.503695 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-bound-sa-token\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.503864 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.503724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b252320-ad5b-4490-bcd3-dc01e9179b81-ca-trust-extracted\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.503864 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.503748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-certificates\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.504040 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.503971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b252320-ad5b-4490-bcd3-dc01e9179b81-installation-pull-secrets\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.504083 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.504034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsmh2\" (UniqueName: \"kubernetes.io/projected/071690c8-fde4-4021-9197-658b91d47206-kube-api-access-jsmh2\") pod \"ingress-canary-5sz5d\" (UID: \"071690c8-fde4-4021-9197-658b91d47206\") " pod="openshift-ingress-canary/ingress-canary-5sz5d" Jun 13 03:44:35.504083 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.504066 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfzhr\" (UniqueName: \"kubernetes.io/projected/25d12dad-debe-46e1-9e8a-5bc09754f000-kube-api-access-cfzhr\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:35.504157 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.504096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25d12dad-debe-46e1-9e8a-5bc09754f000-tmp-dir\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:35.504228 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.504209 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-certificates\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.504469 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.504439 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b252320-ad5b-4490-bcd3-dc01e9179b81-trusted-ca\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.504568 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.504496 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b252320-ad5b-4490-bcd3-dc01e9179b81-ca-trust-extracted\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.508444 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.508424 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b252320-ad5b-4490-bcd3-dc01e9179b81-installation-pull-secrets\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.508538 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.508429 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b252320-ad5b-4490-bcd3-dc01e9179b81-image-registry-private-configuration\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.512228 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.512205 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-bound-sa-token\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.512490 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.512472 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp6p2\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-kube-api-access-sp6p2\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:35.564112 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.564084 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tttnq_6d920e6a-30a7-42f0-b28e-7047b0d9f779/konnectivity-agent/0.log" limit=1024 Jun 13 03:44:35.605039 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.605017 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:35.605123 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.605052 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25d12dad-debe-46e1-9e8a-5bc09754f000-config-volume\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:35.605123 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.605070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/071690c8-fde4-4021-9197-658b91d47206-cert\") pod \"ingress-canary-5sz5d\" (UID: \"071690c8-fde4-4021-9197-658b91d47206\") " pod="openshift-ingress-canary/ingress-canary-5sz5d" Jun 13 03:44:35.605214 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:35.605158 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:44:35.605214 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:35.605209 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls podName:25d12dad-debe-46e1-9e8a-5bc09754f000 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:36.105194135 +0000 UTC m=+35.578687865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls") pod "dns-default-6hg4s" (UID: "25d12dad-debe-46e1-9e8a-5bc09754f000") : secret "dns-default-metrics-tls" not found Jun 13 03:44:35.605311 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.605291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmh2\" (UniqueName: \"kubernetes.io/projected/071690c8-fde4-4021-9197-658b91d47206-kube-api-access-jsmh2\") pod \"ingress-canary-5sz5d\" (UID: \"071690c8-fde4-4021-9197-658b91d47206\") " pod="openshift-ingress-canary/ingress-canary-5sz5d" Jun 13 03:44:35.605383 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.605332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfzhr\" (UniqueName: \"kubernetes.io/projected/25d12dad-debe-46e1-9e8a-5bc09754f000-kube-api-access-cfzhr\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:35.605500 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.605482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25d12dad-debe-46e1-9e8a-5bc09754f000-tmp-dir\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:35.605668 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.605650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/25d12dad-debe-46e1-9e8a-5bc09754f000-config-volume\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:35.605730 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.605710 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25d12dad-debe-46e1-9e8a-5bc09754f000-tmp-dir\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:35.607154 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.607136 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/071690c8-fde4-4021-9197-658b91d47206-cert\") pod \"ingress-canary-5sz5d\" (UID: \"071690c8-fde4-4021-9197-658b91d47206\") " pod="openshift-ingress-canary/ingress-canary-5sz5d" Jun 13 03:44:35.613483 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.613462 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfzhr\" (UniqueName: \"kubernetes.io/projected/25d12dad-debe-46e1-9e8a-5bc09754f000-kube-api-access-cfzhr\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:35.613831 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.613812 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsmh2\" (UniqueName: \"kubernetes.io/projected/071690c8-fde4-4021-9197-658b91d47206-kube-api-access-jsmh2\") pod \"ingress-canary-5sz5d\" (UID: \"071690c8-fde4-4021-9197-658b91d47206\") " pod="openshift-ingress-canary/ingress-canary-5sz5d" Jun 13 03:44:35.666042 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.666012 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5sz5d" Jun 13 03:44:35.855849 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:35.855773 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5sz5d"] Jun 13 03:44:35.860413 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:44:35.860392 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071690c8_fde4_4021_9197_658b91d47206.slice/crio-c8c2af82bd62f06503cca245e8615233fa4be57ee04ec6e1a89772211d49abcc WatchSource:0}: Error finding container c8c2af82bd62f06503cca245e8615233fa4be57ee04ec6e1a89772211d49abcc: Status 404 returned error can't find the container with id c8c2af82bd62f06503cca245e8615233fa4be57ee04ec6e1a89772211d49abcc Jun 13 03:44:36.009819 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:36.009781 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:36.009977 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:36.009907 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:44:36.009977 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:36.009928 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689668959-dbhfg: secret "image-registry-tls" not found Jun 13 03:44:36.010081 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:36.009996 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls podName:9b252320-ad5b-4490-bcd3-dc01e9179b81 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:37.009976025 +0000 UTC m=+36.483469771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls") pod "image-registry-6689668959-dbhfg" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81") : secret "image-registry-tls" not found Jun 13 03:44:36.010159 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:36.010138 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:44:36.010208 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:36.010158 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:44:36.010374 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:36.010335 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:44:36.012887 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:36.012867 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 03:44:36.012993 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:36.012941 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 03:44:36.012993 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:36.012958 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 03:44:36.013100 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:36.013015 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7pdj\"" Jun 13 03:44:36.013671 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:36.013645 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tqfh\"" Jun 13 03:44:36.013756 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:36.013649 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 03:44:36.111192 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:36.111135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:36.111303 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:36.111284 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:44:36.111356 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:36.111343 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls podName:25d12dad-debe-46e1-9e8a-5bc09754f000 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:37.111325946 +0000 UTC m=+36.584819686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls") pod "dns-default-6hg4s" (UID: "25d12dad-debe-46e1-9e8a-5bc09754f000") : secret "dns-default-metrics-tls" not found Jun 13 03:44:36.196415 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:36.196391 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5sz5d" event={"ID":"071690c8-fde4-4021-9197-658b91d47206","Type":"ContainerStarted","Data":"c8c2af82bd62f06503cca245e8615233fa4be57ee04ec6e1a89772211d49abcc"} Jun 13 03:44:37.019592 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:37.019553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:37.020077 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:37.019746 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:44:37.020077 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:37.019763 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689668959-dbhfg: secret "image-registry-tls" not found Jun 13 03:44:37.020077 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:37.019835 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls podName:9b252320-ad5b-4490-bcd3-dc01e9179b81 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:39.019816116 +0000 UTC m=+38.493309851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls") pod "image-registry-6689668959-dbhfg" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81") : secret "image-registry-tls" not found Jun 13 03:44:37.120197 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:37.120164 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:37.120401 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:37.120292 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:44:37.120401 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:37.120380 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls podName:25d12dad-debe-46e1-9e8a-5bc09754f000 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:39.120346636 +0000 UTC m=+38.593840369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls") pod "dns-default-6hg4s" (UID: "25d12dad-debe-46e1-9e8a-5bc09754f000") : secret "dns-default-metrics-tls" not found Jun 13 03:44:39.036617 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:39.036446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:39.036617 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:39.036581 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:44:39.037197 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:39.036633 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689668959-dbhfg: secret "image-registry-tls" not found Jun 13 03:44:39.037197 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:39.036678 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls podName:9b252320-ad5b-4490-bcd3-dc01e9179b81 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:43.036664176 +0000 UTC m=+42.510157921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls") pod "image-registry-6689668959-dbhfg" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81") : secret "image-registry-tls" not found Jun 13 03:44:39.137183 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:39.137153 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:39.137284 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:39.137253 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:44:39.137324 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:39.137302 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls podName:25d12dad-debe-46e1-9e8a-5bc09754f000 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:43.1372883 +0000 UTC m=+42.610782030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls") pod "dns-default-6hg4s" (UID: "25d12dad-debe-46e1-9e8a-5bc09754f000") : secret "dns-default-metrics-tls" not found Jun 13 03:44:39.204803 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:39.204769 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5sz5d" event={"ID":"071690c8-fde4-4021-9197-658b91d47206","Type":"ContainerStarted","Data":"610f80142840952c3ad05240a54eef92b65c087021336d36e0a1b47dd5a0ad08"} Jun 13 03:44:39.207451 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:39.207426 2562 generic.go:356] "Generic (PLEG): container finished" podID="f039be5b-cbfe-4023-bb27-d76a5061dca5" containerID="f920193e19634bf2f0e5f823ab5a524c9c8ad5865843f9fb69e605511e075879" exitCode=0 Jun 13 03:44:39.207563 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:39.207466 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ntktp" event={"ID":"f039be5b-cbfe-4023-bb27-d76a5061dca5","Type":"ContainerDied","Data":"f920193e19634bf2f0e5f823ab5a524c9c8ad5865843f9fb69e605511e075879"} Jun 13 03:44:39.220058 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:39.220017 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5sz5d" podStartSLOduration=1.511758503 podStartE2EDuration="4.220004014s" totalImagesPullingTime="2.708245511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:39.218902299 +0000 UTC m=+38.692396052" watchObservedRunningTime="2026-06-13 03:44:39.220004014 +0000 UTC m=+38.693497767" Jun 13 03:44:40.212879 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:40.212839 2562 generic.go:356] "Generic (PLEG): container finished" podID="f039be5b-cbfe-4023-bb27-d76a5061dca5" containerID="2d876445dcfeb7f06a7d0b289ab39ab97fa72260f1574fad510db9e058998517" exitCode=0 Jun 13 03:44:40.213292 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:40.212921 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ntktp" event={"ID":"f039be5b-cbfe-4023-bb27-d76a5061dca5","Type":"ContainerDied","Data":"2d876445dcfeb7f06a7d0b289ab39ab97fa72260f1574fad510db9e058998517"} Jun 13 03:44:41.217890 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:41.217850 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ntktp" event={"ID":"f039be5b-cbfe-4023-bb27-d76a5061dca5","Type":"ContainerStarted","Data":"c9e1ce832c5179e6a9bd2d61829f5d58ca961c97c18dec2b566641694fffd1b2"} Jun 13 03:44:41.239216 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:41.239170 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ntktp" podStartSLOduration=9.464085645 podStartE2EDuration="40.239155896s" totalImagesPullingTime="30.775070251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:44:41.237318531 +0000 UTC m=+40.710812285" watchObservedRunningTime="2026-06-13 03:44:41.239155896 +0000 UTC m=+40.712649650" Jun 13 03:44:43.063350 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:43.063320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:43.063718 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:43.063433 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:44:43.063718 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:43.063444 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689668959-dbhfg: secret "image-registry-tls" not found Jun 13 03:44:43.063718 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:43.063490 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls podName:9b252320-ad5b-4490-bcd3-dc01e9179b81 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:51.06347841 +0000 UTC m=+50.536972141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls") pod "image-registry-6689668959-dbhfg" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81") : secret "image-registry-tls" not found Jun 13 03:44:43.164549 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:43.164507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:43.164681 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:43.164657 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:44:43.164725 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:43.164715 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls podName:25d12dad-debe-46e1-9e8a-5bc09754f000 nodeName:}" failed. No retries permitted until 2026-06-13 03:44:51.164701515 +0000 UTC m=+50.638195245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls") pod "dns-default-6hg4s" (UID: "25d12dad-debe-46e1-9e8a-5bc09754f000") : secret "dns-default-metrics-tls" not found Jun 13 03:44:51.125096 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:51.125068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:44:51.125595 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:51.125173 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:44:51.125595 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:51.125184 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689668959-dbhfg: secret "image-registry-tls" not found Jun 13 03:44:51.125595 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:51.125233 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls podName:9b252320-ad5b-4490-bcd3-dc01e9179b81 nodeName:}" failed. No retries permitted until 2026-06-13 03:45:07.125220942 +0000 UTC m=+66.598714673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls") pod "image-registry-6689668959-dbhfg" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81") : secret "image-registry-tls" not found Jun 13 03:44:51.225854 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:44:51.225831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:44:51.225984 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:51.225964 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:44:51.226028 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:44:51.226018 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls podName:25d12dad-debe-46e1-9e8a-5bc09754f000 nodeName:}" failed. No retries permitted until 2026-06-13 03:45:07.226006563 +0000 UTC m=+66.699500297 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls") pod "dns-default-6hg4s" (UID: "25d12dad-debe-46e1-9e8a-5bc09754f000") : secret "dns-default-metrics-tls" not found Jun 13 03:45:01.189895 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:01.189867 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5r49" Jun 13 03:45:06.833934 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:06.833882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:45:06.834320 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:06.833951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djqf\" (UniqueName: \"kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf\") pod \"network-check-target-x8x7g\" (UID: \"57ee5806-e368-4391-b4e7-cac42e9ed7e1\") " pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:45:06.834320 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:06.834065 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:45:06.836756 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:06.836737 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 03:45:06.836870 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:06.836761 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 03:45:06.836870 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:06.836799 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 03:45:06.844888 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:45:06.844869 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 03:45:06.844970 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:45:06.844930 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs podName:0b2f1c7f-0403-4a8d-b546-53e9a0cde19a nodeName:}" failed. No retries permitted until 2026-06-13 03:46:10.844911223 +0000 UTC m=+130.318404968 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs") pod "network-metrics-daemon-5gtcb" (UID: "0b2f1c7f-0403-4a8d-b546-53e9a0cde19a") : secret "metrics-daemon-secret" not found Jun 13 03:45:06.846966 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:06.846949 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 03:45:06.848140 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:06.848118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f285c10-8c5a-4b17-a928-14070376cf58-original-pull-secret\") pod \"global-pull-secret-syncer-qkfvr\" (UID: \"9f285c10-8c5a-4b17-a928-14070376cf58\") " pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:45:06.857749 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:06.857728 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8djqf\" (UniqueName: \"kubernetes.io/projected/57ee5806-e368-4391-b4e7-cac42e9ed7e1-kube-api-access-8djqf\") pod \"network-check-target-x8x7g\" (UID: \"57ee5806-e368-4391-b4e7-cac42e9ed7e1\") " pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:45:06.924676 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:06.924653 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tqfh\"" Jun 13 03:45:06.932753 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:06.932727 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:45:06.935198 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:06.935184 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkfvr" Jun 13 03:45:07.071304 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:07.071259 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x8x7g"] Jun 13 03:45:07.073957 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:45:07.073933 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ee5806_e368_4391_b4e7_cac42e9ed7e1.slice/crio-96bf891967bcf03528849f99d7b48c53d194f685cbbb6fc7beeae87393c060c8 WatchSource:0}: Error finding container 96bf891967bcf03528849f99d7b48c53d194f685cbbb6fc7beeae87393c060c8: Status 404 returned error can't find the container with id 96bf891967bcf03528849f99d7b48c53d194f685cbbb6fc7beeae87393c060c8 Jun 13 03:45:07.082058 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:07.082032 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qkfvr"] Jun 13 03:45:07.084210 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:45:07.084158 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f285c10_8c5a_4b17_a928_14070376cf58.slice/crio-ee707f5eddd7801693d5b6727af08b92bb97418bd41a9d1a55c023322de5b66d WatchSource:0}: Error finding container ee707f5eddd7801693d5b6727af08b92bb97418bd41a9d1a55c023322de5b66d: Status 404 returned error can't find the container with id ee707f5eddd7801693d5b6727af08b92bb97418bd41a9d1a55c023322de5b66d Jun 13 03:45:07.136457 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:07.136433 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:45:07.136564 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:45:07.136552 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:45:07.136604 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:45:07.136566 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689668959-dbhfg: secret "image-registry-tls" not found Jun 13 03:45:07.136604 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:45:07.136603 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls podName:9b252320-ad5b-4490-bcd3-dc01e9179b81 nodeName:}" failed. No retries permitted until 2026-06-13 03:45:39.136591888 +0000 UTC m=+98.610085618 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls") pod "image-registry-6689668959-dbhfg" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81") : secret "image-registry-tls" not found Jun 13 03:45:07.237402 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:07.237354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:45:07.237508 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:45:07.237492 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:45:07.237555 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:45:07.237546 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls podName:25d12dad-debe-46e1-9e8a-5bc09754f000 nodeName:}" failed. No retries permitted until 2026-06-13 03:45:39.237533036 +0000 UTC m=+98.711026768 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls") pod "dns-default-6hg4s" (UID: "25d12dad-debe-46e1-9e8a-5bc09754f000") : secret "dns-default-metrics-tls" not found Jun 13 03:45:07.276177 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:07.276151 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qkfvr" event={"ID":"9f285c10-8c5a-4b17-a928-14070376cf58","Type":"ContainerStarted","Data":"ee707f5eddd7801693d5b6727af08b92bb97418bd41a9d1a55c023322de5b66d"} Jun 13 03:45:07.277240 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:07.277220 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x8x7g" event={"ID":"57ee5806-e368-4391-b4e7-cac42e9ed7e1","Type":"ContainerStarted","Data":"96bf891967bcf03528849f99d7b48c53d194f685cbbb6fc7beeae87393c060c8"} Jun 13 03:45:12.292775 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:12.292679 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qkfvr" event={"ID":"9f285c10-8c5a-4b17-a928-14070376cf58","Type":"ContainerStarted","Data":"560b78b248de9d3f89b0210130b59c8f43a7901fef1c253695d7ea77f3ece112"} Jun 13 03:45:12.294124 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:12.294098 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x8x7g" event={"ID":"57ee5806-e368-4391-b4e7-cac42e9ed7e1","Type":"ContainerStarted","Data":"21e867b104d8879917a018975b4a2c4cc7fbc55d804c3c6888f356b23f224e30"} Jun 13 03:45:12.294239 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:12.294162 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:45:12.306561 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:12.306520 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qkfvr" podStartSLOduration=66.411688983 podStartE2EDuration="1m11.306510039s" totalImagesPullingTime="4.894821056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:45:12.306204288 +0000 UTC m=+71.779698040" watchObservedRunningTime="2026-06-13 03:45:12.306510039 +0000 UTC m=+71.780003792" Jun 13 03:45:12.322602 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:12.322562 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x8x7g" podStartSLOduration=66.421001318 podStartE2EDuration="1m11.322548762s" totalImagesPullingTime="4.901547444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:45:12.322204473 +0000 UTC m=+71.795698227" watchObservedRunningTime="2026-06-13 03:45:12.322548762 +0000 UTC m=+71.796042514" Jun 13 03:45:39.156979 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:39.156874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:45:39.156979 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:45:39.156970 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:45:39.156979 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:45:39.156981 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689668959-dbhfg: secret "image-registry-tls" not found Jun 13 03:45:39.157489 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:45:39.157027 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls podName:9b252320-ad5b-4490-bcd3-dc01e9179b81 nodeName:}" failed. No retries permitted until 2026-06-13 03:46:43.157014233 +0000 UTC m=+162.630507964 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls") pod "image-registry-6689668959-dbhfg" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81") : secret "image-registry-tls" not found Jun 13 03:45:39.257135 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:39.257106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:45:39.257264 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:45:39.257202 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:45:39.257264 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:45:39.257248 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls podName:25d12dad-debe-46e1-9e8a-5bc09754f000 nodeName:}" failed. No retries permitted until 2026-06-13 03:46:43.257236219 +0000 UTC m=+162.730729949 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls") pod "dns-default-6hg4s" (UID: "25d12dad-debe-46e1-9e8a-5bc09754f000") : secret "dns-default-metrics-tls" not found Jun 13 03:45:43.299756 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:45:43.299721 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x8x7g" Jun 13 03:46:10.861587 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:46:10.861535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:46:10.862077 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:46:10.861675 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 03:46:10.862077 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:46:10.861728 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs podName:0b2f1c7f-0403-4a8d-b546-53e9a0cde19a nodeName:}" failed. No retries permitted until 2026-06-13 03:48:12.861715009 +0000 UTC m=+252.335208739 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs") pod "network-metrics-daemon-5gtcb" (UID: "0b2f1c7f-0403-4a8d-b546-53e9a0cde19a") : secret "metrics-daemon-secret" not found Jun 13 03:46:38.333212 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:46:38.333170 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6689668959-dbhfg" podUID="9b252320-ad5b-4490-bcd3-dc01e9179b81" Jun 13 03:46:38.356474 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:46:38.356451 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6hg4s" podUID="25d12dad-debe-46e1-9e8a-5bc09754f000" Jun 13 03:46:38.492141 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:46:38.492120 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:46:38.492257 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:46:38.492126 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hg4s" Jun 13 03:46:39.029081 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:46:39.029038 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5gtcb" podUID="0b2f1c7f-0403-4a8d-b546-53e9a0cde19a" Jun 13 03:46:43.172619 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:46:43.172579 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:46:43.173070 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:46:43.172709 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 03:46:43.173070 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:46:43.172720 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689668959-dbhfg: secret "image-registry-tls" not found Jun 13 03:46:43.173070 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:46:43.172779 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls podName:9b252320-ad5b-4490-bcd3-dc01e9179b81 nodeName:}" failed. No retries permitted until 2026-06-13 03:48:45.172764073 +0000 UTC m=+284.646257803 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls") pod "image-registry-6689668959-dbhfg" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81") : secret "image-registry-tls" not found Jun 13 03:46:43.273731 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:46:43.273690 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:46:43.273871 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:46:43.273810 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 03:46:43.273871 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:46:43.273856 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls podName:25d12dad-debe-46e1-9e8a-5bc09754f000 nodeName:}" failed. No retries permitted until 2026-06-13 03:48:45.273844372 +0000 UTC m=+284.747338103 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls") pod "dns-default-6hg4s" (UID: "25d12dad-debe-46e1-9e8a-5bc09754f000") : secret "dns-default-metrics-tls" not found Jun 13 03:46:53.010909 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:46:53.010874 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:47:25.636222 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.636190 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4"] Jun 13 03:47:25.637711 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.637695 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh"] Jun 13 03:47:25.637830 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.637813 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" Jun 13 03:47:25.639252 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.639227 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" Jun 13 03:47:25.639909 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.639887 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb"] Jun 13 03:47:25.640287 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.640263 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 13 03:47:25.640434 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.640415 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 13 03:47:25.640505 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.640438 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2cjhn\"" Jun 13 03:47:25.640505 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.640478 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 13 03:47:25.640608 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.640439 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 13 03:47:25.641415 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.641392 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 13 03:47:25.641652 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.641630 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-ptfx4"] Jun 13 03:47:25.641652 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.641641 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 13 03:47:25.641806 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.641684 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 13 03:47:25.641806 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.641763 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7ncfn\"" Jun 13 03:47:25.641913 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.641873 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" Jun 13 03:47:25.641966 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.641950 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 13 03:47:25.643113 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.643094 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r"] Jun 13 03:47:25.643222 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.643185 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.646183 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.645719 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 13 03:47:25.647626 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.646594 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 03:47:25.647626 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.646772 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 13 03:47:25.647626 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.646869 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 03:47:25.647626 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.647460 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:25.648171 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.647671 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 13 03:47:25.648294 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.648269 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bxb4l\"" Jun 13 03:47:25.648782 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.648758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pcnw\" (UniqueName: \"kubernetes.io/projected/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-kube-api-access-9pcnw\") pod \"cluster-samples-operator-9547488fd-vxlwb\" (UID: \"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" Jun 13 03:47:25.648856 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.648795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94f26210-0f47-4364-9179-63392b1623f4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-9t5v4\" (UID: \"94f26210-0f47-4364-9179-63392b1623f4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" Jun 13 03:47:25.649318 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.649299 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xzbx5\"" Jun 13 03:47:25.649440 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.649424 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 13 03:47:25.649592 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.649550 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 13 03:47:25.649592 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.649574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64784d09-dfc8-4eb6-9c95-467ba97ef359-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5p4vh\" (UID: \"64784d09-dfc8-4eb6-9c95-467ba97ef359\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" Jun 13 03:47:25.649728 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.649614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs5df\" (UniqueName: \"kubernetes.io/projected/382e45c6-a956-438f-b519-9e378ff06578-kube-api-access-zs5df\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.649728 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.649644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94f26210-0f47-4364-9179-63392b1623f4-config\") pod \"service-ca-operator-7ccbfd59dc-9t5v4\" (UID: \"94f26210-0f47-4364-9179-63392b1623f4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" Jun 13 03:47:25.649728 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.649673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/382e45c6-a956-438f-b519-9e378ff06578-snapshots\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.649728 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.649700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/382e45c6-a956-438f-b519-9e378ff06578-serving-cert\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.649728 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.649725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64784d09-dfc8-4eb6-9c95-467ba97ef359-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5p4vh\" (UID: \"64784d09-dfc8-4eb6-9c95-467ba97ef359\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" Jun 13 03:47:25.649968 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.649758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vxlwb\" (UID: \"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" Jun 13 03:47:25.649968 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.649915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpk5p\" (UniqueName: \"kubernetes.io/projected/64784d09-dfc8-4eb6-9c95-467ba97ef359-kube-api-access-mpk5p\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5p4vh\" (UID: \"64784d09-dfc8-4eb6-9c95-467ba97ef359\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" Jun 13 03:47:25.650071 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.650033 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382e45c6-a956-438f-b519-9e378ff06578-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.650119 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.650067 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/382e45c6-a956-438f-b519-9e378ff06578-tmp\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.650170 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.650121 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6zvs\" (UniqueName: \"kubernetes.io/projected/94f26210-0f47-4364-9179-63392b1623f4-kube-api-access-g6zvs\") pod \"service-ca-operator-7ccbfd59dc-9t5v4\" (UID: \"94f26210-0f47-4364-9179-63392b1623f4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" Jun 13 03:47:25.650218 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.650165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382e45c6-a956-438f-b519-9e378ff06578-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.652052 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.652028 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 13 03:47:25.652205 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.652182 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 13 03:47:25.652303 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.652255 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lv85t\"" Jun 13 03:47:25.652427 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.652403 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 13 03:47:25.652714 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.652523 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh"] Jun 13 03:47:25.652971 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.652953 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4"] Jun 13 03:47:25.653261 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.653243 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 13 03:47:25.655206 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.655146 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb"] Jun 13 03:47:25.655310 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.655292 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 13 03:47:25.655975 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.655954 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-ptfx4"] Jun 13 03:47:25.666412 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.666393 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r"] Jun 13 03:47:25.750831 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.750811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/382e45c6-a956-438f-b519-9e378ff06578-snapshots\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.750949 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.750837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/382e45c6-a956-438f-b519-9e378ff06578-serving-cert\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.750949 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.750863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64784d09-dfc8-4eb6-9c95-467ba97ef359-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5p4vh\" (UID: \"64784d09-dfc8-4eb6-9c95-467ba97ef359\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" Jun 13 03:47:25.750949 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.750882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vxlwb\" (UID: \"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" Jun 13 03:47:25.750949 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.750931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpk5p\" (UniqueName: \"kubernetes.io/projected/64784d09-dfc8-4eb6-9c95-467ba97ef359-kube-api-access-mpk5p\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5p4vh\" (UID: \"64784d09-dfc8-4eb6-9c95-467ba97ef359\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" Jun 13 03:47:25.751126 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:25.750967 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 03:47:25.751126 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.750967 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9252b71e-443e-4ff4-a6ea-6b46dbb948af-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:25.751126 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:25.751126 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:25.751031 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls podName:7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd nodeName:}" failed. No retries permitted until 2026-06-13 03:47:26.251014594 +0000 UTC m=+205.724508328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vxlwb" (UID: "7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd") : secret "samples-operator-tls" not found Jun 13 03:47:25.751126 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382e45c6-a956-438f-b519-9e378ff06578-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.751126 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/382e45c6-a956-438f-b519-9e378ff06578-tmp\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.751126 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6zvs\" (UniqueName: \"kubernetes.io/projected/94f26210-0f47-4364-9179-63392b1623f4-kube-api-access-g6zvs\") pod \"service-ca-operator-7ccbfd59dc-9t5v4\" (UID: \"94f26210-0f47-4364-9179-63392b1623f4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" Jun 13 03:47:25.751471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrq2b\" (UniqueName: \"kubernetes.io/projected/9252b71e-443e-4ff4-a6ea-6b46dbb948af-kube-api-access-hrq2b\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:25.751471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382e45c6-a956-438f-b519-9e378ff06578-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.751471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pcnw\" (UniqueName: \"kubernetes.io/projected/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-kube-api-access-9pcnw\") pod \"cluster-samples-operator-9547488fd-vxlwb\" (UID: \"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" Jun 13 03:47:25.751471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94f26210-0f47-4364-9179-63392b1623f4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-9t5v4\" (UID: \"94f26210-0f47-4364-9179-63392b1623f4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" Jun 13 03:47:25.751471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751461 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64784d09-dfc8-4eb6-9c95-467ba97ef359-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5p4vh\" (UID: \"64784d09-dfc8-4eb6-9c95-467ba97ef359\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" Jun 13 03:47:25.751857 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751516 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/382e45c6-a956-438f-b519-9e378ff06578-snapshots\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.751857 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64784d09-dfc8-4eb6-9c95-467ba97ef359-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5p4vh\" (UID: \"64784d09-dfc8-4eb6-9c95-467ba97ef359\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" Jun 13 03:47:25.751857 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs5df\" (UniqueName: \"kubernetes.io/projected/382e45c6-a956-438f-b519-9e378ff06578-kube-api-access-zs5df\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.751857 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94f26210-0f47-4364-9179-63392b1623f4-config\") pod \"service-ca-operator-7ccbfd59dc-9t5v4\" (UID: \"94f26210-0f47-4364-9179-63392b1623f4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" Jun 13 03:47:25.751857 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382e45c6-a956-438f-b519-9e378ff06578-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.752105 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.751925 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/382e45c6-a956-438f-b519-9e378ff06578-tmp\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.752298 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.752267 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94f26210-0f47-4364-9179-63392b1623f4-config\") pod \"service-ca-operator-7ccbfd59dc-9t5v4\" (UID: \"94f26210-0f47-4364-9179-63392b1623f4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" Jun 13 03:47:25.753131 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.753100 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382e45c6-a956-438f-b519-9e378ff06578-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.753880 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.753857 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/382e45c6-a956-438f-b519-9e378ff06578-serving-cert\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.753985 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.753956 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94f26210-0f47-4364-9179-63392b1623f4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-9t5v4\" (UID: \"94f26210-0f47-4364-9179-63392b1623f4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" Jun 13 03:47:25.754242 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.754222 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64784d09-dfc8-4eb6-9c95-467ba97ef359-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5p4vh\" (UID: \"64784d09-dfc8-4eb6-9c95-467ba97ef359\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" Jun 13 03:47:25.764998 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.764972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpk5p\" (UniqueName: \"kubernetes.io/projected/64784d09-dfc8-4eb6-9c95-467ba97ef359-kube-api-access-mpk5p\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5p4vh\" (UID: \"64784d09-dfc8-4eb6-9c95-467ba97ef359\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" Jun 13 03:47:25.769506 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.769487 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6zvs\" (UniqueName: \"kubernetes.io/projected/94f26210-0f47-4364-9179-63392b1623f4-kube-api-access-g6zvs\") pod \"service-ca-operator-7ccbfd59dc-9t5v4\" (UID: \"94f26210-0f47-4364-9179-63392b1623f4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" Jun 13 03:47:25.773116 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.773092 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs5df\" (UniqueName: \"kubernetes.io/projected/382e45c6-a956-438f-b519-9e378ff06578-kube-api-access-zs5df\") pod \"insights-operator-5bbd86d6bd-ptfx4\" (UID: \"382e45c6-a956-438f-b519-9e378ff06578\") " pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:25.773281 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.773260 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pcnw\" (UniqueName: \"kubernetes.io/projected/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-kube-api-access-9pcnw\") pod \"cluster-samples-operator-9547488fd-vxlwb\" (UID: \"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" Jun 13 03:47:25.834090 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.834068 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c4d6ff5b6-pptlr"] Jun 13 03:47:25.836595 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.836571 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.838888 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.838859 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 13 03:47:25.838888 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.838874 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7rxnw\"" Jun 13 03:47:25.839086 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.838862 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 13 03:47:25.839086 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.838920 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 13 03:47:25.839086 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.838863 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 13 03:47:25.839086 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.838993 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 13 03:47:25.839283 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.839268 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 13 03:47:25.846749 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.846729 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c4d6ff5b6-pptlr"] Jun 13 03:47:25.852247 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.852229 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-default-certificate\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.852336 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.852255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvw2x\" (UniqueName: \"kubernetes.io/projected/59846397-d812-442b-a8f6-40f0f5d01cf5-kube-api-access-xvw2x\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.852336 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.852278 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9252b71e-443e-4ff4-a6ea-6b46dbb948af-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:25.852336 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.852297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:25.852480 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.852374 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.852480 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:25.852402 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 03:47:25.852480 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.852424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrq2b\" (UniqueName: \"kubernetes.io/projected/9252b71e-443e-4ff4-a6ea-6b46dbb948af-kube-api-access-hrq2b\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:25.852480 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:25.852457 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls podName:9252b71e-443e-4ff4-a6ea-6b46dbb948af nodeName:}" failed. No retries permitted until 2026-06-13 03:47:26.352440735 +0000 UTC m=+205.825934469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-q7t5r" (UID: "9252b71e-443e-4ff4-a6ea-6b46dbb948af") : secret "cluster-monitoring-operator-tls" not found Jun 13 03:47:25.852707 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.852518 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-stats-auth\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.852707 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.852570 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.852904 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.852887 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9252b71e-443e-4ff4-a6ea-6b46dbb948af-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:25.860773 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.860753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrq2b\" (UniqueName: \"kubernetes.io/projected/9252b71e-443e-4ff4-a6ea-6b46dbb948af-kube-api-access-hrq2b\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:25.953084 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.953024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-default-certificate\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.953084 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.953051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvw2x\" (UniqueName: \"kubernetes.io/projected/59846397-d812-442b-a8f6-40f0f5d01cf5-kube-api-access-xvw2x\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.953084 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.953078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.953239 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.953209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-stats-auth\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.953282 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.953258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.953353 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:25.953339 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle podName:59846397-d812-442b-a8f6-40f0f5d01cf5 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:26.453322469 +0000 UTC m=+205.926816241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle") pod "router-default-c4d6ff5b6-pptlr" (UID: "59846397-d812-442b-a8f6-40f0f5d01cf5") : configmap references non-existent config key: service-ca.crt Jun 13 03:47:25.953426 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:25.953399 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 03:47:25.953466 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:25.953454 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs podName:59846397-d812-442b-a8f6-40f0f5d01cf5 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:26.453439378 +0000 UTC m=+205.926933110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs") pod "router-default-c4d6ff5b6-pptlr" (UID: "59846397-d812-442b-a8f6-40f0f5d01cf5") : secret "router-metrics-certs-default" not found Jun 13 03:47:25.953529 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.953506 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" Jun 13 03:47:25.955249 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.955230 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-default-certificate\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.955627 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.955407 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-stats-auth\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.960619 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.960602 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvw2x\" (UniqueName: \"kubernetes.io/projected/59846397-d812-442b-a8f6-40f0f5d01cf5-kube-api-access-xvw2x\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:25.961305 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.961290 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" Jun 13 03:47:25.974199 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:25.974181 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" Jun 13 03:47:26.085271 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:26.085251 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4"] Jun 13 03:47:26.087437 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:47:26.087412 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f26210_0f47_4364_9179_63392b1623f4.slice/crio-d02ebfb3efe5459e6214a0cb03b355938aa92288601c3d7696a862ff42db9205 WatchSource:0}: Error finding container d02ebfb3efe5459e6214a0cb03b355938aa92288601c3d7696a862ff42db9205: Status 404 returned error can't find the container with id d02ebfb3efe5459e6214a0cb03b355938aa92288601c3d7696a862ff42db9205 Jun 13 03:47:26.100952 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:26.100929 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh"] Jun 13 03:47:26.103321 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:47:26.103289 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64784d09_dfc8_4eb6_9c95_467ba97ef359.slice/crio-325bee278ecbd4a63fd46210947bd40c6d7e0003c918b6ce85dfaaa523797b39 WatchSource:0}: Error finding container 325bee278ecbd4a63fd46210947bd40c6d7e0003c918b6ce85dfaaa523797b39: Status 404 returned error can't find the container with id 325bee278ecbd4a63fd46210947bd40c6d7e0003c918b6ce85dfaaa523797b39 Jun 13 03:47:26.117946 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:26.117922 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-ptfx4"] Jun 13 03:47:26.120844 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:47:26.120823 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382e45c6_a956_438f_b519_9e378ff06578.slice/crio-72e231178b7df11047dc779a14f7707d561d84c400121f7b060a1eea10a25f46 WatchSource:0}: Error finding container 72e231178b7df11047dc779a14f7707d561d84c400121f7b060a1eea10a25f46: Status 404 returned error can't find the container with id 72e231178b7df11047dc779a14f7707d561d84c400121f7b060a1eea10a25f46 Jun 13 03:47:26.255427 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:26.255348 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vxlwb\" (UID: \"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" Jun 13 03:47:26.255524 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:26.255486 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 03:47:26.255563 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:26.255536 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls podName:7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd nodeName:}" failed. No retries permitted until 2026-06-13 03:47:27.255523789 +0000 UTC m=+206.729017523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vxlwb" (UID: "7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd") : secret "samples-operator-tls" not found Jun 13 03:47:26.356196 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:26.356162 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:26.356341 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:26.356310 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 03:47:26.356403 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:26.356389 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls podName:9252b71e-443e-4ff4-a6ea-6b46dbb948af nodeName:}" failed. No retries permitted until 2026-06-13 03:47:27.356357042 +0000 UTC m=+206.829850772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-q7t5r" (UID: "9252b71e-443e-4ff4-a6ea-6b46dbb948af") : secret "cluster-monitoring-operator-tls" not found Jun 13 03:47:26.456934 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:26.456905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:26.457085 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:26.456970 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:26.457125 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:26.457084 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 03:47:26.457125 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:26.457090 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle podName:59846397-d812-442b-a8f6-40f0f5d01cf5 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:27.457074871 +0000 UTC m=+206.930568602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle") pod "router-default-c4d6ff5b6-pptlr" (UID: "59846397-d812-442b-a8f6-40f0f5d01cf5") : configmap references non-existent config key: service-ca.crt Jun 13 03:47:26.457125 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:26.457125 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs podName:59846397-d812-442b-a8f6-40f0f5d01cf5 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:27.457111141 +0000 UTC m=+206.930604871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs") pod "router-default-c4d6ff5b6-pptlr" (UID: "59846397-d812-442b-a8f6-40f0f5d01cf5") : secret "router-metrics-certs-default" not found Jun 13 03:47:26.601141 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:26.601050 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" event={"ID":"382e45c6-a956-438f-b519-9e378ff06578","Type":"ContainerStarted","Data":"72e231178b7df11047dc779a14f7707d561d84c400121f7b060a1eea10a25f46"} Jun 13 03:47:26.602114 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:26.602086 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" event={"ID":"94f26210-0f47-4364-9179-63392b1623f4","Type":"ContainerStarted","Data":"d02ebfb3efe5459e6214a0cb03b355938aa92288601c3d7696a862ff42db9205"} Jun 13 03:47:26.603089 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:26.603066 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" event={"ID":"64784d09-dfc8-4eb6-9c95-467ba97ef359","Type":"ContainerStarted","Data":"325bee278ecbd4a63fd46210947bd40c6d7e0003c918b6ce85dfaaa523797b39"} Jun 13 03:47:27.264060 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:27.263918 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vxlwb\" (UID: \"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" Jun 13 03:47:27.264539 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:27.264105 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 03:47:27.264539 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:27.264177 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls podName:7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd nodeName:}" failed. No retries permitted until 2026-06-13 03:47:29.264158228 +0000 UTC m=+208.737651959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vxlwb" (UID: "7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd") : secret "samples-operator-tls" not found Jun 13 03:47:27.365324 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:27.365282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:27.365500 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:27.365450 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 03:47:27.365541 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:27.365518 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls podName:9252b71e-443e-4ff4-a6ea-6b46dbb948af nodeName:}" failed. No retries permitted until 2026-06-13 03:47:29.365501399 +0000 UTC m=+208.838995130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-q7t5r" (UID: "9252b71e-443e-4ff4-a6ea-6b46dbb948af") : secret "cluster-monitoring-operator-tls" not found Jun 13 03:47:27.465882 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:27.465845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:27.466071 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:27.465943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:27.466071 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:27.466024 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 03:47:27.466071 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:27.466068 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle podName:59846397-d812-442b-a8f6-40f0f5d01cf5 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:29.466050318 +0000 UTC m=+208.939544054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle") pod "router-default-c4d6ff5b6-pptlr" (UID: "59846397-d812-442b-a8f6-40f0f5d01cf5") : configmap references non-existent config key: service-ca.crt Jun 13 03:47:27.466240 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:27.466094 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs podName:59846397-d812-442b-a8f6-40f0f5d01cf5 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:29.466076043 +0000 UTC m=+208.939569775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs") pod "router-default-c4d6ff5b6-pptlr" (UID: "59846397-d812-442b-a8f6-40f0f5d01cf5") : secret "router-metrics-certs-default" not found Jun 13 03:47:29.279066 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:29.279026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vxlwb\" (UID: \"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" Jun 13 03:47:29.279552 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:29.279211 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 03:47:29.279552 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:29.279284 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls podName:7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd nodeName:}" failed. No retries permitted until 2026-06-13 03:47:33.279262904 +0000 UTC m=+212.752756649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vxlwb" (UID: "7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd") : secret "samples-operator-tls" not found Jun 13 03:47:29.380792 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:29.380762 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:29.380967 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:29.380949 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 03:47:29.381051 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:29.381021 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls podName:9252b71e-443e-4ff4-a6ea-6b46dbb948af nodeName:}" failed. No retries permitted until 2026-06-13 03:47:33.381000628 +0000 UTC m=+212.854494359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-q7t5r" (UID: "9252b71e-443e-4ff4-a6ea-6b46dbb948af") : secret "cluster-monitoring-operator-tls" not found Jun 13 03:47:29.482118 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:29.482083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:29.482307 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:29.482155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:29.482307 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:29.482282 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle podName:59846397-d812-442b-a8f6-40f0f5d01cf5 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:33.482259684 +0000 UTC m=+212.955753417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle") pod "router-default-c4d6ff5b6-pptlr" (UID: "59846397-d812-442b-a8f6-40f0f5d01cf5") : configmap references non-existent config key: service-ca.crt Jun 13 03:47:29.482307 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:29.482287 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 03:47:29.482496 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:29.482334 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs podName:59846397-d812-442b-a8f6-40f0f5d01cf5 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:33.482324307 +0000 UTC m=+212.955818042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs") pod "router-default-c4d6ff5b6-pptlr" (UID: "59846397-d812-442b-a8f6-40f0f5d01cf5") : secret "router-metrics-certs-default" not found Jun 13 03:47:29.616022 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:29.615579 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" event={"ID":"382e45c6-a956-438f-b519-9e378ff06578","Type":"ContainerStarted","Data":"d3a9627410e18d3bd06206794fbfd65efa1ede82b8ab3febba080cb22e812162"} Jun 13 03:47:29.617314 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:29.617286 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" event={"ID":"94f26210-0f47-4364-9179-63392b1623f4","Type":"ContainerStarted","Data":"e5465bae34691f642c19ff5f58800d39e0fd4270f634ce4afa989c77fc78a583"} Jun 13 03:47:29.619104 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:29.619078 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" event={"ID":"64784d09-dfc8-4eb6-9c95-467ba97ef359","Type":"ContainerStarted","Data":"5ef7784b0c3ea0c58a4c6b74d56da97c09698fbda157ef0c60e72ed59d633818"} Jun 13 03:47:29.632939 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:29.632902 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" podStartSLOduration=1.412888489 podStartE2EDuration="4.632889869s" totalImagesPullingTime="3.22000138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:29.631478488 +0000 UTC m=+209.104972260" watchObservedRunningTime="2026-06-13 03:47:29.632889869 +0000 UTC m=+209.106383599" Jun 13 03:47:29.645966 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:29.645915 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" podStartSLOduration=1.396760676 podStartE2EDuration="4.645898433s" totalImagesPullingTime="3.249137757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:29.644285731 +0000 UTC m=+209.117779485" watchObservedRunningTime="2026-06-13 03:47:29.645898433 +0000 UTC m=+209.119392187" Jun 13 03:47:30.648115 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.648053 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" podStartSLOduration=2.406853861 podStartE2EDuration="5.648031826s" totalImagesPullingTime="3.241177965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:29.662794217 +0000 UTC m=+209.136287970" watchObservedRunningTime="2026-06-13 03:47:30.648031826 +0000 UTC m=+210.121525581" Jun 13 03:47:30.648534 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.648209 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-b2swr"] Jun 13 03:47:30.650697 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.650676 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-b2swr" Jun 13 03:47:30.652946 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.652928 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 13 03:47:30.654003 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.653984 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 13 03:47:30.654079 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.654008 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dlwzf\"" Jun 13 03:47:30.658088 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.658044 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-b2swr"] Jun 13 03:47:30.691624 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.691595 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jftk9\" (UniqueName: \"kubernetes.io/projected/94e935bc-381c-4ccf-ba98-d71827db00d5-kube-api-access-jftk9\") pod \"migrator-d4bcd4867-b2swr\" (UID: \"94e935bc-381c-4ccf-ba98-d71827db00d5\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-b2swr" Jun 13 03:47:30.793493 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.793454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jftk9\" (UniqueName: \"kubernetes.io/projected/94e935bc-381c-4ccf-ba98-d71827db00d5-kube-api-access-jftk9\") pod \"migrator-d4bcd4867-b2swr\" (UID: \"94e935bc-381c-4ccf-ba98-d71827db00d5\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-b2swr" Jun 13 03:47:30.806976 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.806943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jftk9\" (UniqueName: \"kubernetes.io/projected/94e935bc-381c-4ccf-ba98-d71827db00d5-kube-api-access-jftk9\") pod \"migrator-d4bcd4867-b2swr\" (UID: \"94e935bc-381c-4ccf-ba98-d71827db00d5\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-b2swr" Jun 13 03:47:30.811243 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.811212 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x9rh8"] Jun 13 03:47:30.814165 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.814141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:30.816850 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.816827 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 03:47:30.817076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.816853 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 03:47:30.817164 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.816933 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-64h9h\"" Jun 13 03:47:30.825717 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.825696 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x9rh8"] Jun 13 03:47:30.894880 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.894844 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:30.895012 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.894973 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8954b42f-92cf-4205-99c7-c437ed73656e-crio-socket\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:30.895012 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.895006 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:30.895109 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.895025 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fst8w\" (UniqueName: \"kubernetes.io/projected/8954b42f-92cf-4205-99c7-c437ed73656e-kube-api-access-fst8w\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:30.895109 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.895048 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8954b42f-92cf-4205-99c7-c437ed73656e-data-volume\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:30.960169 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.960101 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-b2swr" Jun 13 03:47:30.996318 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.996290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8954b42f-92cf-4205-99c7-c437ed73656e-crio-socket\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:30.996497 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.996329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:30.996497 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.996357 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fst8w\" (UniqueName: \"kubernetes.io/projected/8954b42f-92cf-4205-99c7-c437ed73656e-kube-api-access-fst8w\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:30.996497 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.996409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8954b42f-92cf-4205-99c7-c437ed73656e-data-volume\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:30.996497 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.996429 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8954b42f-92cf-4205-99c7-c437ed73656e-crio-socket\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:30.996497 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:30.996443 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 03:47:30.996497 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:30.996502 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm podName:8954b42f-92cf-4205-99c7-c437ed73656e nodeName:}" failed. No retries permitted until 2026-06-13 03:47:31.496487535 +0000 UTC m=+210.969981267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9rh8" (UID: "8954b42f-92cf-4205-99c7-c437ed73656e") : configmap "kube-rbac-proxy" not found Jun 13 03:47:30.996809 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.996548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:30.996809 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:30.996692 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 03:47:30.996809 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:30.996739 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8954b42f-92cf-4205-99c7-c437ed73656e-data-volume\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:30.996809 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:30.996755 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls podName:8954b42f-92cf-4205-99c7-c437ed73656e nodeName:}" failed. No retries permitted until 2026-06-13 03:47:31.496738781 +0000 UTC m=+210.970232518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9rh8" (UID: "8954b42f-92cf-4205-99c7-c437ed73656e") : secret "insights-runtime-extractor-tls" not found Jun 13 03:47:31.005322 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:31.005255 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fst8w\" (UniqueName: \"kubernetes.io/projected/8954b42f-92cf-4205-99c7-c437ed73656e-kube-api-access-fst8w\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:31.082130 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:31.082099 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-b2swr"] Jun 13 03:47:31.085258 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:47:31.085195 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e935bc_381c_4ccf_ba98_d71827db00d5.slice/crio-709668ad93788a50aab4d22e3e36df2662a6200718e2393a0b26725fa55438f1 WatchSource:0}: Error finding container 709668ad93788a50aab4d22e3e36df2662a6200718e2393a0b26725fa55438f1: Status 404 returned error can't find the container with id 709668ad93788a50aab4d22e3e36df2662a6200718e2393a0b26725fa55438f1 Jun 13 03:47:31.500587 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:31.500555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:31.500787 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:31.500635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:31.500787 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:31.500684 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 03:47:31.500787 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:31.500742 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 03:47:31.500787 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:31.500748 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm podName:8954b42f-92cf-4205-99c7-c437ed73656e nodeName:}" failed. No retries permitted until 2026-06-13 03:47:32.500732275 +0000 UTC m=+211.974226005 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9rh8" (UID: "8954b42f-92cf-4205-99c7-c437ed73656e") : configmap "kube-rbac-proxy" not found Jun 13 03:47:31.500787 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:31.500791 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls podName:8954b42f-92cf-4205-99c7-c437ed73656e nodeName:}" failed. No retries permitted until 2026-06-13 03:47:32.500779964 +0000 UTC m=+211.974273695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9rh8" (UID: "8954b42f-92cf-4205-99c7-c437ed73656e") : secret "insights-runtime-extractor-tls" not found Jun 13 03:47:31.627049 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:31.627013 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-b2swr" event={"ID":"94e935bc-381c-4ccf-ba98-d71827db00d5","Type":"ContainerStarted","Data":"709668ad93788a50aab4d22e3e36df2662a6200718e2393a0b26725fa55438f1"} Jun 13 03:47:32.508874 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:32.508797 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:32.509199 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:32.508897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:32.509199 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:32.508920 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 03:47:32.509199 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:32.508990 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm podName:8954b42f-92cf-4205-99c7-c437ed73656e nodeName:}" failed. No retries permitted until 2026-06-13 03:47:34.508972936 +0000 UTC m=+213.982466678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9rh8" (UID: "8954b42f-92cf-4205-99c7-c437ed73656e") : configmap "kube-rbac-proxy" not found Jun 13 03:47:32.509199 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:32.509047 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 03:47:32.509199 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:32.509106 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls podName:8954b42f-92cf-4205-99c7-c437ed73656e nodeName:}" failed. No retries permitted until 2026-06-13 03:47:34.509090851 +0000 UTC m=+213.982584605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9rh8" (UID: "8954b42f-92cf-4205-99c7-c437ed73656e") : secret "insights-runtime-extractor-tls" not found Jun 13 03:47:32.631589 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:32.631555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-b2swr" event={"ID":"94e935bc-381c-4ccf-ba98-d71827db00d5","Type":"ContainerStarted","Data":"bbfaec709617b2d820cca2e327642342e563a90b39af80c92b9ab4d93d0d0154"} Jun 13 03:47:32.631736 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:32.631644 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-b2swr" event={"ID":"94e935bc-381c-4ccf-ba98-d71827db00d5","Type":"ContainerStarted","Data":"e7534baf2ab2575cf0c94bf7565d13a18de0c4610b877cb23d19f537968ba37f"} Jun 13 03:47:32.646078 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:32.646036 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-b2swr" podStartSLOduration=1.582121203 podStartE2EDuration="2.646018809s" totalImagesPullingTime="1.063897606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:32.644881682 +0000 UTC m=+212.118375447" watchObservedRunningTime="2026-06-13 03:47:32.646018809 +0000 UTC m=+212.119512560" Jun 13 03:47:33.316808 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:33.316775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vxlwb\" (UID: \"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" Jun 13 03:47:33.316957 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:33.316919 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 03:47:33.317011 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:33.316982 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls podName:7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd nodeName:}" failed. No retries permitted until 2026-06-13 03:47:41.316968157 +0000 UTC m=+220.790461889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vxlwb" (UID: "7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd") : secret "samples-operator-tls" not found Jun 13 03:47:33.417303 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:33.417265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:33.417471 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:33.417436 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 03:47:33.417512 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:33.417502 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls podName:9252b71e-443e-4ff4-a6ea-6b46dbb948af nodeName:}" failed. No retries permitted until 2026-06-13 03:47:41.417486108 +0000 UTC m=+220.890979842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-q7t5r" (UID: "9252b71e-443e-4ff4-a6ea-6b46dbb948af") : secret "cluster-monitoring-operator-tls" not found Jun 13 03:47:33.518634 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:33.518600 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:33.518992 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:33.518748 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 13 03:47:33.518992 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:33.518770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:33.518992 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:33.518802 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs podName:59846397-d812-442b-a8f6-40f0f5d01cf5 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:41.518789242 +0000 UTC m=+220.992282973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs") pod "router-default-c4d6ff5b6-pptlr" (UID: "59846397-d812-442b-a8f6-40f0f5d01cf5") : secret "router-metrics-certs-default" not found Jun 13 03:47:33.518992 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:33.518878 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle podName:59846397-d812-442b-a8f6-40f0f5d01cf5 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:41.518856498 +0000 UTC m=+220.992350234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle") pod "router-default-c4d6ff5b6-pptlr" (UID: "59846397-d812-442b-a8f6-40f0f5d01cf5") : configmap references non-existent config key: service-ca.crt Jun 13 03:47:33.900383 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:33.900340 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6sff_af08c78b-69e1-421a-8df3-73fa59c36e18/dns-node-resolver/0.log" Jun 13 03:47:34.526912 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:34.526886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:34.527320 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:34.526970 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:34.527320 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:34.527008 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 03:47:34.527320 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:34.527074 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm podName:8954b42f-92cf-4205-99c7-c437ed73656e nodeName:}" failed. No retries permitted until 2026-06-13 03:47:38.527059834 +0000 UTC m=+218.000553575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9rh8" (UID: "8954b42f-92cf-4205-99c7-c437ed73656e") : configmap "kube-rbac-proxy" not found Jun 13 03:47:34.527320 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:34.527129 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 03:47:34.527320 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:34.527209 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls podName:8954b42f-92cf-4205-99c7-c437ed73656e nodeName:}" failed. No retries permitted until 2026-06-13 03:47:38.527189619 +0000 UTC m=+218.000683364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9rh8" (UID: "8954b42f-92cf-4205-99c7-c437ed73656e") : secret "insights-runtime-extractor-tls" not found Jun 13 03:47:34.700040 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:34.700015 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gzqcn_9b69f037-b1a8-47bf-b468-b48b84405b26/node-ca/0.log" Jun 13 03:47:35.299466 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:35.299433 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5sz5d_071690c8-fde4-4021-9197-658b91d47206/serve-healthcheck-canary/0.log" Jun 13 03:47:35.901257 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:35.901230 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-b2swr_94e935bc-381c-4ccf-ba98-d71827db00d5/migrator/0.log" Jun 13 03:47:36.102061 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:36.102032 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-b2swr_94e935bc-381c-4ccf-ba98-d71827db00d5/graceful-termination/0.log" Jun 13 03:47:36.301610 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:36.301542 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-5p4vh_64784d09-dfc8-4eb6-9c95-467ba97ef359/kube-storage-version-migrator-operator/0.log" Jun 13 03:47:38.559685 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:38.559645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:38.560136 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:38.559750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:38.560136 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:38.559817 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 03:47:38.560136 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:38.559834 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 03:47:38.560136 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:38.559902 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls podName:8954b42f-92cf-4205-99c7-c437ed73656e nodeName:}" failed. No retries permitted until 2026-06-13 03:47:46.559882468 +0000 UTC m=+226.033376221 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9rh8" (UID: "8954b42f-92cf-4205-99c7-c437ed73656e") : secret "insights-runtime-extractor-tls" not found Jun 13 03:47:38.560136 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:38.559922 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm podName:8954b42f-92cf-4205-99c7-c437ed73656e nodeName:}" failed. No retries permitted until 2026-06-13 03:47:46.559912362 +0000 UTC m=+226.033406098 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9rh8" (UID: "8954b42f-92cf-4205-99c7-c437ed73656e") : configmap "kube-rbac-proxy" not found Jun 13 03:47:41.378139 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:41.378095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vxlwb\" (UID: \"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" Jun 13 03:47:41.380610 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:41.380585 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vxlwb\" (UID: \"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" Jun 13 03:47:41.479294 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:41.479252 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:41.479479 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:41.479422 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 03:47:41.479552 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:41.479492 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls podName:9252b71e-443e-4ff4-a6ea-6b46dbb948af nodeName:}" failed. No retries permitted until 2026-06-13 03:47:57.479473274 +0000 UTC m=+236.952967022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-q7t5r" (UID: "9252b71e-443e-4ff4-a6ea-6b46dbb948af") : secret "cluster-monitoring-operator-tls" not found Jun 13 03:47:41.567866 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:41.567833 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" Jun 13 03:47:41.579965 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:41.579938 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:41.580084 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:41.580007 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:41.580148 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:47:41.580101 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle podName:59846397-d812-442b-a8f6-40f0f5d01cf5 nodeName:}" failed. No retries permitted until 2026-06-13 03:47:57.580084856 +0000 UTC m=+237.053578587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle") pod "router-default-c4d6ff5b6-pptlr" (UID: "59846397-d812-442b-a8f6-40f0f5d01cf5") : configmap references non-existent config key: service-ca.crt Jun 13 03:47:41.582390 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:41.582352 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59846397-d812-442b-a8f6-40f0f5d01cf5-metrics-certs\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:41.683874 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:41.683836 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb"] Jun 13 03:47:42.663611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:42.663560 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" event={"ID":"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd","Type":"ContainerStarted","Data":"95e34bcd8a4c2ecbb368851507455a9fcd8a9189ea94d6ed7e8572f38893a434"} Jun 13 03:47:43.668425 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:43.668333 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" event={"ID":"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd","Type":"ContainerStarted","Data":"06963b91157e60d6395830be03b2195598fe44b906827b069f0612dd16f92847"} Jun 13 03:47:43.668425 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:43.668405 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" event={"ID":"7f91ce6b-aafa-4c51-a192-0ce1e37b5bcd","Type":"ContainerStarted","Data":"3cef4116bedaa6a4df7ec99d8a8b6f13d74b33a8d12f5a3cb6fdbec869af1994"} Jun 13 03:47:43.683076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:43.683026 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vxlwb" podStartSLOduration=17.02723977 podStartE2EDuration="18.683009844s" totalImagesPullingTime="1.655770074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:43.682467832 +0000 UTC m=+223.155961599" watchObservedRunningTime="2026-06-13 03:47:43.683009844 +0000 UTC m=+223.156503598" Jun 13 03:47:46.619488 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:46.619460 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:46.619865 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:46.619526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:46.619943 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:46.619925 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8954b42f-92cf-4205-99c7-c437ed73656e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:46.621655 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:46.621629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8954b42f-92cf-4205-99c7-c437ed73656e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9rh8\" (UID: \"8954b42f-92cf-4205-99c7-c437ed73656e\") " pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:46.725815 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:46.725790 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x9rh8" Jun 13 03:47:46.843484 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:46.843451 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x9rh8"] Jun 13 03:47:46.846102 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:47:46.846079 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8954b42f_92cf_4205_99c7_c437ed73656e.slice/crio-2f737b84542d677922d8e9fd7b2124b1bba657a9d2b2c6008ef0a8d0a222f214 WatchSource:0}: Error finding container 2f737b84542d677922d8e9fd7b2124b1bba657a9d2b2c6008ef0a8d0a222f214: Status 404 returned error can't find the container with id 2f737b84542d677922d8e9fd7b2124b1bba657a9d2b2c6008ef0a8d0a222f214 Jun 13 03:47:47.681436 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:47.681401 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9rh8" event={"ID":"8954b42f-92cf-4205-99c7-c437ed73656e","Type":"ContainerStarted","Data":"2f737b84542d677922d8e9fd7b2124b1bba657a9d2b2c6008ef0a8d0a222f214"} Jun 13 03:47:50.694143 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:50.694105 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9rh8" event={"ID":"8954b42f-92cf-4205-99c7-c437ed73656e","Type":"ContainerStarted","Data":"d2a659de0468a5471ed8dc3f19a377978bcc2a2bbeb7e38e2b57a8a58f8c7ec8"} Jun 13 03:47:51.699304 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:51.699263 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9rh8" event={"ID":"8954b42f-92cf-4205-99c7-c437ed73656e","Type":"ContainerStarted","Data":"5ccb08391e95255c78220e9fc67794164c4ce35edfb63edd9c0f8136e1704c84"} Jun 13 03:47:52.703831 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:52.703800 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9rh8" event={"ID":"8954b42f-92cf-4205-99c7-c437ed73656e","Type":"ContainerStarted","Data":"69750f4d40325237ebe534c3486359ee2fc4caf922a0fc5137b2de3cb00912af"} Jun 13 03:47:52.721862 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:52.721819 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x9rh8" podStartSLOduration=17.084793033 podStartE2EDuration="22.721800857s" totalImagesPullingTime="5.637007824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 03:47:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:52.720878037 +0000 UTC m=+232.194371791" watchObservedRunningTime="2026-06-13 03:47:52.721800857 +0000 UTC m=+232.195294620" Jun 13 03:47:57.502897 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:57.502836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:57.505220 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:57.505199 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9252b71e-443e-4ff4-a6ea-6b46dbb948af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-q7t5r\" (UID: \"9252b71e-443e-4ff4-a6ea-6b46dbb948af\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:57.603906 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:57.603862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:57.604484 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:57.604465 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59846397-d812-442b-a8f6-40f0f5d01cf5-service-ca-bundle\") pod \"router-default-c4d6ff5b6-pptlr\" (UID: \"59846397-d812-442b-a8f6-40f0f5d01cf5\") " pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:57.645880 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:57.645852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:57.767409 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:57.767323 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c4d6ff5b6-pptlr"] Jun 13 03:47:57.770101 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:47:57.770077 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59846397_d812_442b_a8f6_40f0f5d01cf5.slice/crio-e48f4680939782a2fcd60d37d1de813966b1c9b20a2ad7c46032f75a1386a53a WatchSource:0}: Error finding container e48f4680939782a2fcd60d37d1de813966b1c9b20a2ad7c46032f75a1386a53a: Status 404 returned error can't find the container with id e48f4680939782a2fcd60d37d1de813966b1c9b20a2ad7c46032f75a1386a53a Jun 13 03:47:57.778227 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:57.778211 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" Jun 13 03:47:57.898836 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:57.898813 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r"] Jun 13 03:47:57.900973 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:47:57.900948 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9252b71e_443e_4ff4_a6ea_6b46dbb948af.slice/crio-7432ddb99e2fbbd020f6e693e8405e97fa38b14d9da34ba5139540fb70ccbc8d WatchSource:0}: Error finding container 7432ddb99e2fbbd020f6e693e8405e97fa38b14d9da34ba5139540fb70ccbc8d: Status 404 returned error can't find the container with id 7432ddb99e2fbbd020f6e693e8405e97fa38b14d9da34ba5139540fb70ccbc8d Jun 13 03:47:58.723629 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:58.723592 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" event={"ID":"9252b71e-443e-4ff4-a6ea-6b46dbb948af","Type":"ContainerStarted","Data":"7432ddb99e2fbbd020f6e693e8405e97fa38b14d9da34ba5139540fb70ccbc8d"} Jun 13 03:47:58.725404 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:58.725355 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" event={"ID":"59846397-d812-442b-a8f6-40f0f5d01cf5","Type":"ContainerStarted","Data":"88dd9fa5d7e796d89b97bf032a3dad606c77082a54ae8e744880bae29d35357f"} Jun 13 03:47:58.725537 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:58.725415 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" event={"ID":"59846397-d812-442b-a8f6-40f0f5d01cf5","Type":"ContainerStarted","Data":"e48f4680939782a2fcd60d37d1de813966b1c9b20a2ad7c46032f75a1386a53a"} Jun 13 03:47:58.743661 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:58.743610 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" podStartSLOduration=33.74359729 podStartE2EDuration="33.74359729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:58.742701056 +0000 UTC m=+238.216194831" watchObservedRunningTime="2026-06-13 03:47:58.74359729 +0000 UTC m=+238.217091042" Jun 13 03:47:59.646298 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:59.646259 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:59.648999 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:59.648798 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:59.730741 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:59.730650 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" event={"ID":"9252b71e-443e-4ff4-a6ea-6b46dbb948af","Type":"ContainerStarted","Data":"0479b30d2d005919fe4b494112eeb683c5d46ab769c4c610c83a78e992718264"} Jun 13 03:47:59.731161 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:59.730898 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:59.732182 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:59.732163 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c4d6ff5b6-pptlr" Jun 13 03:47:59.751088 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:47:59.751031 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-q7t5r" podStartSLOduration=33.175526852 podStartE2EDuration="34.751014764s" totalImagesPullingTime="1.575487912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:47:59.749326836 +0000 UTC m=+239.222820590" watchObservedRunningTime="2026-06-13 03:47:59.751014764 +0000 UTC m=+239.224508518" Jun 13 03:48:00.876080 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:00.876044 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67bcc4c686-vqsnc"] Jun 13 03:48:00.879066 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:00.879051 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:00.881226 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:00.881207 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 13 03:48:00.882330 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:00.882273 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7kzdx\"" Jun 13 03:48:00.883266 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:00.882756 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 13 03:48:00.883266 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:00.882933 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 13 03:48:00.883569 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:00.882762 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 13 03:48:00.883883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:00.883663 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 13 03:48:00.884648 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:00.884246 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 13 03:48:00.884648 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:00.884432 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 13 03:48:00.889006 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:00.888980 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bcc4c686-vqsnc"] Jun 13 03:48:01.034665 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.034640 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-oauth-config\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.034665 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.034668 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-service-ca\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.034831 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.034684 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-config\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.034831 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.034699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x69wx\" (UniqueName: \"kubernetes.io/projected/323ab6f0-78e0-44d2-8658-532dc6e2eee1-kube-api-access-x69wx\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.034831 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.034791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-oauth-serving-cert\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.034831 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.034815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-serving-cert\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.135395 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.135285 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-oauth-serving-cert\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.135395 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.135336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-serving-cert\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.135624 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.135414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-oauth-config\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.135624 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.135437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-service-ca\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.135624 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.135459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-config\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.135624 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.135479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x69wx\" (UniqueName: \"kubernetes.io/projected/323ab6f0-78e0-44d2-8658-532dc6e2eee1-kube-api-access-x69wx\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.138037 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.138017 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 13 03:48:01.138122 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.138020 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 13 03:48:01.138251 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.138234 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 13 03:48:01.138296 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.138273 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 13 03:48:01.138348 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.138273 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 13 03:48:01.142505 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.142487 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 13 03:48:01.146890 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.146861 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-service-ca\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.147047 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.146903 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-config\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.147047 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.146967 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-oauth-serving-cert\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.148543 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.148526 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-oauth-config\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.148732 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.148712 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-serving-cert\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.153303 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.153276 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 13 03:48:01.164251 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.164231 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x69wx\" (UniqueName: \"kubernetes.io/projected/323ab6f0-78e0-44d2-8658-532dc6e2eee1-kube-api-access-x69wx\") pod \"console-67bcc4c686-vqsnc\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.192356 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.192335 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7kzdx\"" Jun 13 03:48:01.201253 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.201240 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:01.334229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.334178 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bcc4c686-vqsnc"] Jun 13 03:48:01.336166 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:48:01.336139 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323ab6f0_78e0_44d2_8658_532dc6e2eee1.slice/crio-14e0efc823c4c476d7d3dad89d64dc28fd5fc3e2a7f8a3d8e7fc674905ee63f0 WatchSource:0}: Error finding container 14e0efc823c4c476d7d3dad89d64dc28fd5fc3e2a7f8a3d8e7fc674905ee63f0: Status 404 returned error can't find the container with id 14e0efc823c4c476d7d3dad89d64dc28fd5fc3e2a7f8a3d8e7fc674905ee63f0 Jun 13 03:48:01.738764 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:01.738724 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bcc4c686-vqsnc" event={"ID":"323ab6f0-78e0-44d2-8658-532dc6e2eee1","Type":"ContainerStarted","Data":"14e0efc823c4c476d7d3dad89d64dc28fd5fc3e2a7f8a3d8e7fc674905ee63f0"} Jun 13 03:48:03.024405 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.024371 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng"] Jun 13 03:48:03.057198 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.057163 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng"] Jun 13 03:48:03.057392 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.057252 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.060013 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.059863 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 13 03:48:03.060145 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.060018 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 13 03:48:03.060211 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.060183 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jm87s\"" Jun 13 03:48:03.060991 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.060968 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 13 03:48:03.151417 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.151352 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/05decfcf-3583-4a7f-bc0e-30c7fd6eb459-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-dfmng\" (UID: \"05decfcf-3583-4a7f-bc0e-30c7fd6eb459\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.151570 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.151460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxkwt\" (UniqueName: \"kubernetes.io/projected/05decfcf-3583-4a7f-bc0e-30c7fd6eb459-kube-api-access-gxkwt\") pod \"prometheus-operator-864fcfc6f9-dfmng\" (UID: \"05decfcf-3583-4a7f-bc0e-30c7fd6eb459\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.151570 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.151505 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05decfcf-3583-4a7f-bc0e-30c7fd6eb459-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-dfmng\" (UID: \"05decfcf-3583-4a7f-bc0e-30c7fd6eb459\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.151659 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.151581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05decfcf-3583-4a7f-bc0e-30c7fd6eb459-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-dfmng\" (UID: \"05decfcf-3583-4a7f-bc0e-30c7fd6eb459\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.252315 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.252279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxkwt\" (UniqueName: \"kubernetes.io/projected/05decfcf-3583-4a7f-bc0e-30c7fd6eb459-kube-api-access-gxkwt\") pod \"prometheus-operator-864fcfc6f9-dfmng\" (UID: \"05decfcf-3583-4a7f-bc0e-30c7fd6eb459\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.252315 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.252320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05decfcf-3583-4a7f-bc0e-30c7fd6eb459-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-dfmng\" (UID: \"05decfcf-3583-4a7f-bc0e-30c7fd6eb459\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.252567 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.252356 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05decfcf-3583-4a7f-bc0e-30c7fd6eb459-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-dfmng\" (UID: \"05decfcf-3583-4a7f-bc0e-30c7fd6eb459\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.252627 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.252562 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/05decfcf-3583-4a7f-bc0e-30c7fd6eb459-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-dfmng\" (UID: \"05decfcf-3583-4a7f-bc0e-30c7fd6eb459\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.253003 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.252983 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05decfcf-3583-4a7f-bc0e-30c7fd6eb459-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-dfmng\" (UID: \"05decfcf-3583-4a7f-bc0e-30c7fd6eb459\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.254769 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.254738 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/05decfcf-3583-4a7f-bc0e-30c7fd6eb459-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-dfmng\" (UID: \"05decfcf-3583-4a7f-bc0e-30c7fd6eb459\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.254876 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.254857 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05decfcf-3583-4a7f-bc0e-30c7fd6eb459-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-dfmng\" (UID: \"05decfcf-3583-4a7f-bc0e-30c7fd6eb459\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.259733 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.259706 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxkwt\" (UniqueName: \"kubernetes.io/projected/05decfcf-3583-4a7f-bc0e-30c7fd6eb459-kube-api-access-gxkwt\") pod \"prometheus-operator-864fcfc6f9-dfmng\" (UID: \"05decfcf-3583-4a7f-bc0e-30c7fd6eb459\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.368405 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.368307 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" Jun 13 03:48:03.517586 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.517551 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng"] Jun 13 03:48:03.521215 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:48:03.521186 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05decfcf_3583_4a7f_bc0e_30c7fd6eb459.slice/crio-c85283ad66f743b838aaf1e87e01967992485e7e5acd668eba0d231f249ea872 WatchSource:0}: Error finding container c85283ad66f743b838aaf1e87e01967992485e7e5acd668eba0d231f249ea872: Status 404 returned error can't find the container with id c85283ad66f743b838aaf1e87e01967992485e7e5acd668eba0d231f249ea872 Jun 13 03:48:03.747568 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:03.747525 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" event={"ID":"05decfcf-3583-4a7f-bc0e-30c7fd6eb459","Type":"ContainerStarted","Data":"c85283ad66f743b838aaf1e87e01967992485e7e5acd668eba0d231f249ea872"} Jun 13 03:48:05.755648 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:05.755546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bcc4c686-vqsnc" event={"ID":"323ab6f0-78e0-44d2-8658-532dc6e2eee1","Type":"ContainerStarted","Data":"a7b65efc3e177a666b900b80ee293eecfbe38987e9c88e92c80a293c389d21e8"} Jun 13 03:48:05.757318 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:05.757281 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" event={"ID":"05decfcf-3583-4a7f-bc0e-30c7fd6eb459","Type":"ContainerStarted","Data":"752c90684312595264e4d98faf00daf37a8c724f91289e2f3148bb26d0b8f9c9"} Jun 13 03:48:05.757468 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:05.757327 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" event={"ID":"05decfcf-3583-4a7f-bc0e-30c7fd6eb459","Type":"ContainerStarted","Data":"2f361714805d28a4558320ace4923ee15e29978043c04b503fc614ef56885d86"} Jun 13 03:48:05.772732 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:05.772683 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67bcc4c686-vqsnc" podStartSLOduration=2.390881124 podStartE2EDuration="5.772667575s" totalImagesPullingTime="3.381786451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:05.772295467 +0000 UTC m=+245.245789234" watchObservedRunningTime="2026-06-13 03:48:05.772667575 +0000 UTC m=+245.246161329" Jun 13 03:48:05.787835 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:05.787787 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-dfmng" podStartSLOduration=0.889010121 podStartE2EDuration="2.787773773s" totalImagesPullingTime="1.898763652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:48:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:05.78672994 +0000 UTC m=+245.260223717" watchObservedRunningTime="2026-06-13 03:48:05.787773773 +0000 UTC m=+245.261267526" Jun 13 03:48:07.380083 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.380050 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4jwwp"] Jun 13 03:48:07.382405 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.382390 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.384541 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.384517 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 13 03:48:07.384676 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.384592 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 13 03:48:07.384833 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.384817 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9br6t\"" Jun 13 03:48:07.384833 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.384825 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 13 03:48:07.492612 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.492576 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-tls\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.492612 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.492617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c513ac26-f582-4b70-9770-7fbe8ab17742-root\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.492788 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.492643 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhxz8\" (UniqueName: \"kubernetes.io/projected/c513ac26-f582-4b70-9770-7fbe8ab17742-kube-api-access-fhxz8\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.492788 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.492708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-wtmp\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.492788 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.492738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-textfile\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.492788 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.492764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.492914 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.492814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c513ac26-f582-4b70-9770-7fbe8ab17742-sys\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.492914 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.492848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c513ac26-f582-4b70-9770-7fbe8ab17742-metrics-client-ca\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.492914 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.492890 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594035 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.593997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594191 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.594055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-tls\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594191 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.594091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c513ac26-f582-4b70-9770-7fbe8ab17742-root\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594191 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.594118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhxz8\" (UniqueName: \"kubernetes.io/projected/c513ac26-f582-4b70-9770-7fbe8ab17742-kube-api-access-fhxz8\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594191 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.594172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-wtmp\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594386 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.594208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-textfile\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594386 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:48:07.594220 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 13 03:48:07.594386 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.594241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594386 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:48:07.594309 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-tls podName:c513ac26-f582-4b70-9770-7fbe8ab17742 nodeName:}" failed. No retries permitted until 2026-06-13 03:48:08.09427085 +0000 UTC m=+247.567764591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-tls") pod "node-exporter-4jwwp" (UID: "c513ac26-f582-4b70-9770-7fbe8ab17742") : secret "node-exporter-tls" not found Jun 13 03:48:07.594620 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.594417 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-wtmp\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594620 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.594502 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c513ac26-f582-4b70-9770-7fbe8ab17742-root\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594620 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.594559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c513ac26-f582-4b70-9770-7fbe8ab17742-sys\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594620 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.594607 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-textfile\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594820 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.594553 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c513ac26-f582-4b70-9770-7fbe8ab17742-sys\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594820 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.594658 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c513ac26-f582-4b70-9770-7fbe8ab17742-metrics-client-ca\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.594922 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.594855 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.595186 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.595163 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c513ac26-f582-4b70-9770-7fbe8ab17742-metrics-client-ca\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.596945 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.596917 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:07.601681 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:07.601661 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhxz8\" (UniqueName: \"kubernetes.io/projected/c513ac26-f582-4b70-9770-7fbe8ab17742-kube-api-access-fhxz8\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:08.103187 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:08.103150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-tls\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:08.105562 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:08.105534 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c513ac26-f582-4b70-9770-7fbe8ab17742-node-exporter-tls\") pod \"node-exporter-4jwwp\" (UID: \"c513ac26-f582-4b70-9770-7fbe8ab17742\") " pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:08.291218 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:08.291186 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4jwwp" Jun 13 03:48:08.301265 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:48:08.301238 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc513ac26_f582_4b70_9770_7fbe8ab17742.slice/crio-37e1cdb6b779f33c1e7eed1e8b031cb37d11558092e34515f3f327640eaa3fac WatchSource:0}: Error finding container 37e1cdb6b779f33c1e7eed1e8b031cb37d11558092e34515f3f327640eaa3fac: Status 404 returned error can't find the container with id 37e1cdb6b779f33c1e7eed1e8b031cb37d11558092e34515f3f327640eaa3fac Jun 13 03:48:08.768896 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:08.768856 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jwwp" event={"ID":"c513ac26-f582-4b70-9770-7fbe8ab17742","Type":"ContainerStarted","Data":"37e1cdb6b779f33c1e7eed1e8b031cb37d11558092e34515f3f327640eaa3fac"} Jun 13 03:48:09.773875 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:09.773839 2562 generic.go:356] "Generic (PLEG): container finished" podID="c513ac26-f582-4b70-9770-7fbe8ab17742" containerID="e77ad134f4f718a07fd2353309049bb3e6faf93436620f8de67dbcbcdd6c9465" exitCode=0 Jun 13 03:48:09.774324 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:09.773889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jwwp" event={"ID":"c513ac26-f582-4b70-9770-7fbe8ab17742","Type":"ContainerDied","Data":"e77ad134f4f718a07fd2353309049bb3e6faf93436620f8de67dbcbcdd6c9465"} Jun 13 03:48:10.780099 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:10.780059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jwwp" event={"ID":"c513ac26-f582-4b70-9770-7fbe8ab17742","Type":"ContainerStarted","Data":"17505b16e5279c79ea2c3ce3890ff09ca5f05df7260d6001df0c60a30d1c6f85"} Jun 13 03:48:10.780509 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:10.780125 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jwwp" event={"ID":"c513ac26-f582-4b70-9770-7fbe8ab17742","Type":"ContainerStarted","Data":"25cc9b7c9b2f1cb1c84bc7682723dcdd307482be82589118fe6cf66f95de659d"} Jun 13 03:48:10.798401 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:10.798338 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4jwwp" podStartSLOduration=2.920940794 podStartE2EDuration="3.798324048s" totalImagesPullingTime="809.92562ms" totalInitContainerRuntime="67.457634ms" isStatefulPod=true podCreationTimestamp="2026-06-13 03:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:10.797008421 +0000 UTC m=+250.270502186" watchObservedRunningTime="2026-06-13 03:48:10.798324048 +0000 UTC m=+250.271817800" Jun 13 03:48:11.201614 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:11.201580 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:11.201790 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:11.201631 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:11.203146 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:11.203104 2562 patch_prober.go:28] interesting pod/console-67bcc4c686-vqsnc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" start-of-body= Jun 13 03:48:11.203272 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:11.203174 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67bcc4c686-vqsnc" podUID="323ab6f0-78e0-44d2-8658-532dc6e2eee1" containerName="console" probeResult="failure" output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" Jun 13 03:48:12.141544 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.141511 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj"] Jun 13 03:48:12.146233 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.146202 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj" Jun 13 03:48:12.148960 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.148935 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rbsdw\"" Jun 13 03:48:12.149072 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.149002 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 13 03:48:12.151749 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.151729 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj"] Jun 13 03:48:12.237833 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.237798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvb8g\" (UniqueName: \"kubernetes.io/projected/539644f6-8272-40bc-bae1-deb259490985-kube-api-access-tvb8g\") pod \"monitoring-plugin-589576dfc7-gn4bj\" (UID: \"539644f6-8272-40bc-bae1-deb259490985\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj" Jun 13 03:48:12.237984 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.237849 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539644f6-8272-40bc-bae1-deb259490985-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-gn4bj\" (UID: \"539644f6-8272-40bc-bae1-deb259490985\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj" Jun 13 03:48:12.338605 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.338572 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539644f6-8272-40bc-bae1-deb259490985-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-gn4bj\" (UID: \"539644f6-8272-40bc-bae1-deb259490985\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj" Jun 13 03:48:12.338770 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.338713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvb8g\" (UniqueName: \"kubernetes.io/projected/539644f6-8272-40bc-bae1-deb259490985-kube-api-access-tvb8g\") pod \"monitoring-plugin-589576dfc7-gn4bj\" (UID: \"539644f6-8272-40bc-bae1-deb259490985\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj" Jun 13 03:48:12.340946 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.340923 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539644f6-8272-40bc-bae1-deb259490985-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-gn4bj\" (UID: \"539644f6-8272-40bc-bae1-deb259490985\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj" Jun 13 03:48:12.346083 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.346051 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvb8g\" (UniqueName: \"kubernetes.io/projected/539644f6-8272-40bc-bae1-deb259490985-kube-api-access-tvb8g\") pod \"monitoring-plugin-589576dfc7-gn4bj\" (UID: \"539644f6-8272-40bc-bae1-deb259490985\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj" Jun 13 03:48:12.456622 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.456563 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj" Jun 13 03:48:12.575716 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.575542 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj"] Jun 13 03:48:12.578001 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:48:12.577976 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539644f6_8272_40bc_bae1_deb259490985.slice/crio-38ff2973193b397303b9d0f5c511581f3806d0b0f9aa844e47bc53adcb246e85 WatchSource:0}: Error finding container 38ff2973193b397303b9d0f5c511581f3806d0b0f9aa844e47bc53adcb246e85: Status 404 returned error can't find the container with id 38ff2973193b397303b9d0f5c511581f3806d0b0f9aa844e47bc53adcb246e85 Jun 13 03:48:12.786981 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.786916 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj" event={"ID":"539644f6-8272-40bc-bae1-deb259490985","Type":"ContainerStarted","Data":"38ff2973193b397303b9d0f5c511581f3806d0b0f9aa844e47bc53adcb246e85"} Jun 13 03:48:12.942953 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.942926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:48:12.945087 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:12.945061 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2f1c7f-0403-4a8d-b546-53e9a0cde19a-metrics-certs\") pod \"network-metrics-daemon-5gtcb\" (UID: \"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a\") " pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:48:13.114897 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:13.114828 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7pdj\"" Jun 13 03:48:13.122277 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:13.122228 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gtcb" Jun 13 03:48:13.255201 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:13.255177 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5gtcb"] Jun 13 03:48:13.257305 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:48:13.257280 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2f1c7f_0403_4a8d_b546_53e9a0cde19a.slice/crio-56166a56d998fd39c6cd858ceccbbe62029b4f8452c08c25c4c22bf27df08e3a WatchSource:0}: Error finding container 56166a56d998fd39c6cd858ceccbbe62029b4f8452c08c25c4c22bf27df08e3a: Status 404 returned error can't find the container with id 56166a56d998fd39c6cd858ceccbbe62029b4f8452c08c25c4c22bf27df08e3a Jun 13 03:48:13.796909 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:13.796859 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5gtcb" event={"ID":"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a","Type":"ContainerStarted","Data":"56166a56d998fd39c6cd858ceccbbe62029b4f8452c08c25c4c22bf27df08e3a"} Jun 13 03:48:14.803005 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:14.802914 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5gtcb" event={"ID":"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a","Type":"ContainerStarted","Data":"200318d1bf5381b80070d5dcf1ace87834bedcbf4476bc428f68819940426b4c"} Jun 13 03:48:14.803005 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:14.802976 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5gtcb" event={"ID":"0b2f1c7f-0403-4a8d-b546-53e9a0cde19a","Type":"ContainerStarted","Data":"0821999d19ee42c78369eba9e560140354be18a48c04448c7b16ddb6df5cc5fb"} Jun 13 03:48:14.804475 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:14.804452 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj" event={"ID":"539644f6-8272-40bc-bae1-deb259490985","Type":"ContainerStarted","Data":"b87be096d58bc5cb6509e5ed39a2ac43d04f427c8c79d1a1b437aa23af9459ad"} Jun 13 03:48:14.804661 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:14.804645 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj" Jun 13 03:48:14.809673 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:14.809656 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj" Jun 13 03:48:14.818631 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:14.818593 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5gtcb" podStartSLOduration=252.649399235 podStartE2EDuration="4m13.818581091s" totalImagesPullingTime="1.169181856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:14.818292103 +0000 UTC m=+254.291785855" watchObservedRunningTime="2026-06-13 03:48:14.818581091 +0000 UTC m=+254.292074845" Jun 13 03:48:14.835069 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:14.835033 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-gn4bj" podStartSLOduration=1.552664013 podStartE2EDuration="2.835026022s" totalImagesPullingTime="1.282362009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:14.834842868 +0000 UTC m=+254.308336620" watchObservedRunningTime="2026-06-13 03:48:14.835026022 +0000 UTC m=+254.308519774" Jun 13 03:48:15.098752 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:15.098680 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67bcc4c686-vqsnc"] Jun 13 03:48:40.117832 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:40.117742 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67bcc4c686-vqsnc" podUID="323ab6f0-78e0-44d2-8658-532dc6e2eee1" containerName="console" containerID="cri-o://a7b65efc3e177a666b900b80ee293eecfbe38987e9c88e92c80a293c389d21e8" gracePeriod=15 Jun 13 03:48:41.493164 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:48:41.493117 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6689668959-dbhfg" podUID="9b252320-ad5b-4490-bcd3-dc01e9179b81" Jun 13 03:48:41.493164 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:48:41.493118 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6hg4s" podUID="25d12dad-debe-46e1-9e8a-5bc09754f000" Jun 13 03:48:41.893795 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:41.893765 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:48:41.893984 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:41.893766 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hg4s" Jun 13 03:48:45.172988 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.172921 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:48:45.175144 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.175114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") pod \"image-registry-6689668959-dbhfg\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:48:45.197725 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.197703 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wrg5q\"" Jun 13 03:48:45.205803 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.205786 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:48:45.331981 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.331956 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6689668959-dbhfg"] Jun 13 03:48:45.334113 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:48:45.334082 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b252320_ad5b_4490_bcd3_dc01e9179b81.slice/crio-8c55e65dcf710d57a3a18217ac8c04b9d7e2d9b0b8f5973c667dcc03eb945ea1 WatchSource:0}: Error finding container 8c55e65dcf710d57a3a18217ac8c04b9d7e2d9b0b8f5973c667dcc03eb945ea1: Status 404 returned error can't find the container with id 8c55e65dcf710d57a3a18217ac8c04b9d7e2d9b0b8f5973c667dcc03eb945ea1 Jun 13 03:48:45.374303 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.374280 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:48:45.376622 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.376597 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d12dad-debe-46e1-9e8a-5bc09754f000-metrics-tls\") pod \"dns-default-6hg4s\" (UID: \"25d12dad-debe-46e1-9e8a-5bc09754f000\") " pod="openshift-dns/dns-default-6hg4s" Jun 13 03:48:45.496944 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.496882 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-stzhf\"" Jun 13 03:48:45.504870 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.504848 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hg4s" Jun 13 03:48:45.626098 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.626074 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6hg4s"] Jun 13 03:48:45.627692 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:48:45.627659 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d12dad_debe_46e1_9e8a_5bc09754f000.slice/crio-a9758e6c7cfecf3ae7629318559a21127348ef4b843f107b8f1cb90088e23416 WatchSource:0}: Error finding container a9758e6c7cfecf3ae7629318559a21127348ef4b843f107b8f1cb90088e23416: Status 404 returned error can't find the container with id a9758e6c7cfecf3ae7629318559a21127348ef4b843f107b8f1cb90088e23416 Jun 13 03:48:45.913312 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.913279 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hg4s" event={"ID":"25d12dad-debe-46e1-9e8a-5bc09754f000","Type":"ContainerStarted","Data":"a9758e6c7cfecf3ae7629318559a21127348ef4b843f107b8f1cb90088e23416"} Jun 13 03:48:45.914799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.914775 2562 generic.go:356] "Generic (PLEG): container finished" podID="94f26210-0f47-4364-9179-63392b1623f4" containerID="e5465bae34691f642c19ff5f58800d39e0fd4270f634ce4afa989c77fc78a583" exitCode=0 Jun 13 03:48:45.914929 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.914814 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" event={"ID":"94f26210-0f47-4364-9179-63392b1623f4","Type":"ContainerDied","Data":"e5465bae34691f642c19ff5f58800d39e0fd4270f634ce4afa989c77fc78a583"} Jun 13 03:48:45.915162 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.915148 2562 scope.go:117] "RemoveContainer" containerID="e5465bae34691f642c19ff5f58800d39e0fd4270f634ce4afa989c77fc78a583" Jun 13 03:48:45.916390 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.916345 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6689668959-dbhfg" event={"ID":"9b252320-ad5b-4490-bcd3-dc01e9179b81","Type":"ContainerStarted","Data":"67cad8b31338b4f1e8dd7f2f1577dc7cfa561aaed6dd15bb4a1d1ac505b089a0"} Jun 13 03:48:45.916483 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.916409 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6689668959-dbhfg" event={"ID":"9b252320-ad5b-4490-bcd3-dc01e9179b81","Type":"ContainerStarted","Data":"8c55e65dcf710d57a3a18217ac8c04b9d7e2d9b0b8f5973c667dcc03eb945ea1"} Jun 13 03:48:45.916483 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.916432 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:48:45.947997 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:45.947958 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6689668959-dbhfg" podStartSLOduration=284.947940332 podStartE2EDuration="4m44.947940332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:45.947425217 +0000 UTC m=+285.420918985" watchObservedRunningTime="2026-06-13 03:48:45.947940332 +0000 UTC m=+285.421434120" Jun 13 03:48:46.923341 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:46.923282 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9t5v4" event={"ID":"94f26210-0f47-4364-9179-63392b1623f4","Type":"ContainerStarted","Data":"d4e5046612af96d10fd88ff6c300cbec7ea3ada45abe05a3878d269063d78c9a"} Jun 13 03:48:47.932405 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:47.932374 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hg4s" event={"ID":"25d12dad-debe-46e1-9e8a-5bc09754f000","Type":"ContainerStarted","Data":"652a2a0a91ffd2eb4167151b71e1321247e7470565dd94df21317335eaf48afd"} Jun 13 03:48:47.932806 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:47.932445 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hg4s" event={"ID":"25d12dad-debe-46e1-9e8a-5bc09754f000","Type":"ContainerStarted","Data":"c5dd574052b532c43e78f46aaadfb19a30d70888b7b9c351659477380a19e865"} Jun 13 03:48:47.932806 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:47.932505 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6hg4s" Jun 13 03:48:47.949437 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:47.949391 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6hg4s" podStartSLOduration=251.349619537 podStartE2EDuration="4m12.949356257s" totalImagesPullingTime="1.59973672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:48:47.947700822 +0000 UTC m=+287.421194577" watchObservedRunningTime="2026-06-13 03:48:47.949356257 +0000 UTC m=+287.422850010" Jun 13 03:48:55.257954 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.257930 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67bcc4c686-vqsnc_323ab6f0-78e0-44d2-8658-532dc6e2eee1/console/0.log" Jun 13 03:48:55.260414 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.260398 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:55.344218 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.344186 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-service-ca\") pod \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " Jun 13 03:48:55.344218 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.344222 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-serving-cert\") pod \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " Jun 13 03:48:55.344483 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.344244 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-oauth-config\") pod \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " Jun 13 03:48:55.344483 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.344263 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-oauth-serving-cert\") pod \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " Jun 13 03:48:55.344483 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.344291 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x69wx\" (UniqueName: \"kubernetes.io/projected/323ab6f0-78e0-44d2-8658-532dc6e2eee1-kube-api-access-x69wx\") pod \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " Jun 13 03:48:55.344483 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.344323 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-config\") pod \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\" (UID: \"323ab6f0-78e0-44d2-8658-532dc6e2eee1\") " Jun 13 03:48:55.344739 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.344707 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-service-ca" (OuterVolumeSpecName: "service-ca") pod "323ab6f0-78e0-44d2-8658-532dc6e2eee1" (UID: "323ab6f0-78e0-44d2-8658-532dc6e2eee1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:48:55.344813 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.344733 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "323ab6f0-78e0-44d2-8658-532dc6e2eee1" (UID: "323ab6f0-78e0-44d2-8658-532dc6e2eee1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:48:55.344866 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.344799 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-config" (OuterVolumeSpecName: "console-config") pod "323ab6f0-78e0-44d2-8658-532dc6e2eee1" (UID: "323ab6f0-78e0-44d2-8658-532dc6e2eee1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:48:55.346667 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.346637 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "323ab6f0-78e0-44d2-8658-532dc6e2eee1" (UID: "323ab6f0-78e0-44d2-8658-532dc6e2eee1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:48:55.346778 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.346708 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "323ab6f0-78e0-44d2-8658-532dc6e2eee1" (UID: "323ab6f0-78e0-44d2-8658-532dc6e2eee1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:48:55.346819 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.346777 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/323ab6f0-78e0-44d2-8658-532dc6e2eee1-kube-api-access-x69wx" (OuterVolumeSpecName: "kube-api-access-x69wx") pod "323ab6f0-78e0-44d2-8658-532dc6e2eee1" (UID: "323ab6f0-78e0-44d2-8658-532dc6e2eee1"). InnerVolumeSpecName "kube-api-access-x69wx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:48:55.444964 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.444933 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-config\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:48:55.444964 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.444961 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-service-ca\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:48:55.444964 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.444969 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-serving-cert\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:48:55.445181 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.444978 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/323ab6f0-78e0-44d2-8658-532dc6e2eee1-console-oauth-config\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:48:55.445181 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.444987 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/323ab6f0-78e0-44d2-8658-532dc6e2eee1-oauth-serving-cert\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:48:55.445181 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.444995 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x69wx\" (UniqueName: \"kubernetes.io/projected/323ab6f0-78e0-44d2-8658-532dc6e2eee1-kube-api-access-x69wx\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:48:55.963445 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.963414 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67bcc4c686-vqsnc_323ab6f0-78e0-44d2-8658-532dc6e2eee1/console/0.log" Jun 13 03:48:55.963635 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.963469 2562 generic.go:356] "Generic (PLEG): container finished" podID="323ab6f0-78e0-44d2-8658-532dc6e2eee1" containerID="a7b65efc3e177a666b900b80ee293eecfbe38987e9c88e92c80a293c389d21e8" exitCode=137 Jun 13 03:48:55.963635 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.963516 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bcc4c686-vqsnc" event={"ID":"323ab6f0-78e0-44d2-8658-532dc6e2eee1","Type":"ContainerDied","Data":"a7b65efc3e177a666b900b80ee293eecfbe38987e9c88e92c80a293c389d21e8"} Jun 13 03:48:55.963635 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.963530 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bcc4c686-vqsnc" Jun 13 03:48:55.963635 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.963565 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bcc4c686-vqsnc" event={"ID":"323ab6f0-78e0-44d2-8658-532dc6e2eee1","Type":"ContainerDied","Data":"14e0efc823c4c476d7d3dad89d64dc28fd5fc3e2a7f8a3d8e7fc674905ee63f0"} Jun 13 03:48:55.963635 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.963607 2562 scope.go:117] "RemoveContainer" containerID="a7b65efc3e177a666b900b80ee293eecfbe38987e9c88e92c80a293c389d21e8" Jun 13 03:48:55.973960 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.973939 2562 scope.go:117] "RemoveContainer" containerID="a7b65efc3e177a666b900b80ee293eecfbe38987e9c88e92c80a293c389d21e8" Jun 13 03:48:55.974211 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:48:55.974192 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7b65efc3e177a666b900b80ee293eecfbe38987e9c88e92c80a293c389d21e8\": container with ID starting with a7b65efc3e177a666b900b80ee293eecfbe38987e9c88e92c80a293c389d21e8 not found: ID does not exist" containerID="a7b65efc3e177a666b900b80ee293eecfbe38987e9c88e92c80a293c389d21e8" Jun 13 03:48:55.974265 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.974218 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7b65efc3e177a666b900b80ee293eecfbe38987e9c88e92c80a293c389d21e8"} err="failed to get container status \"a7b65efc3e177a666b900b80ee293eecfbe38987e9c88e92c80a293c389d21e8\": rpc error: code = NotFound desc = could not find container \"a7b65efc3e177a666b900b80ee293eecfbe38987e9c88e92c80a293c389d21e8\": container with ID starting with a7b65efc3e177a666b900b80ee293eecfbe38987e9c88e92c80a293c389d21e8 not found: ID does not exist" Jun 13 03:48:55.984054 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.984031 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67bcc4c686-vqsnc"] Jun 13 03:48:55.987902 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:55.987882 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67bcc4c686-vqsnc"] Jun 13 03:48:57.014855 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:57.014822 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="323ab6f0-78e0-44d2-8658-532dc6e2eee1" path="/var/lib/kubelet/pods/323ab6f0-78e0-44d2-8658-532dc6e2eee1/volumes" Jun 13 03:48:57.938702 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:57.938676 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6hg4s" Jun 13 03:48:59.981875 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:59.981842 2562 generic.go:356] "Generic (PLEG): container finished" podID="64784d09-dfc8-4eb6-9c95-467ba97ef359" containerID="5ef7784b0c3ea0c58a4c6b74d56da97c09698fbda157ef0c60e72ed59d633818" exitCode=0 Jun 13 03:48:59.982176 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:59.981870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" event={"ID":"64784d09-dfc8-4eb6-9c95-467ba97ef359","Type":"ContainerDied","Data":"5ef7784b0c3ea0c58a4c6b74d56da97c09698fbda157ef0c60e72ed59d633818"} Jun 13 03:48:59.982233 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:59.982217 2562 scope.go:117] "RemoveContainer" containerID="5ef7784b0c3ea0c58a4c6b74d56da97c09698fbda157ef0c60e72ed59d633818" Jun 13 03:48:59.983577 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:59.983553 2562 generic.go:356] "Generic (PLEG): container finished" podID="382e45c6-a956-438f-b519-9e378ff06578" containerID="d3a9627410e18d3bd06206794fbfd65efa1ede82b8ab3febba080cb22e812162" exitCode=0 Jun 13 03:48:59.983649 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:59.983598 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" event={"ID":"382e45c6-a956-438f-b519-9e378ff06578","Type":"ContainerDied","Data":"d3a9627410e18d3bd06206794fbfd65efa1ede82b8ab3febba080cb22e812162"} Jun 13 03:48:59.983870 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:48:59.983858 2562 scope.go:117] "RemoveContainer" containerID="d3a9627410e18d3bd06206794fbfd65efa1ede82b8ab3febba080cb22e812162" Jun 13 03:49:00.957260 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:00.957235 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 03:49:00.959737 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:00.959706 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 03:49:00.965804 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:00.965761 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 13 03:49:00.988524 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:00.988496 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5p4vh" event={"ID":"64784d09-dfc8-4eb6-9c95-467ba97ef359","Type":"ContainerStarted","Data":"9df52dbd3581abfc79602447601d991154065a9e817d46306d9e1f7a0067f78e"} Jun 13 03:49:00.990162 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:00.990134 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-ptfx4" event={"ID":"382e45c6-a956-438f-b519-9e378ff06578","Type":"ContainerStarted","Data":"e53e34db6a10a12dc660645da2bb5da529d2381f7bc386134f5a1402cb9b5a3a"} Jun 13 03:49:03.970379 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:03.970329 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-q7t5r_9252b71e-443e-4ff4-a6ea-6b46dbb948af/cluster-monitoring-operator/0.log" Jun 13 03:49:04.969031 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:04.968996 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-gn4bj_539644f6-8272-40bc-bae1-deb259490985/monitoring-plugin/0.log" Jun 13 03:49:05.169084 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:05.169054 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jwwp_c513ac26-f582-4b70-9770-7fbe8ab17742/init-textfile/0.log" Jun 13 03:49:05.210214 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:05.210183 2562 patch_prober.go:28] interesting pod/image-registry-6689668959-dbhfg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 03:49:05.210405 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:05.210229 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6689668959-dbhfg" podUID="9b252320-ad5b-4490-bcd3-dc01e9179b81" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 03:49:05.369642 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:05.369576 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jwwp_c513ac26-f582-4b70-9770-7fbe8ab17742/node-exporter/0.log" Jun 13 03:49:05.568972 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:05.568941 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jwwp_c513ac26-f582-4b70-9770-7fbe8ab17742/kube-rbac-proxy/0.log" Jun 13 03:49:06.927574 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:06.927547 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:49:08.970226 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:08.970193 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-dfmng_05decfcf-3583-4a7f-bc0e-30c7fd6eb459/prometheus-operator/0.log" Jun 13 03:49:09.168810 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:09.168779 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-dfmng_05decfcf-3583-4a7f-bc0e-30c7fd6eb459/kube-rbac-proxy/0.log" Jun 13 03:49:11.973676 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:11.973648 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hg4s_25d12dad-debe-46e1-9e8a-5bc09754f000/dns/0.log" Jun 13 03:49:12.169220 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:12.169193 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hg4s_25d12dad-debe-46e1-9e8a-5bc09754f000/kube-rbac-proxy/0.log" Jun 13 03:49:13.568305 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:13.568280 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6sff_af08c78b-69e1-421a-8df3-73fa59c36e18/dns-node-resolver/0.log" Jun 13 03:49:13.769428 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:13.769403 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6689668959-dbhfg_9b252320-ad5b-4490-bcd3-dc01e9179b81/registry/0.log" Jun 13 03:49:14.568924 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:14.568897 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gzqcn_9b69f037-b1a8-47bf-b468-b48b84405b26/node-ca/0.log" Jun 13 03:49:14.969074 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:14.969047 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c4d6ff5b6-pptlr_59846397-d812-442b-a8f6-40f0f5d01cf5/router/0.log" Jun 13 03:49:15.170079 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:15.170053 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5sz5d_071690c8-fde4-4021-9197-658b91d47206/serve-healthcheck-canary/0.log" Jun 13 03:49:20.010097 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:20.010061 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6689668959-dbhfg"] Jun 13 03:49:35.852760 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.852708 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6599d884cd-kmxsq"] Jun 13 03:49:35.854284 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.854254 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323ab6f0-78e0-44d2-8658-532dc6e2eee1" containerName="console" Jun 13 03:49:35.854483 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.854469 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="323ab6f0-78e0-44d2-8658-532dc6e2eee1" containerName="console" Jun 13 03:49:35.854722 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.854709 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="323ab6f0-78e0-44d2-8658-532dc6e2eee1" containerName="console" Jun 13 03:49:35.860053 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.860026 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:35.862681 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.862649 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7kzdx\"" Jun 13 03:49:35.862984 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.862957 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6599d884cd-kmxsq"] Jun 13 03:49:35.863551 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.863530 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 13 03:49:35.863714 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.863681 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 13 03:49:35.864057 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.863556 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 13 03:49:35.864283 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.863589 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 13 03:49:35.864459 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.863656 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 13 03:49:35.864581 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.863704 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 13 03:49:35.864659 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.863540 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 13 03:49:35.870179 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.869983 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 13 03:49:35.956726 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.956693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-serving-cert\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:35.956726 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.956731 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lmsp\" (UniqueName: \"kubernetes.io/projected/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-kube-api-access-9lmsp\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:35.956946 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.956753 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-oauth-config\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:35.956946 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.956838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-service-ca\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:35.956946 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.956859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-trusted-ca-bundle\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:35.956946 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.956878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-config\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:35.956946 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:35.956900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-oauth-serving-cert\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.057375 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.057325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-service-ca\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.057375 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.057372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-trusted-ca-bundle\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.057602 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.057391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-config\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.057602 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.057408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-oauth-serving-cert\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.057602 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.057445 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-serving-cert\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.057602 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.057461 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lmsp\" (UniqueName: \"kubernetes.io/projected/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-kube-api-access-9lmsp\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.057602 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.057483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-oauth-config\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.058172 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.058146 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-service-ca\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.058295 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.058146 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-config\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.058417 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.058394 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-trusted-ca-bundle\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.058496 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.058482 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-oauth-serving-cert\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.060518 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.060490 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-oauth-config\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.060975 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.060931 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-serving-cert\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.065877 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.065848 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lmsp\" (UniqueName: \"kubernetes.io/projected/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-kube-api-access-9lmsp\") pod \"console-6599d884cd-kmxsq\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.172931 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.172888 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:36.298544 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:36.298509 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6599d884cd-kmxsq"] Jun 13 03:49:36.301155 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:49:36.301131 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5562e5f1_d3c6_4ab4_941a_6055823e8bb3.slice/crio-fc5343a85b8692d7dcca56b12b94d9b3ed67813f5ea639bffd631dd34348b80b WatchSource:0}: Error finding container fc5343a85b8692d7dcca56b12b94d9b3ed67813f5ea639bffd631dd34348b80b: Status 404 returned error can't find the container with id fc5343a85b8692d7dcca56b12b94d9b3ed67813f5ea639bffd631dd34348b80b Jun 13 03:49:37.123009 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:37.122975 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6599d884cd-kmxsq" event={"ID":"5562e5f1-d3c6-4ab4-941a-6055823e8bb3","Type":"ContainerStarted","Data":"a13315ed1ff91ebdc471d96d8ff255ace68d3362a45c98e0dabf11ec9d2a7e1a"} Jun 13 03:49:37.123390 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:37.123030 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6599d884cd-kmxsq" event={"ID":"5562e5f1-d3c6-4ab4-941a-6055823e8bb3","Type":"ContainerStarted","Data":"fc5343a85b8692d7dcca56b12b94d9b3ed67813f5ea639bffd631dd34348b80b"} Jun 13 03:49:37.142859 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:37.142813 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6599d884cd-kmxsq" podStartSLOduration=2.142798819 podStartE2EDuration="2.142798819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:49:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:49:37.141614131 +0000 UTC m=+336.615107885" watchObservedRunningTime="2026-06-13 03:49:37.142798819 +0000 UTC m=+336.616292574" Jun 13 03:49:45.038669 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.038629 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6689668959-dbhfg" podUID="9b252320-ad5b-4490-bcd3-dc01e9179b81" containerName="registry" containerID="cri-o://67cad8b31338b4f1e8dd7f2f1577dc7cfa561aaed6dd15bb4a1d1ac505b089a0" gracePeriod=30 Jun 13 03:49:45.155504 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.155428 2562 generic.go:356] "Generic (PLEG): container finished" podID="9b252320-ad5b-4490-bcd3-dc01e9179b81" containerID="67cad8b31338b4f1e8dd7f2f1577dc7cfa561aaed6dd15bb4a1d1ac505b089a0" exitCode=0 Jun 13 03:49:45.155577 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.155498 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6689668959-dbhfg" event={"ID":"9b252320-ad5b-4490-bcd3-dc01e9179b81","Type":"ContainerDied","Data":"67cad8b31338b4f1e8dd7f2f1577dc7cfa561aaed6dd15bb4a1d1ac505b089a0"} Jun 13 03:49:45.274266 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.274242 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:49:45.423308 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.423286 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-bound-sa-token\") pod \"9b252320-ad5b-4490-bcd3-dc01e9179b81\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " Jun 13 03:49:45.423489 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.423316 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") pod \"9b252320-ad5b-4490-bcd3-dc01e9179b81\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " Jun 13 03:49:45.423489 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.423347 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b252320-ad5b-4490-bcd3-dc01e9179b81-image-registry-private-configuration\") pod \"9b252320-ad5b-4490-bcd3-dc01e9179b81\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " Jun 13 03:49:45.423489 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.423389 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp6p2\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-kube-api-access-sp6p2\") pod \"9b252320-ad5b-4490-bcd3-dc01e9179b81\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " Jun 13 03:49:45.423489 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.423417 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b252320-ad5b-4490-bcd3-dc01e9179b81-ca-trust-extracted\") pod \"9b252320-ad5b-4490-bcd3-dc01e9179b81\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " Jun 13 03:49:45.423489 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.423463 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b252320-ad5b-4490-bcd3-dc01e9179b81-trusted-ca\") pod \"9b252320-ad5b-4490-bcd3-dc01e9179b81\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " Jun 13 03:49:45.423740 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.423497 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-certificates\") pod \"9b252320-ad5b-4490-bcd3-dc01e9179b81\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " Jun 13 03:49:45.423740 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.423525 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b252320-ad5b-4490-bcd3-dc01e9179b81-installation-pull-secrets\") pod \"9b252320-ad5b-4490-bcd3-dc01e9179b81\" (UID: \"9b252320-ad5b-4490-bcd3-dc01e9179b81\") " Jun 13 03:49:45.424595 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.424385 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9b252320-ad5b-4490-bcd3-dc01e9179b81" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:49:45.425703 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.424763 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b252320-ad5b-4490-bcd3-dc01e9179b81-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9b252320-ad5b-4490-bcd3-dc01e9179b81" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:49:45.426738 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.426706 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9b252320-ad5b-4490-bcd3-dc01e9179b81" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:49:45.431502 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.431304 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b252320-ad5b-4490-bcd3-dc01e9179b81-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9b252320-ad5b-4490-bcd3-dc01e9179b81" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:49:45.431723 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.431693 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-kube-api-access-sp6p2" (OuterVolumeSpecName: "kube-api-access-sp6p2") pod "9b252320-ad5b-4490-bcd3-dc01e9179b81" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81"). InnerVolumeSpecName "kube-api-access-sp6p2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:49:45.431838 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.431693 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b252320-ad5b-4490-bcd3-dc01e9179b81-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9b252320-ad5b-4490-bcd3-dc01e9179b81" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:49:45.432121 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.431946 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9b252320-ad5b-4490-bcd3-dc01e9179b81" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:49:45.435703 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.435678 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b252320-ad5b-4490-bcd3-dc01e9179b81-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9b252320-ad5b-4490-bcd3-dc01e9179b81" (UID: "9b252320-ad5b-4490-bcd3-dc01e9179b81"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:49:45.525203 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.525181 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-bound-sa-token\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:49:45.525203 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.525201 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-tls\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:49:45.525316 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.525210 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b252320-ad5b-4490-bcd3-dc01e9179b81-image-registry-private-configuration\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:49:45.525316 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.525219 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp6p2\" (UniqueName: \"kubernetes.io/projected/9b252320-ad5b-4490-bcd3-dc01e9179b81-kube-api-access-sp6p2\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:49:45.525316 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.525228 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b252320-ad5b-4490-bcd3-dc01e9179b81-ca-trust-extracted\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:49:45.525316 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.525236 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b252320-ad5b-4490-bcd3-dc01e9179b81-trusted-ca\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:49:45.525316 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.525245 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b252320-ad5b-4490-bcd3-dc01e9179b81-registry-certificates\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:49:45.525316 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:45.525252 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b252320-ad5b-4490-bcd3-dc01e9179b81-installation-pull-secrets\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:49:46.160052 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:46.160017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6689668959-dbhfg" event={"ID":"9b252320-ad5b-4490-bcd3-dc01e9179b81","Type":"ContainerDied","Data":"8c55e65dcf710d57a3a18217ac8c04b9d7e2d9b0b8f5973c667dcc03eb945ea1"} Jun 13 03:49:46.160052 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:46.160029 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6689668959-dbhfg" Jun 13 03:49:46.160516 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:46.160063 2562 scope.go:117] "RemoveContainer" containerID="67cad8b31338b4f1e8dd7f2f1577dc7cfa561aaed6dd15bb4a1d1ac505b089a0" Jun 13 03:49:46.173410 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:46.173392 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:46.173493 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:46.173446 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:46.177873 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:46.177856 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:49:46.180491 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:46.180469 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6689668959-dbhfg"] Jun 13 03:49:46.183814 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:46.183796 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6689668959-dbhfg"] Jun 13 03:49:47.014894 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:47.014858 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b252320-ad5b-4490-bcd3-dc01e9179b81" path="/var/lib/kubelet/pods/9b252320-ad5b-4490-bcd3-dc01e9179b81/volumes" Jun 13 03:49:47.168613 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:49:47.168588 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:50:42.292898 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.292861 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84c796d8ff-nt7sq"] Jun 13 03:50:42.293327 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.293132 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b252320-ad5b-4490-bcd3-dc01e9179b81" containerName="registry" Jun 13 03:50:42.293327 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.293143 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b252320-ad5b-4490-bcd3-dc01e9179b81" containerName="registry" Jun 13 03:50:42.293327 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.293183 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b252320-ad5b-4490-bcd3-dc01e9179b81" containerName="registry" Jun 13 03:50:42.296141 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.296119 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.307456 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.307432 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c796d8ff-nt7sq"] Jun 13 03:50:42.417232 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.417204 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-trusted-ca-bundle\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.417398 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.417237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-service-ca\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.417398 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.417276 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3211d457-774f-4335-b98b-7655a207c3e4-console-oauth-config\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.417398 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.417328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3211d457-774f-4335-b98b-7655a207c3e4-console-serving-cert\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.417398 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.417382 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-oauth-serving-cert\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.417552 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.417429 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-console-config\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.417552 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.417445 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bztds\" (UniqueName: \"kubernetes.io/projected/3211d457-774f-4335-b98b-7655a207c3e4-kube-api-access-bztds\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.518147 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.518123 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-service-ca\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.518297 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.518159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3211d457-774f-4335-b98b-7655a207c3e4-console-oauth-config\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.518297 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.518178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3211d457-774f-4335-b98b-7655a207c3e4-console-serving-cert\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.518297 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.518193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-oauth-serving-cert\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.518297 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.518221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-console-config\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.518297 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.518235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bztds\" (UniqueName: \"kubernetes.io/projected/3211d457-774f-4335-b98b-7655a207c3e4-kube-api-access-bztds\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.518297 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.518259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-trusted-ca-bundle\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.518889 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.518867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-service-ca\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.519017 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.518995 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-oauth-serving-cert\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.519081 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.519030 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-trusted-ca-bundle\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.519144 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.519112 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-console-config\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.520835 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.520809 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3211d457-774f-4335-b98b-7655a207c3e4-console-serving-cert\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.520916 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.520810 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3211d457-774f-4335-b98b-7655a207c3e4-console-oauth-config\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.525327 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.525304 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bztds\" (UniqueName: \"kubernetes.io/projected/3211d457-774f-4335-b98b-7655a207c3e4-kube-api-access-bztds\") pod \"console-84c796d8ff-nt7sq\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.606453 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.606345 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:42.729005 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:42.728970 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c796d8ff-nt7sq"] Jun 13 03:50:42.731845 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:50:42.731816 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3211d457_774f_4335_b98b_7655a207c3e4.slice/crio-c8420adcc31822fbbd356740c98f32b62b9ce20fae17033224fb4661ffc1cc71 WatchSource:0}: Error finding container c8420adcc31822fbbd356740c98f32b62b9ce20fae17033224fb4661ffc1cc71: Status 404 returned error can't find the container with id c8420adcc31822fbbd356740c98f32b62b9ce20fae17033224fb4661ffc1cc71 Jun 13 03:50:43.365519 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:43.365480 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c796d8ff-nt7sq" event={"ID":"3211d457-774f-4335-b98b-7655a207c3e4","Type":"ContainerStarted","Data":"9acea30520e109f06eb45443811a373172baf9c8ceadc7b49c6095829277889d"} Jun 13 03:50:43.365920 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:43.365536 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c796d8ff-nt7sq" event={"ID":"3211d457-774f-4335-b98b-7655a207c3e4","Type":"ContainerStarted","Data":"c8420adcc31822fbbd356740c98f32b62b9ce20fae17033224fb4661ffc1cc71"} Jun 13 03:50:43.382584 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:43.382535 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84c796d8ff-nt7sq" podStartSLOduration=1.382515638 podStartE2EDuration="1.382515638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:50:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:50:43.380808566 +0000 UTC m=+402.854302320" watchObservedRunningTime="2026-06-13 03:50:43.382515638 +0000 UTC m=+402.856009390" Jun 13 03:50:52.606546 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:52.606504 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:52.607039 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:52.606580 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:52.610909 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:52.610888 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:53.403588 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:53.403558 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:50:53.445938 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:50:53.445905 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6599d884cd-kmxsq"] Jun 13 03:51:18.467067 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.466942 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6599d884cd-kmxsq" podUID="5562e5f1-d3c6-4ab4-941a-6055823e8bb3" containerName="console" containerID="cri-o://a13315ed1ff91ebdc471d96d8ff255ace68d3362a45c98e0dabf11ec9d2a7e1a" gracePeriod=15 Jun 13 03:51:18.703963 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.703935 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:51:18.884301 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.884279 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lmsp\" (UniqueName: \"kubernetes.io/projected/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-kube-api-access-9lmsp\") pod \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " Jun 13 03:51:18.884470 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.884322 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-service-ca\") pod \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " Jun 13 03:51:18.884470 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.884343 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-oauth-serving-cert\") pod \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " Jun 13 03:51:18.884470 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.884411 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-trusted-ca-bundle\") pod \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " Jun 13 03:51:18.884470 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.884439 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-oauth-config\") pod \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " Jun 13 03:51:18.884679 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.884472 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-config\") pod \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " Jun 13 03:51:18.884679 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.884514 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-serving-cert\") pod \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\" (UID: \"5562e5f1-d3c6-4ab4-941a-6055823e8bb3\") " Jun 13 03:51:18.884913 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.884875 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5562e5f1-d3c6-4ab4-941a-6055823e8bb3" (UID: "5562e5f1-d3c6-4ab4-941a-6055823e8bb3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:51:18.884913 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.884901 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-config" (OuterVolumeSpecName: "console-config") pod "5562e5f1-d3c6-4ab4-941a-6055823e8bb3" (UID: "5562e5f1-d3c6-4ab4-941a-6055823e8bb3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:51:18.885098 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.884883 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-service-ca" (OuterVolumeSpecName: "service-ca") pod "5562e5f1-d3c6-4ab4-941a-6055823e8bb3" (UID: "5562e5f1-d3c6-4ab4-941a-6055823e8bb3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:51:18.885098 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.884976 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5562e5f1-d3c6-4ab4-941a-6055823e8bb3" (UID: "5562e5f1-d3c6-4ab4-941a-6055823e8bb3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:51:18.886640 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.886618 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5562e5f1-d3c6-4ab4-941a-6055823e8bb3" (UID: "5562e5f1-d3c6-4ab4-941a-6055823e8bb3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:51:18.886710 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.886650 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5562e5f1-d3c6-4ab4-941a-6055823e8bb3" (UID: "5562e5f1-d3c6-4ab4-941a-6055823e8bb3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:51:18.886710 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.886690 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-kube-api-access-9lmsp" (OuterVolumeSpecName: "kube-api-access-9lmsp") pod "5562e5f1-d3c6-4ab4-941a-6055823e8bb3" (UID: "5562e5f1-d3c6-4ab4-941a-6055823e8bb3"). InnerVolumeSpecName "kube-api-access-9lmsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:51:18.985883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.985856 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-trusted-ca-bundle\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:51:18.985883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.985878 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-oauth-config\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:51:18.985883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.985888 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-config\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:51:18.986077 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.985896 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-console-serving-cert\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:51:18.986077 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.985905 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lmsp\" (UniqueName: \"kubernetes.io/projected/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-kube-api-access-9lmsp\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:51:18.986077 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.985914 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-service-ca\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:51:18.986077 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:18.985922 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5562e5f1-d3c6-4ab4-941a-6055823e8bb3-oauth-serving-cert\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:51:19.495144 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:19.495105 2562 generic.go:356] "Generic (PLEG): container finished" podID="5562e5f1-d3c6-4ab4-941a-6055823e8bb3" containerID="a13315ed1ff91ebdc471d96d8ff255ace68d3362a45c98e0dabf11ec9d2a7e1a" exitCode=0 Jun 13 03:51:19.495650 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:19.495156 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6599d884cd-kmxsq" Jun 13 03:51:19.495650 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:19.495179 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6599d884cd-kmxsq" event={"ID":"5562e5f1-d3c6-4ab4-941a-6055823e8bb3","Type":"ContainerDied","Data":"a13315ed1ff91ebdc471d96d8ff255ace68d3362a45c98e0dabf11ec9d2a7e1a"} Jun 13 03:51:19.495650 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:19.495226 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6599d884cd-kmxsq" event={"ID":"5562e5f1-d3c6-4ab4-941a-6055823e8bb3","Type":"ContainerDied","Data":"fc5343a85b8692d7dcca56b12b94d9b3ed67813f5ea639bffd631dd34348b80b"} Jun 13 03:51:19.495650 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:19.495246 2562 scope.go:117] "RemoveContainer" containerID="a13315ed1ff91ebdc471d96d8ff255ace68d3362a45c98e0dabf11ec9d2a7e1a" Jun 13 03:51:19.503286 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:19.503269 2562 scope.go:117] "RemoveContainer" containerID="a13315ed1ff91ebdc471d96d8ff255ace68d3362a45c98e0dabf11ec9d2a7e1a" Jun 13 03:51:19.503554 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:51:19.503536 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a13315ed1ff91ebdc471d96d8ff255ace68d3362a45c98e0dabf11ec9d2a7e1a\": container with ID starting with a13315ed1ff91ebdc471d96d8ff255ace68d3362a45c98e0dabf11ec9d2a7e1a not found: ID does not exist" containerID="a13315ed1ff91ebdc471d96d8ff255ace68d3362a45c98e0dabf11ec9d2a7e1a" Jun 13 03:51:19.503607 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:19.503561 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a13315ed1ff91ebdc471d96d8ff255ace68d3362a45c98e0dabf11ec9d2a7e1a"} err="failed to get container status \"a13315ed1ff91ebdc471d96d8ff255ace68d3362a45c98e0dabf11ec9d2a7e1a\": rpc error: code = NotFound desc = could not find container \"a13315ed1ff91ebdc471d96d8ff255ace68d3362a45c98e0dabf11ec9d2a7e1a\": container with ID starting with a13315ed1ff91ebdc471d96d8ff255ace68d3362a45c98e0dabf11ec9d2a7e1a not found: ID does not exist" Jun 13 03:51:19.510249 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:19.510230 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6599d884cd-kmxsq"] Jun 13 03:51:19.512083 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:19.512063 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6599d884cd-kmxsq"] Jun 13 03:51:21.016332 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:21.016298 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5562e5f1-d3c6-4ab4-941a-6055823e8bb3" path="/var/lib/kubelet/pods/5562e5f1-d3c6-4ab4-941a-6055823e8bb3/volumes" Jun 13 03:51:46.627523 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.627490 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88"] Jun 13 03:51:46.627934 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.627895 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5562e5f1-d3c6-4ab4-941a-6055823e8bb3" containerName="console" Jun 13 03:51:46.627934 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.627914 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5562e5f1-d3c6-4ab4-941a-6055823e8bb3" containerName="console" Jun 13 03:51:46.628007 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.627987 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5562e5f1-d3c6-4ab4-941a-6055823e8bb3" containerName="console" Jun 13 03:51:46.632453 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.632431 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" Jun 13 03:51:46.634907 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.634881 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 03:51:46.636072 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.636054 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 03:51:46.636151 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.636071 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hf8qg\"" Jun 13 03:51:46.640734 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.640711 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88"] Jun 13 03:51:46.684325 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.684302 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88\" (UID: \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" Jun 13 03:51:46.684472 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.684333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx944\" (UniqueName: \"kubernetes.io/projected/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-kube-api-access-kx944\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88\" (UID: \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" Jun 13 03:51:46.684472 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.684392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88\" (UID: \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" Jun 13 03:51:46.785591 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.785555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88\" (UID: \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" Jun 13 03:51:46.785773 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.785619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88\" (UID: \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" Jun 13 03:51:46.785773 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.785638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx944\" (UniqueName: \"kubernetes.io/projected/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-kube-api-access-kx944\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88\" (UID: \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" Jun 13 03:51:46.786011 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.785988 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88\" (UID: \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" Jun 13 03:51:46.786079 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.785997 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88\" (UID: \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" Jun 13 03:51:46.793446 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.793409 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx944\" (UniqueName: \"kubernetes.io/projected/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-kube-api-access-kx944\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88\" (UID: \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" Jun 13 03:51:46.942182 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:46.942092 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" Jun 13 03:51:47.074789 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:47.074742 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88"] Jun 13 03:51:47.077651 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:51:47.077622 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0460a7_b2fb_48f9_847c_b8fd4aad8eae.slice/crio-caee15cbb13b56118603aaaf3d338cd355af7b1b95d0622983295d81e7f423fd WatchSource:0}: Error finding container caee15cbb13b56118603aaaf3d338cd355af7b1b95d0622983295d81e7f423fd: Status 404 returned error can't find the container with id caee15cbb13b56118603aaaf3d338cd355af7b1b95d0622983295d81e7f423fd Jun 13 03:51:47.080055 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:47.080036 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 03:51:47.597988 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:47.597952 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" event={"ID":"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae","Type":"ContainerStarted","Data":"caee15cbb13b56118603aaaf3d338cd355af7b1b95d0622983295d81e7f423fd"} Jun 13 03:51:53.624725 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:53.624651 2562 generic.go:356] "Generic (PLEG): container finished" podID="3d0460a7-b2fb-48f9-847c-b8fd4aad8eae" containerID="68e155dca68567294d982eb4bcdc52bda7f283b56e17d307304c152339df7fe0" exitCode=0 Jun 13 03:51:53.625060 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:53.624737 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" event={"ID":"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae","Type":"ContainerDied","Data":"68e155dca68567294d982eb4bcdc52bda7f283b56e17d307304c152339df7fe0"} Jun 13 03:51:55.634596 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:55.634568 2562 generic.go:356] "Generic (PLEG): container finished" podID="3d0460a7-b2fb-48f9-847c-b8fd4aad8eae" containerID="693aa80111b4e71d29fec0c068d2bb522aa3d5348971fdad3e7bd8af07500216" exitCode=0 Jun 13 03:51:55.634976 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:51:55.634620 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" event={"ID":"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae","Type":"ContainerDied","Data":"693aa80111b4e71d29fec0c068d2bb522aa3d5348971fdad3e7bd8af07500216"} Jun 13 03:52:01.662998 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:01.662924 2562 generic.go:356] "Generic (PLEG): container finished" podID="3d0460a7-b2fb-48f9-847c-b8fd4aad8eae" containerID="35a26a3fb669c9c2824f421e6e42837c87ffb2f73948a03dc2efab3b5179a2ad" exitCode=0 Jun 13 03:52:01.663304 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:01.663017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" event={"ID":"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae","Type":"ContainerDied","Data":"35a26a3fb669c9c2824f421e6e42837c87ffb2f73948a03dc2efab3b5179a2ad"} Jun 13 03:52:02.784570 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:02.784547 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" Jun 13 03:52:02.911067 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:02.911032 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-util\") pod \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\" (UID: \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\") " Jun 13 03:52:02.911259 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:02.911079 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx944\" (UniqueName: \"kubernetes.io/projected/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-kube-api-access-kx944\") pod \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\" (UID: \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\") " Jun 13 03:52:02.911259 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:02.911129 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-bundle\") pod \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\" (UID: \"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae\") " Jun 13 03:52:02.911777 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:02.911755 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-bundle" (OuterVolumeSpecName: "bundle") pod "3d0460a7-b2fb-48f9-847c-b8fd4aad8eae" (UID: "3d0460a7-b2fb-48f9-847c-b8fd4aad8eae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:52:02.913268 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:02.913239 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-kube-api-access-kx944" (OuterVolumeSpecName: "kube-api-access-kx944") pod "3d0460a7-b2fb-48f9-847c-b8fd4aad8eae" (UID: "3d0460a7-b2fb-48f9-847c-b8fd4aad8eae"). InnerVolumeSpecName "kube-api-access-kx944". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:52:02.915428 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:02.915407 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-util" (OuterVolumeSpecName: "util") pod "3d0460a7-b2fb-48f9-847c-b8fd4aad8eae" (UID: "3d0460a7-b2fb-48f9-847c-b8fd4aad8eae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:52:03.011662 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:03.011632 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-bundle\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:52:03.011662 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:03.011657 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-util\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:52:03.011662 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:03.011667 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx944\" (UniqueName: \"kubernetes.io/projected/3d0460a7-b2fb-48f9-847c-b8fd4aad8eae-kube-api-access-kx944\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:52:03.671773 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:03.671730 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" event={"ID":"3d0460a7-b2fb-48f9-847c-b8fd4aad8eae","Type":"ContainerDied","Data":"caee15cbb13b56118603aaaf3d338cd355af7b1b95d0622983295d81e7f423fd"} Jun 13 03:52:03.671915 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:03.671779 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnts88" Jun 13 03:52:03.671915 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:03.671788 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="caee15cbb13b56118603aaaf3d338cd355af7b1b95d0622983295d81e7f423fd" Jun 13 03:52:09.311055 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.311020 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4"] Jun 13 03:52:09.311508 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.311281 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0460a7-b2fb-48f9-847c-b8fd4aad8eae" containerName="util" Jun 13 03:52:09.311508 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.311292 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0460a7-b2fb-48f9-847c-b8fd4aad8eae" containerName="util" Jun 13 03:52:09.311508 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.311301 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0460a7-b2fb-48f9-847c-b8fd4aad8eae" containerName="pull" Jun 13 03:52:09.311508 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.311307 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0460a7-b2fb-48f9-847c-b8fd4aad8eae" containerName="pull" Jun 13 03:52:09.311508 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.311323 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0460a7-b2fb-48f9-847c-b8fd4aad8eae" containerName="extract" Jun 13 03:52:09.311508 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.311329 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0460a7-b2fb-48f9-847c-b8fd4aad8eae" containerName="extract" Jun 13 03:52:09.311508 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.311418 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d0460a7-b2fb-48f9-847c-b8fd4aad8eae" containerName="extract" Jun 13 03:52:09.315279 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.315262 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4" Jun 13 03:52:09.318143 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.318124 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6zfrm\"" Jun 13 03:52:09.318580 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.318562 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 13 03:52:09.318703 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.318686 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 13 03:52:09.324932 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.324912 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4"] Jun 13 03:52:09.363292 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.363272 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17f0eb08-2859-4f87-a0ec-2ccf62a42c3f-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-r7sl4\" (UID: \"17f0eb08-2859-4f87-a0ec-2ccf62a42c3f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4" Jun 13 03:52:09.363416 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.363301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n44dq\" (UniqueName: \"kubernetes.io/projected/17f0eb08-2859-4f87-a0ec-2ccf62a42c3f-kube-api-access-n44dq\") pod \"cert-manager-operator-controller-manager-57757f7cfc-r7sl4\" (UID: \"17f0eb08-2859-4f87-a0ec-2ccf62a42c3f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4" Jun 13 03:52:09.463650 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.463622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17f0eb08-2859-4f87-a0ec-2ccf62a42c3f-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-r7sl4\" (UID: \"17f0eb08-2859-4f87-a0ec-2ccf62a42c3f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4" Jun 13 03:52:09.463792 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.463656 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n44dq\" (UniqueName: \"kubernetes.io/projected/17f0eb08-2859-4f87-a0ec-2ccf62a42c3f-kube-api-access-n44dq\") pod \"cert-manager-operator-controller-manager-57757f7cfc-r7sl4\" (UID: \"17f0eb08-2859-4f87-a0ec-2ccf62a42c3f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4" Jun 13 03:52:09.464014 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.463995 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17f0eb08-2859-4f87-a0ec-2ccf62a42c3f-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-r7sl4\" (UID: \"17f0eb08-2859-4f87-a0ec-2ccf62a42c3f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4" Jun 13 03:52:09.474763 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.474735 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n44dq\" (UniqueName: \"kubernetes.io/projected/17f0eb08-2859-4f87-a0ec-2ccf62a42c3f-kube-api-access-n44dq\") pod \"cert-manager-operator-controller-manager-57757f7cfc-r7sl4\" (UID: \"17f0eb08-2859-4f87-a0ec-2ccf62a42c3f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4" Jun 13 03:52:09.624044 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.623948 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4" Jun 13 03:52:09.765049 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:09.765018 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4"] Jun 13 03:52:09.768812 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:52:09.768786 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f0eb08_2859_4f87_a0ec_2ccf62a42c3f.slice/crio-c6d2a4bd5f070eddf902fb725ba1ec828c1eb92d0f6dc01a676f8e7583ada58c WatchSource:0}: Error finding container c6d2a4bd5f070eddf902fb725ba1ec828c1eb92d0f6dc01a676f8e7583ada58c: Status 404 returned error can't find the container with id c6d2a4bd5f070eddf902fb725ba1ec828c1eb92d0f6dc01a676f8e7583ada58c Jun 13 03:52:10.701447 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:10.701402 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4" event={"ID":"17f0eb08-2859-4f87-a0ec-2ccf62a42c3f","Type":"ContainerStarted","Data":"c6d2a4bd5f070eddf902fb725ba1ec828c1eb92d0f6dc01a676f8e7583ada58c"} Jun 13 03:52:11.706972 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:11.706932 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4" event={"ID":"17f0eb08-2859-4f87-a0ec-2ccf62a42c3f","Type":"ContainerStarted","Data":"cbd07bfe685518f5d5ae3a64e60b9a7d566645d899b25e46f6a0dba26db57b88"} Jun 13 03:52:11.727076 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:11.727023 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-r7sl4" podStartSLOduration=1.220650661 podStartE2EDuration="2.727004981s" totalImagesPullingTime="1.50635432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:52:11.725599824 +0000 UTC m=+491.199093589" watchObservedRunningTime="2026-06-13 03:52:11.727004981 +0000 UTC m=+491.200498735" Jun 13 03:52:13.033352 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.033320 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk"] Jun 13 03:52:13.035513 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.035494 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" Jun 13 03:52:13.039946 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.039918 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 03:52:13.039946 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.039930 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hf8qg\"" Jun 13 03:52:13.039946 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.039918 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 03:52:13.048745 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.048722 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk"] Jun 13 03:52:13.090693 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.090663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk\" (UID: \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" Jun 13 03:52:13.090810 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.090698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk\" (UID: \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" Jun 13 03:52:13.090810 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.090725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njqns\" (UniqueName: \"kubernetes.io/projected/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-kube-api-access-njqns\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk\" (UID: \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" Jun 13 03:52:13.191602 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.191573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk\" (UID: \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" Jun 13 03:52:13.191711 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.191608 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk\" (UID: \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" Jun 13 03:52:13.191711 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.191631 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njqns\" (UniqueName: \"kubernetes.io/projected/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-kube-api-access-njqns\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk\" (UID: \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" Jun 13 03:52:13.191959 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.191942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk\" (UID: \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" Jun 13 03:52:13.192013 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.191998 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk\" (UID: \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" Jun 13 03:52:13.198800 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.198777 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njqns\" (UniqueName: \"kubernetes.io/projected/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-kube-api-access-njqns\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk\" (UID: \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" Jun 13 03:52:13.344895 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.344835 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" Jun 13 03:52:13.465659 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.465634 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk"] Jun 13 03:52:13.468006 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:52:13.467977 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0dd5ac_ee10_4d24_88fd_eee6664d847f.slice/crio-a2c66f40cfc975089a95fcbce7e94a4c19b14c559884ee23d695c8dc21027aca WatchSource:0}: Error finding container a2c66f40cfc975089a95fcbce7e94a4c19b14c559884ee23d695c8dc21027aca: Status 404 returned error can't find the container with id a2c66f40cfc975089a95fcbce7e94a4c19b14c559884ee23d695c8dc21027aca Jun 13 03:52:13.716078 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.716037 2562 generic.go:356] "Generic (PLEG): container finished" podID="ae0dd5ac-ee10-4d24-88fd-eee6664d847f" containerID="4f9dc4fa44d4071b3501239dada5fe646c14763e2b5a42e3e26c7bac685c0fe0" exitCode=0 Jun 13 03:52:13.716341 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.716124 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" event={"ID":"ae0dd5ac-ee10-4d24-88fd-eee6664d847f","Type":"ContainerDied","Data":"4f9dc4fa44d4071b3501239dada5fe646c14763e2b5a42e3e26c7bac685c0fe0"} Jun 13 03:52:13.716341 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:13.716184 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" event={"ID":"ae0dd5ac-ee10-4d24-88fd-eee6664d847f","Type":"ContainerStarted","Data":"a2c66f40cfc975089a95fcbce7e94a4c19b14c559884ee23d695c8dc21027aca"} Jun 13 03:52:16.152885 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.152850 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-z6f99"] Jun 13 03:52:16.154783 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.154768 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z6f99" Jun 13 03:52:16.157087 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.157066 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dgr25\"" Jun 13 03:52:16.157329 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.157313 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 13 03:52:16.158030 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.158013 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 13 03:52:16.162317 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.162296 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-z6f99"] Jun 13 03:52:16.216220 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.216193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbs2d\" (UniqueName: \"kubernetes.io/projected/f2d26339-9e72-4340-9cb0-48857748d216-kube-api-access-cbs2d\") pod \"cert-manager-cainjector-5d99449ffd-z6f99\" (UID: \"f2d26339-9e72-4340-9cb0-48857748d216\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z6f99" Jun 13 03:52:16.216346 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.216261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2d26339-9e72-4340-9cb0-48857748d216-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-z6f99\" (UID: \"f2d26339-9e72-4340-9cb0-48857748d216\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z6f99" Jun 13 03:52:16.317212 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.317187 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2d26339-9e72-4340-9cb0-48857748d216-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-z6f99\" (UID: \"f2d26339-9e72-4340-9cb0-48857748d216\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z6f99" Jun 13 03:52:16.317325 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.317225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbs2d\" (UniqueName: \"kubernetes.io/projected/f2d26339-9e72-4340-9cb0-48857748d216-kube-api-access-cbs2d\") pod \"cert-manager-cainjector-5d99449ffd-z6f99\" (UID: \"f2d26339-9e72-4340-9cb0-48857748d216\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z6f99" Jun 13 03:52:16.325300 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.325274 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2d26339-9e72-4340-9cb0-48857748d216-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-z6f99\" (UID: \"f2d26339-9e72-4340-9cb0-48857748d216\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z6f99" Jun 13 03:52:16.325420 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.325325 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbs2d\" (UniqueName: \"kubernetes.io/projected/f2d26339-9e72-4340-9cb0-48857748d216-kube-api-access-cbs2d\") pod \"cert-manager-cainjector-5d99449ffd-z6f99\" (UID: \"f2d26339-9e72-4340-9cb0-48857748d216\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-z6f99" Jun 13 03:52:16.472122 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.472040 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z6f99" Jun 13 03:52:16.593447 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.593419 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-z6f99"] Jun 13 03:52:16.595717 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:52:16.595694 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2d26339_9e72_4340_9cb0_48857748d216.slice/crio-e5b80eafb334e3e7fa43296b5369f2607cc1e57828d13f7a9bd9a210c4a88730 WatchSource:0}: Error finding container e5b80eafb334e3e7fa43296b5369f2607cc1e57828d13f7a9bd9a210c4a88730: Status 404 returned error can't find the container with id e5b80eafb334e3e7fa43296b5369f2607cc1e57828d13f7a9bd9a210c4a88730 Jun 13 03:52:16.732035 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.731945 2562 generic.go:356] "Generic (PLEG): container finished" podID="ae0dd5ac-ee10-4d24-88fd-eee6664d847f" containerID="0bfc7b35f93f9efc985f2597cc285718168012b4d9bfbd1627a57d1cd7f6466e" exitCode=0 Jun 13 03:52:16.732176 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.732028 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" event={"ID":"ae0dd5ac-ee10-4d24-88fd-eee6664d847f","Type":"ContainerDied","Data":"0bfc7b35f93f9efc985f2597cc285718168012b4d9bfbd1627a57d1cd7f6466e"} Jun 13 03:52:16.733426 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:16.733391 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z6f99" event={"ID":"f2d26339-9e72-4340-9cb0-48857748d216","Type":"ContainerStarted","Data":"e5b80eafb334e3e7fa43296b5369f2607cc1e57828d13f7a9bd9a210c4a88730"} Jun 13 03:52:17.742413 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:17.742354 2562 generic.go:356] "Generic (PLEG): container finished" podID="ae0dd5ac-ee10-4d24-88fd-eee6664d847f" containerID="bdcae479431f9c39e6cfc27f908677f98cadd8405e9e74cb8785e96571fe4263" exitCode=0 Jun 13 03:52:17.742413 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:17.742401 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" event={"ID":"ae0dd5ac-ee10-4d24-88fd-eee6664d847f","Type":"ContainerDied","Data":"bdcae479431f9c39e6cfc27f908677f98cadd8405e9e74cb8785e96571fe4263"} Jun 13 03:52:19.030094 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.030069 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" Jun 13 03:52:19.139164 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.139141 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njqns\" (UniqueName: \"kubernetes.io/projected/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-kube-api-access-njqns\") pod \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\" (UID: \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\") " Jun 13 03:52:19.139289 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.139179 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-bundle\") pod \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\" (UID: \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\") " Jun 13 03:52:19.139289 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.139250 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-util\") pod \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\" (UID: \"ae0dd5ac-ee10-4d24-88fd-eee6664d847f\") " Jun 13 03:52:19.139699 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.139661 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-bundle" (OuterVolumeSpecName: "bundle") pod "ae0dd5ac-ee10-4d24-88fd-eee6664d847f" (UID: "ae0dd5ac-ee10-4d24-88fd-eee6664d847f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:52:19.141166 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.141139 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-kube-api-access-njqns" (OuterVolumeSpecName: "kube-api-access-njqns") pod "ae0dd5ac-ee10-4d24-88fd-eee6664d847f" (UID: "ae0dd5ac-ee10-4d24-88fd-eee6664d847f"). InnerVolumeSpecName "kube-api-access-njqns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:52:19.146052 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.146023 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-util" (OuterVolumeSpecName: "util") pod "ae0dd5ac-ee10-4d24-88fd-eee6664d847f" (UID: "ae0dd5ac-ee10-4d24-88fd-eee6664d847f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:52:19.240426 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.240398 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-bundle\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:52:19.240426 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.240422 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-util\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:52:19.240426 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.240431 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njqns\" (UniqueName: \"kubernetes.io/projected/ae0dd5ac-ee10-4d24-88fd-eee6664d847f-kube-api-access-njqns\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:52:19.758619 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.758588 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" Jun 13 03:52:19.758619 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.758611 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl27wk" event={"ID":"ae0dd5ac-ee10-4d24-88fd-eee6664d847f","Type":"ContainerDied","Data":"a2c66f40cfc975089a95fcbce7e94a4c19b14c559884ee23d695c8dc21027aca"} Jun 13 03:52:19.758965 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.758684 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2c66f40cfc975089a95fcbce7e94a4c19b14c559884ee23d695c8dc21027aca" Jun 13 03:52:19.760217 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.760188 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z6f99" event={"ID":"f2d26339-9e72-4340-9cb0-48857748d216","Type":"ContainerStarted","Data":"2649c926a629e2d4ec527e8b290c516facd04589c9fd69945a98a146f5c0d398"} Jun 13 03:52:19.775462 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:19.775418 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-z6f99" podStartSLOduration=1.293452746 podStartE2EDuration="3.775405476s" totalImagesPullingTime="2.48195273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:52:19.774582114 +0000 UTC m=+499.248075867" watchObservedRunningTime="2026-06-13 03:52:19.775405476 +0000 UTC m=+499.248899229" Jun 13 03:52:29.027061 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.027025 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz"] Jun 13 03:52:29.027471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.027286 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae0dd5ac-ee10-4d24-88fd-eee6664d847f" containerName="pull" Jun 13 03:52:29.027471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.027297 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae0dd5ac-ee10-4d24-88fd-eee6664d847f" containerName="pull" Jun 13 03:52:29.027471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.027305 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae0dd5ac-ee10-4d24-88fd-eee6664d847f" containerName="extract" Jun 13 03:52:29.027471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.027310 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae0dd5ac-ee10-4d24-88fd-eee6664d847f" containerName="extract" Jun 13 03:52:29.027471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.027322 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae0dd5ac-ee10-4d24-88fd-eee6664d847f" containerName="util" Jun 13 03:52:29.027471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.027327 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae0dd5ac-ee10-4d24-88fd-eee6664d847f" containerName="util" Jun 13 03:52:29.027471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.027395 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae0dd5ac-ee10-4d24-88fd-eee6664d847f" containerName="extract" Jun 13 03:52:29.030526 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.030509 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" Jun 13 03:52:29.032828 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.032805 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hf8qg\"" Jun 13 03:52:29.032928 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.032807 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 03:52:29.033720 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.033702 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 03:52:29.037794 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.037768 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz"] Jun 13 03:52:29.117083 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.117046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz\" (UID: \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" Jun 13 03:52:29.117248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.117091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz\" (UID: \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" Jun 13 03:52:29.117248 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.117146 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xpwt\" (UniqueName: \"kubernetes.io/projected/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-kube-api-access-5xpwt\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz\" (UID: \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" Jun 13 03:52:29.217908 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.217883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz\" (UID: \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" Jun 13 03:52:29.218088 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.217930 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xpwt\" (UniqueName: \"kubernetes.io/projected/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-kube-api-access-5xpwt\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz\" (UID: \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" Jun 13 03:52:29.218088 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.218039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz\" (UID: \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" Jun 13 03:52:29.218316 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.218295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz\" (UID: \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" Jun 13 03:52:29.218403 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.218330 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz\" (UID: \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" Jun 13 03:52:29.225846 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.225828 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xpwt\" (UniqueName: \"kubernetes.io/projected/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-kube-api-access-5xpwt\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz\" (UID: \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" Jun 13 03:52:29.340835 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.340769 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" Jun 13 03:52:29.464155 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.464123 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz"] Jun 13 03:52:29.467720 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:52:29.467690 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d50fc1_6906_4f3c_8b42_6ef4ec002a45.slice/crio-753ddf939a7e201f8d10df1941b7f33dc14f377b7ac8b1f76ff34f25e5bb4def WatchSource:0}: Error finding container 753ddf939a7e201f8d10df1941b7f33dc14f377b7ac8b1f76ff34f25e5bb4def: Status 404 returned error can't find the container with id 753ddf939a7e201f8d10df1941b7f33dc14f377b7ac8b1f76ff34f25e5bb4def Jun 13 03:52:29.804846 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.804808 2562 generic.go:356] "Generic (PLEG): container finished" podID="f7d50fc1-6906-4f3c-8b42-6ef4ec002a45" containerID="43fd934d4a3586fb900a0f0a3aa75e022288c1077315d7552fc969aa8dd21cff" exitCode=0 Jun 13 03:52:29.805047 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.804873 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" event={"ID":"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45","Type":"ContainerDied","Data":"43fd934d4a3586fb900a0f0a3aa75e022288c1077315d7552fc969aa8dd21cff"} Jun 13 03:52:29.805047 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:29.804909 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" event={"ID":"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45","Type":"ContainerStarted","Data":"753ddf939a7e201f8d10df1941b7f33dc14f377b7ac8b1f76ff34f25e5bb4def"} Jun 13 03:52:30.810543 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:30.810506 2562 generic.go:356] "Generic (PLEG): container finished" podID="f7d50fc1-6906-4f3c-8b42-6ef4ec002a45" containerID="4f144b6bf95797985c318e1e003020ea5fd9c2af1df93b133d60ca7585f1afda" exitCode=0 Jun 13 03:52:30.811049 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:30.810599 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" event={"ID":"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45","Type":"ContainerDied","Data":"4f144b6bf95797985c318e1e003020ea5fd9c2af1df93b133d60ca7585f1afda"} Jun 13 03:52:31.816373 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:31.816327 2562 generic.go:356] "Generic (PLEG): container finished" podID="f7d50fc1-6906-4f3c-8b42-6ef4ec002a45" containerID="cbd934bf631676c967a2823e16f854353357243a0b1100d932f716d44b7c4da9" exitCode=0 Jun 13 03:52:31.816761 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:31.816412 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" event={"ID":"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45","Type":"ContainerDied","Data":"cbd934bf631676c967a2823e16f854353357243a0b1100d932f716d44b7c4da9"} Jun 13 03:52:32.943390 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:32.943349 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" Jun 13 03:52:32.967162 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:32.967139 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-fjmkl"] Jun 13 03:52:32.967438 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:32.967424 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d50fc1-6906-4f3c-8b42-6ef4ec002a45" containerName="pull" Jun 13 03:52:32.967438 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:32.967440 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d50fc1-6906-4f3c-8b42-6ef4ec002a45" containerName="pull" Jun 13 03:52:32.967524 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:32.967454 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d50fc1-6906-4f3c-8b42-6ef4ec002a45" containerName="util" Jun 13 03:52:32.967524 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:32.967460 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d50fc1-6906-4f3c-8b42-6ef4ec002a45" containerName="util" Jun 13 03:52:32.967524 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:32.967471 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d50fc1-6906-4f3c-8b42-6ef4ec002a45" containerName="extract" Jun 13 03:52:32.967524 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:32.967477 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d50fc1-6906-4f3c-8b42-6ef4ec002a45" containerName="extract" Jun 13 03:52:32.967524 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:32.967522 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7d50fc1-6906-4f3c-8b42-6ef4ec002a45" containerName="extract" Jun 13 03:52:32.969956 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:32.969938 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fjmkl" Jun 13 03:52:32.972229 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:32.972204 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-k5zwr\"" Jun 13 03:52:32.979516 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:32.979492 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fjmkl"] Jun 13 03:52:33.045391 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.045352 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-util\") pod \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\" (UID: \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\") " Jun 13 03:52:33.045498 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.045399 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-bundle\") pod \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\" (UID: \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\") " Jun 13 03:52:33.045498 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.045460 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xpwt\" (UniqueName: \"kubernetes.io/projected/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-kube-api-access-5xpwt\") pod \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\" (UID: \"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45\") " Jun 13 03:52:33.046203 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.046173 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-bundle" (OuterVolumeSpecName: "bundle") pod "f7d50fc1-6906-4f3c-8b42-6ef4ec002a45" (UID: "f7d50fc1-6906-4f3c-8b42-6ef4ec002a45"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:52:33.047499 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.047476 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-kube-api-access-5xpwt" (OuterVolumeSpecName: "kube-api-access-5xpwt") pod "f7d50fc1-6906-4f3c-8b42-6ef4ec002a45" (UID: "f7d50fc1-6906-4f3c-8b42-6ef4ec002a45"). InnerVolumeSpecName "kube-api-access-5xpwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:52:33.051189 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.051171 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-util" (OuterVolumeSpecName: "util") pod "f7d50fc1-6906-4f3c-8b42-6ef4ec002a45" (UID: "f7d50fc1-6906-4f3c-8b42-6ef4ec002a45"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:52:33.145874 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.145848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bde0c69-2c68-445c-977f-82308cedb7f0-bound-sa-token\") pod \"cert-manager-59c77684cc-fjmkl\" (UID: \"2bde0c69-2c68-445c-977f-82308cedb7f0\") " pod="cert-manager/cert-manager-59c77684cc-fjmkl" Jun 13 03:52:33.145978 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.145879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4lt6\" (UniqueName: \"kubernetes.io/projected/2bde0c69-2c68-445c-977f-82308cedb7f0-kube-api-access-d4lt6\") pod \"cert-manager-59c77684cc-fjmkl\" (UID: \"2bde0c69-2c68-445c-977f-82308cedb7f0\") " pod="cert-manager/cert-manager-59c77684cc-fjmkl" Jun 13 03:52:33.146021 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.145988 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-util\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:52:33.146021 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.146007 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-bundle\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:52:33.146021 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.146016 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xpwt\" (UniqueName: \"kubernetes.io/projected/f7d50fc1-6906-4f3c-8b42-6ef4ec002a45-kube-api-access-5xpwt\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:52:33.246859 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.246825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bde0c69-2c68-445c-977f-82308cedb7f0-bound-sa-token\") pod \"cert-manager-59c77684cc-fjmkl\" (UID: \"2bde0c69-2c68-445c-977f-82308cedb7f0\") " pod="cert-manager/cert-manager-59c77684cc-fjmkl" Jun 13 03:52:33.246859 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.246861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4lt6\" (UniqueName: \"kubernetes.io/projected/2bde0c69-2c68-445c-977f-82308cedb7f0-kube-api-access-d4lt6\") pod \"cert-manager-59c77684cc-fjmkl\" (UID: \"2bde0c69-2c68-445c-977f-82308cedb7f0\") " pod="cert-manager/cert-manager-59c77684cc-fjmkl" Jun 13 03:52:33.254646 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.254618 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bde0c69-2c68-445c-977f-82308cedb7f0-bound-sa-token\") pod \"cert-manager-59c77684cc-fjmkl\" (UID: \"2bde0c69-2c68-445c-977f-82308cedb7f0\") " pod="cert-manager/cert-manager-59c77684cc-fjmkl" Jun 13 03:52:33.254771 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.254753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4lt6\" (UniqueName: \"kubernetes.io/projected/2bde0c69-2c68-445c-977f-82308cedb7f0-kube-api-access-d4lt6\") pod \"cert-manager-59c77684cc-fjmkl\" (UID: \"2bde0c69-2c68-445c-977f-82308cedb7f0\") " pod="cert-manager/cert-manager-59c77684cc-fjmkl" Jun 13 03:52:33.279769 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.279740 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fjmkl" Jun 13 03:52:33.401298 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.401273 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fjmkl"] Jun 13 03:52:33.403228 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:52:33.403200 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bde0c69_2c68_445c_977f_82308cedb7f0.slice/crio-2f1d0e931185e4a393fb8ee94751328fbfd2dab383db640faf809a8fa957de46 WatchSource:0}: Error finding container 2f1d0e931185e4a393fb8ee94751328fbfd2dab383db640faf809a8fa957de46: Status 404 returned error can't find the container with id 2f1d0e931185e4a393fb8ee94751328fbfd2dab383db640faf809a8fa957de46 Jun 13 03:52:33.826920 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.826839 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" Jun 13 03:52:33.826920 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.826870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd55fcz" event={"ID":"f7d50fc1-6906-4f3c-8b42-6ef4ec002a45","Type":"ContainerDied","Data":"753ddf939a7e201f8d10df1941b7f33dc14f377b7ac8b1f76ff34f25e5bb4def"} Jun 13 03:52:33.827103 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.826925 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="753ddf939a7e201f8d10df1941b7f33dc14f377b7ac8b1f76ff34f25e5bb4def" Jun 13 03:52:33.828338 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.828314 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fjmkl" event={"ID":"2bde0c69-2c68-445c-977f-82308cedb7f0","Type":"ContainerStarted","Data":"5735702691af965c08a165326488ba2452f44e340c7b182229f62ba061188d70"} Jun 13 03:52:33.828475 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.828350 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fjmkl" event={"ID":"2bde0c69-2c68-445c-977f-82308cedb7f0","Type":"ContainerStarted","Data":"2f1d0e931185e4a393fb8ee94751328fbfd2dab383db640faf809a8fa957de46"} Jun 13 03:52:33.843420 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:33.843348 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-fjmkl" podStartSLOduration=1.8433335309999999 podStartE2EDuration="1.843333531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:52:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:52:33.842438867 +0000 UTC m=+513.315932643" watchObservedRunningTime="2026-06-13 03:52:33.843333531 +0000 UTC m=+513.316827283" Jun 13 03:52:42.110288 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.110251 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r"] Jun 13 03:52:42.114328 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.114305 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.117470 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.117445 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 13 03:52:42.117585 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.117568 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 13 03:52:42.117652 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.117599 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8f8dz\"" Jun 13 03:52:42.117652 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.117613 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 13 03:52:42.117760 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.117680 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 13 03:52:42.131682 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.131661 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r"] Jun 13 03:52:42.209330 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.209297 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad13c115-060d-4796-82fc-946e59d782a5-manifests\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.209330 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.209333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad13c115-060d-4796-82fc-946e59d782a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.209567 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.209357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4plm\" (UniqueName: \"kubernetes.io/projected/ad13c115-060d-4796-82fc-946e59d782a5-kube-api-access-v4plm\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.209567 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.209445 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad13c115-060d-4796-82fc-946e59d782a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.209567 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.209511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad13c115-060d-4796-82fc-946e59d782a5-tmp\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.310889 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.310857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad13c115-060d-4796-82fc-946e59d782a5-manifests\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.310889 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.310890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad13c115-060d-4796-82fc-946e59d782a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.311107 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.310910 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4plm\" (UniqueName: \"kubernetes.io/projected/ad13c115-060d-4796-82fc-946e59d782a5-kube-api-access-v4plm\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.311107 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.310938 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad13c115-060d-4796-82fc-946e59d782a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.311107 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.310967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad13c115-060d-4796-82fc-946e59d782a5-tmp\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.311401 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.311349 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad13c115-060d-4796-82fc-946e59d782a5-manifests\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.313304 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.313277 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad13c115-060d-4796-82fc-946e59d782a5-tmp\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.313420 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.313340 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad13c115-060d-4796-82fc-946e59d782a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.313667 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.313644 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad13c115-060d-4796-82fc-946e59d782a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.326181 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.326157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4plm\" (UniqueName: \"kubernetes.io/projected/ad13c115-060d-4796-82fc-946e59d782a5-kube-api-access-v4plm\") pod \"opendatahub-operator-controller-manager-7f8b9444ff-cht8r\" (UID: \"ad13c115-060d-4796-82fc-946e59d782a5\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.425973 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.425937 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:42.557206 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.557148 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r"] Jun 13 03:52:42.559404 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:52:42.559378 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad13c115_060d_4796_82fc_946e59d782a5.slice/crio-0bcc6efceae071322cad1d6156e7ee29bba146140558780330096f5cdf994cc3 WatchSource:0}: Error finding container 0bcc6efceae071322cad1d6156e7ee29bba146140558780330096f5cdf994cc3: Status 404 returned error can't find the container with id 0bcc6efceae071322cad1d6156e7ee29bba146140558780330096f5cdf994cc3 Jun 13 03:52:42.867646 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:42.867565 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" event={"ID":"ad13c115-060d-4796-82fc-946e59d782a5","Type":"ContainerStarted","Data":"0bcc6efceae071322cad1d6156e7ee29bba146140558780330096f5cdf994cc3"} Jun 13 03:52:45.884154 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:45.884119 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" event={"ID":"ad13c115-060d-4796-82fc-946e59d782a5","Type":"ContainerStarted","Data":"a9f6fa7bc73efe4ecb1c0f7ca553d2606bacf7e777f2552801bbfe12a06b7247"} Jun 13 03:52:46.889655 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:46.889611 2562 generic.go:356] "Generic (PLEG): container finished" podID="ad13c115-060d-4796-82fc-946e59d782a5" containerID="a9f6fa7bc73efe4ecb1c0f7ca553d2606bacf7e777f2552801bbfe12a06b7247" exitCode=0 Jun 13 03:52:46.890058 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:46.889701 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" event={"ID":"ad13c115-060d-4796-82fc-946e59d782a5","Type":"ContainerDied","Data":"a9f6fa7bc73efe4ecb1c0f7ca553d2606bacf7e777f2552801bbfe12a06b7247"} Jun 13 03:52:47.898385 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:47.897084 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" event={"ID":"ad13c115-060d-4796-82fc-946e59d782a5","Type":"ContainerStarted","Data":"df37705aa1f82ff757428623f5d545c70c4dc9764db673b77487d67cb281f1e6"} Jun 13 03:52:47.898385 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:47.897858 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:52:47.919014 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:47.918955 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" podStartSLOduration=1.840716033 podStartE2EDuration="5.918933769s" totalImagesPullingTime="3.164360607s" totalInitContainerRuntime="913.857129ms" isStatefulPod=false podCreationTimestamp="2026-06-13 03:52:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:52:47.917429289 +0000 UTC m=+527.390923066" watchObservedRunningTime="2026-06-13 03:52:47.918933769 +0000 UTC m=+527.392427522" Jun 13 03:52:59.908701 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:52:59.908671 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f8b9444ff-cht8r" Jun 13 03:53:02.171745 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.171712 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk"] Jun 13 03:53:02.179910 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.179884 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" Jun 13 03:53:02.182530 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.182507 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j5rvt\"" Jun 13 03:53:02.182530 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.182527 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 13 03:53:02.182702 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.182531 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 13 03:53:02.188436 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.188412 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk"] Jun 13 03:53:02.252028 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.251996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b28d1f-7b4a-44a3-a341-a8917beaebbf-tls-certs\") pod \"kube-auth-proxy-75bd78495b-wmlzk\" (UID: \"74b28d1f-7b4a-44a3-a341-a8917beaebbf\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" Jun 13 03:53:02.252028 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.252029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp2vn\" (UniqueName: \"kubernetes.io/projected/74b28d1f-7b4a-44a3-a341-a8917beaebbf-kube-api-access-gp2vn\") pod \"kube-auth-proxy-75bd78495b-wmlzk\" (UID: \"74b28d1f-7b4a-44a3-a341-a8917beaebbf\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" Jun 13 03:53:02.252245 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.252053 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74b28d1f-7b4a-44a3-a341-a8917beaebbf-tmp\") pod \"kube-auth-proxy-75bd78495b-wmlzk\" (UID: \"74b28d1f-7b4a-44a3-a341-a8917beaebbf\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" Jun 13 03:53:02.260876 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.260849 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-mv47x"] Jun 13 03:53:02.263987 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.263963 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" Jun 13 03:53:02.266306 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.266291 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dqh8n\"" Jun 13 03:53:02.266382 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.266289 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 13 03:53:02.280170 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.280146 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-mv47x"] Jun 13 03:53:02.298957 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.298931 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g"] Jun 13 03:53:02.302161 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.302140 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.304778 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.304756 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 13 03:53:02.305121 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.305101 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 13 03:53:02.305233 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.305198 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 13 03:53:02.305395 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.305376 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 13 03:53:02.305544 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.305525 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tv2km\"" Jun 13 03:53:02.305635 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.305581 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 13 03:53:02.312698 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.312673 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g"] Jun 13 03:53:02.353500 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.353469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjwf4\" (UniqueName: \"kubernetes.io/projected/16ec9cae-ecd4-45f9-97a0-524f68865c3f-kube-api-access-cjwf4\") pod \"odh-model-controller-6dc94f689f-mv47x\" (UID: \"16ec9cae-ecd4-45f9-97a0-524f68865c3f\") " pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" Jun 13 03:53:02.353646 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.353509 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16ec9cae-ecd4-45f9-97a0-524f68865c3f-cert\") pod \"odh-model-controller-6dc94f689f-mv47x\" (UID: \"16ec9cae-ecd4-45f9-97a0-524f68865c3f\") " pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" Jun 13 03:53:02.353646 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.353549 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e4dda2b-69d9-4c16-afa2-10a9cd997788-metrics-cert\") pod \"lws-controller-manager-755dd474c5-gxn2g\" (UID: \"4e4dda2b-69d9-4c16-afa2-10a9cd997788\") " pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.353646 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.353582 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4dda2b-69d9-4c16-afa2-10a9cd997788-cert\") pod \"lws-controller-manager-755dd474c5-gxn2g\" (UID: \"4e4dda2b-69d9-4c16-afa2-10a9cd997788\") " pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.353646 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.353625 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b28d1f-7b4a-44a3-a341-a8917beaebbf-tls-certs\") pod \"kube-auth-proxy-75bd78495b-wmlzk\" (UID: \"74b28d1f-7b4a-44a3-a341-a8917beaebbf\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" Jun 13 03:53:02.353789 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.353652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp2vn\" (UniqueName: \"kubernetes.io/projected/74b28d1f-7b4a-44a3-a341-a8917beaebbf-kube-api-access-gp2vn\") pod \"kube-auth-proxy-75bd78495b-wmlzk\" (UID: \"74b28d1f-7b4a-44a3-a341-a8917beaebbf\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" Jun 13 03:53:02.353789 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.353680 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsp76\" (UniqueName: \"kubernetes.io/projected/4e4dda2b-69d9-4c16-afa2-10a9cd997788-kube-api-access-xsp76\") pod \"lws-controller-manager-755dd474c5-gxn2g\" (UID: \"4e4dda2b-69d9-4c16-afa2-10a9cd997788\") " pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.353789 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.353709 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e4dda2b-69d9-4c16-afa2-10a9cd997788-manager-config\") pod \"lws-controller-manager-755dd474c5-gxn2g\" (UID: \"4e4dda2b-69d9-4c16-afa2-10a9cd997788\") " pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.353789 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.353736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74b28d1f-7b4a-44a3-a341-a8917beaebbf-tmp\") pod \"kube-auth-proxy-75bd78495b-wmlzk\" (UID: \"74b28d1f-7b4a-44a3-a341-a8917beaebbf\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" Jun 13 03:53:02.353789 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:53:02.353756 2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 13 03:53:02.353970 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:53:02.353809 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74b28d1f-7b4a-44a3-a341-a8917beaebbf-tls-certs podName:74b28d1f-7b4a-44a3-a341-a8917beaebbf nodeName:}" failed. No retries permitted until 2026-06-13 03:53:02.853795064 +0000 UTC m=+542.327288795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/74b28d1f-7b4a-44a3-a341-a8917beaebbf-tls-certs") pod "kube-auth-proxy-75bd78495b-wmlzk" (UID: "74b28d1f-7b4a-44a3-a341-a8917beaebbf") : secret "kube-auth-proxy-tls" not found Jun 13 03:53:02.355931 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.355907 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74b28d1f-7b4a-44a3-a341-a8917beaebbf-tmp\") pod \"kube-auth-proxy-75bd78495b-wmlzk\" (UID: \"74b28d1f-7b4a-44a3-a341-a8917beaebbf\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" Jun 13 03:53:02.361886 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.361862 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp2vn\" (UniqueName: \"kubernetes.io/projected/74b28d1f-7b4a-44a3-a341-a8917beaebbf-kube-api-access-gp2vn\") pod \"kube-auth-proxy-75bd78495b-wmlzk\" (UID: \"74b28d1f-7b4a-44a3-a341-a8917beaebbf\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" Jun 13 03:53:02.454966 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.454884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsp76\" (UniqueName: \"kubernetes.io/projected/4e4dda2b-69d9-4c16-afa2-10a9cd997788-kube-api-access-xsp76\") pod \"lws-controller-manager-755dd474c5-gxn2g\" (UID: \"4e4dda2b-69d9-4c16-afa2-10a9cd997788\") " pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.454966 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.454918 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e4dda2b-69d9-4c16-afa2-10a9cd997788-manager-config\") pod \"lws-controller-manager-755dd474c5-gxn2g\" (UID: \"4e4dda2b-69d9-4c16-afa2-10a9cd997788\") " pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.454966 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.454949 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjwf4\" (UniqueName: \"kubernetes.io/projected/16ec9cae-ecd4-45f9-97a0-524f68865c3f-kube-api-access-cjwf4\") pod \"odh-model-controller-6dc94f689f-mv47x\" (UID: \"16ec9cae-ecd4-45f9-97a0-524f68865c3f\") " pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" Jun 13 03:53:02.455217 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.454975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16ec9cae-ecd4-45f9-97a0-524f68865c3f-cert\") pod \"odh-model-controller-6dc94f689f-mv47x\" (UID: \"16ec9cae-ecd4-45f9-97a0-524f68865c3f\") " pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" Jun 13 03:53:02.455217 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.455023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e4dda2b-69d9-4c16-afa2-10a9cd997788-metrics-cert\") pod \"lws-controller-manager-755dd474c5-gxn2g\" (UID: \"4e4dda2b-69d9-4c16-afa2-10a9cd997788\") " pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.455217 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.455048 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4dda2b-69d9-4c16-afa2-10a9cd997788-cert\") pod \"lws-controller-manager-755dd474c5-gxn2g\" (UID: \"4e4dda2b-69d9-4c16-afa2-10a9cd997788\") " pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.455217 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:53:02.455133 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 13 03:53:02.455217 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:53:02.455208 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16ec9cae-ecd4-45f9-97a0-524f68865c3f-cert podName:16ec9cae-ecd4-45f9-97a0-524f68865c3f nodeName:}" failed. No retries permitted until 2026-06-13 03:53:02.955187685 +0000 UTC m=+542.428681430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/16ec9cae-ecd4-45f9-97a0-524f68865c3f-cert") pod "odh-model-controller-6dc94f689f-mv47x" (UID: "16ec9cae-ecd4-45f9-97a0-524f68865c3f") : secret "odh-model-controller-webhook-cert" not found Jun 13 03:53:02.455677 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.455652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e4dda2b-69d9-4c16-afa2-10a9cd997788-manager-config\") pod \"lws-controller-manager-755dd474c5-gxn2g\" (UID: \"4e4dda2b-69d9-4c16-afa2-10a9cd997788\") " pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.457538 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.457515 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e4dda2b-69d9-4c16-afa2-10a9cd997788-cert\") pod \"lws-controller-manager-755dd474c5-gxn2g\" (UID: \"4e4dda2b-69d9-4c16-afa2-10a9cd997788\") " pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.457618 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.457559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e4dda2b-69d9-4c16-afa2-10a9cd997788-metrics-cert\") pod \"lws-controller-manager-755dd474c5-gxn2g\" (UID: \"4e4dda2b-69d9-4c16-afa2-10a9cd997788\") " pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.462689 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.462664 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsp76\" (UniqueName: \"kubernetes.io/projected/4e4dda2b-69d9-4c16-afa2-10a9cd997788-kube-api-access-xsp76\") pod \"lws-controller-manager-755dd474c5-gxn2g\" (UID: \"4e4dda2b-69d9-4c16-afa2-10a9cd997788\") " pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.462882 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.462867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjwf4\" (UniqueName: \"kubernetes.io/projected/16ec9cae-ecd4-45f9-97a0-524f68865c3f-kube-api-access-cjwf4\") pod \"odh-model-controller-6dc94f689f-mv47x\" (UID: \"16ec9cae-ecd4-45f9-97a0-524f68865c3f\") " pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" Jun 13 03:53:02.612884 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.612851 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:02.742304 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.742277 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g"] Jun 13 03:53:02.743862 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:53:02.743839 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4dda2b_69d9_4c16_afa2_10a9cd997788.slice/crio-fea2682791083ff44f0078422e1d103e1cfe41b35b0afbf167a2f13453ce3972 WatchSource:0}: Error finding container fea2682791083ff44f0078422e1d103e1cfe41b35b0afbf167a2f13453ce3972: Status 404 returned error can't find the container with id fea2682791083ff44f0078422e1d103e1cfe41b35b0afbf167a2f13453ce3972 Jun 13 03:53:02.859223 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.859192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b28d1f-7b4a-44a3-a341-a8917beaebbf-tls-certs\") pod \"kube-auth-proxy-75bd78495b-wmlzk\" (UID: \"74b28d1f-7b4a-44a3-a341-a8917beaebbf\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" Jun 13 03:53:02.861544 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.861518 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b28d1f-7b4a-44a3-a341-a8917beaebbf-tls-certs\") pod \"kube-auth-proxy-75bd78495b-wmlzk\" (UID: \"74b28d1f-7b4a-44a3-a341-a8917beaebbf\") " pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" Jun 13 03:53:02.960201 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.960163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16ec9cae-ecd4-45f9-97a0-524f68865c3f-cert\") pod \"odh-model-controller-6dc94f689f-mv47x\" (UID: \"16ec9cae-ecd4-45f9-97a0-524f68865c3f\") " pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" Jun 13 03:53:02.960395 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:53:02.960328 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 13 03:53:02.960438 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:53:02.960408 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16ec9cae-ecd4-45f9-97a0-524f68865c3f-cert podName:16ec9cae-ecd4-45f9-97a0-524f68865c3f nodeName:}" failed. No retries permitted until 2026-06-13 03:53:03.960393071 +0000 UTC m=+543.433886802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/16ec9cae-ecd4-45f9-97a0-524f68865c3f-cert") pod "odh-model-controller-6dc94f689f-mv47x" (UID: "16ec9cae-ecd4-45f9-97a0-524f68865c3f") : secret "odh-model-controller-webhook-cert" not found Jun 13 03:53:02.966340 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:02.966312 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" event={"ID":"4e4dda2b-69d9-4c16-afa2-10a9cd997788","Type":"ContainerStarted","Data":"fea2682791083ff44f0078422e1d103e1cfe41b35b0afbf167a2f13453ce3972"} Jun 13 03:53:03.090220 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:03.090138 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" Jun 13 03:53:03.216648 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:03.214150 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk"] Jun 13 03:53:03.220394 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:53:03.220351 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b28d1f_7b4a_44a3_a341_a8917beaebbf.slice/crio-498319af7a9060e6c3cdbd0470853d4f7da0a89c3621f4fa060108251708fa31 WatchSource:0}: Error finding container 498319af7a9060e6c3cdbd0470853d4f7da0a89c3621f4fa060108251708fa31: Status 404 returned error can't find the container with id 498319af7a9060e6c3cdbd0470853d4f7da0a89c3621f4fa060108251708fa31 Jun 13 03:53:03.968302 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:03.967895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16ec9cae-ecd4-45f9-97a0-524f68865c3f-cert\") pod \"odh-model-controller-6dc94f689f-mv47x\" (UID: \"16ec9cae-ecd4-45f9-97a0-524f68865c3f\") " pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" Jun 13 03:53:03.972601 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:03.972486 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16ec9cae-ecd4-45f9-97a0-524f68865c3f-cert\") pod \"odh-model-controller-6dc94f689f-mv47x\" (UID: \"16ec9cae-ecd4-45f9-97a0-524f68865c3f\") " pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" Jun 13 03:53:03.978340 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:03.978307 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" event={"ID":"74b28d1f-7b4a-44a3-a341-a8917beaebbf","Type":"ContainerStarted","Data":"498319af7a9060e6c3cdbd0470853d4f7da0a89c3621f4fa060108251708fa31"} Jun 13 03:53:03.993014 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:03.992985 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn"] Jun 13 03:53:03.998456 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:03.998433 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" Jun 13 03:53:04.002114 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.002089 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 03:53:04.002859 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.002840 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 03:53:04.003031 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.002778 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hf8qg\"" Jun 13 03:53:04.003658 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.003571 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn"] Jun 13 03:53:04.068847 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.068800 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndvj5\" (UniqueName: \"kubernetes.io/projected/294e135f-2359-4994-82fb-fc8813ab7be8-kube-api-access-ndvj5\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn\" (UID: \"294e135f-2359-4994-82fb-fc8813ab7be8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" Jun 13 03:53:04.069025 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.068870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/294e135f-2359-4994-82fb-fc8813ab7be8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn\" (UID: \"294e135f-2359-4994-82fb-fc8813ab7be8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" Jun 13 03:53:04.069025 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.068924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/294e135f-2359-4994-82fb-fc8813ab7be8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn\" (UID: \"294e135f-2359-4994-82fb-fc8813ab7be8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" Jun 13 03:53:04.073312 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.073287 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" Jun 13 03:53:04.170619 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.170238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndvj5\" (UniqueName: \"kubernetes.io/projected/294e135f-2359-4994-82fb-fc8813ab7be8-kube-api-access-ndvj5\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn\" (UID: \"294e135f-2359-4994-82fb-fc8813ab7be8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" Jun 13 03:53:04.170619 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.170306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/294e135f-2359-4994-82fb-fc8813ab7be8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn\" (UID: \"294e135f-2359-4994-82fb-fc8813ab7be8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" Jun 13 03:53:04.170619 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.170355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/294e135f-2359-4994-82fb-fc8813ab7be8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn\" (UID: \"294e135f-2359-4994-82fb-fc8813ab7be8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" Jun 13 03:53:04.170913 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.170783 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/294e135f-2359-4994-82fb-fc8813ab7be8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn\" (UID: \"294e135f-2359-4994-82fb-fc8813ab7be8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" Jun 13 03:53:04.170913 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.170839 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/294e135f-2359-4994-82fb-fc8813ab7be8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn\" (UID: \"294e135f-2359-4994-82fb-fc8813ab7be8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" Jun 13 03:53:04.178547 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.178503 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndvj5\" (UniqueName: \"kubernetes.io/projected/294e135f-2359-4994-82fb-fc8813ab7be8-kube-api-access-ndvj5\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn\" (UID: \"294e135f-2359-4994-82fb-fc8813ab7be8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" Jun 13 03:53:04.314210 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.314129 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" Jun 13 03:53:04.650465 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.650102 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn"] Jun 13 03:53:04.684797 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.684770 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-mv47x"] Jun 13 03:53:04.986897 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.986859 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" event={"ID":"4e4dda2b-69d9-4c16-afa2-10a9cd997788","Type":"ContainerStarted","Data":"f0625e52bb35ee7d8948fad8090f3cdc7c90e4751b4d1d6169acd93f0e3bfd7a"} Jun 13 03:53:04.987091 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:04.986999 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:05.004247 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:05.004194 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" podStartSLOduration=1.185976551 podStartE2EDuration="3.00417606s" totalImagesPullingTime="1.818199509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:53:05.002990145 +0000 UTC m=+544.476483900" watchObservedRunningTime="2026-06-13 03:53:05.00417606 +0000 UTC m=+544.477669816" Jun 13 03:53:05.995644 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:53:05.995609 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294e135f_2359_4994_82fb_fc8813ab7be8.slice/crio-6b7ae08a2004bbfce419c117d30dbe76484131be76f0dbfa410a2d100ada97d0 WatchSource:0}: Error finding container 6b7ae08a2004bbfce419c117d30dbe76484131be76f0dbfa410a2d100ada97d0: Status 404 returned error can't find the container with id 6b7ae08a2004bbfce419c117d30dbe76484131be76f0dbfa410a2d100ada97d0 Jun 13 03:53:05.996434 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:53:05.996411 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ec9cae_ecd4_45f9_97a0_524f68865c3f.slice/crio-ac24b872ad0ee96f1799d661c2fa44553d1927f61263ba11c8190139dd54df83 WatchSource:0}: Error finding container ac24b872ad0ee96f1799d661c2fa44553d1927f61263ba11c8190139dd54df83: Status 404 returned error can't find the container with id ac24b872ad0ee96f1799d661c2fa44553d1927f61263ba11c8190139dd54df83 Jun 13 03:53:07.001074 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:07.001034 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" event={"ID":"16ec9cae-ecd4-45f9-97a0-524f68865c3f","Type":"ContainerStarted","Data":"ac24b872ad0ee96f1799d661c2fa44553d1927f61263ba11c8190139dd54df83"} Jun 13 03:53:07.003644 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:07.003612 2562 generic.go:356] "Generic (PLEG): container finished" podID="294e135f-2359-4994-82fb-fc8813ab7be8" containerID="2a25b8f19a88faadfe365ebed2e921856969418be8750d0772193f98e603c319" exitCode=0 Jun 13 03:53:07.003780 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:07.003692 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" event={"ID":"294e135f-2359-4994-82fb-fc8813ab7be8","Type":"ContainerDied","Data":"2a25b8f19a88faadfe365ebed2e921856969418be8750d0772193f98e603c319"} Jun 13 03:53:07.003780 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:07.003743 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" event={"ID":"294e135f-2359-4994-82fb-fc8813ab7be8","Type":"ContainerStarted","Data":"6b7ae08a2004bbfce419c117d30dbe76484131be76f0dbfa410a2d100ada97d0"} Jun 13 03:53:07.005650 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:07.005619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" event={"ID":"74b28d1f-7b4a-44a3-a341-a8917beaebbf","Type":"ContainerStarted","Data":"7bfb2d9b0faa3858fb6efca543a2d90b5c4fcb4832c212ab1afc7c875bafaa77"} Jun 13 03:53:07.038349 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:07.038297 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75bd78495b-wmlzk" podStartSLOduration=2.207536197 podStartE2EDuration="5.038278918s" totalImagesPullingTime="2.830742721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:53:07.037421548 +0000 UTC m=+546.510915302" watchObservedRunningTime="2026-06-13 03:53:07.038278918 +0000 UTC m=+546.511772671" Jun 13 03:53:08.013404 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:08.013301 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" event={"ID":"294e135f-2359-4994-82fb-fc8813ab7be8","Type":"ContainerStarted","Data":"8ff07a1dbd291d8a850be68c11c5c33b19dffa820a70ac77cf7139d91837a670"} Jun 13 03:53:09.024271 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:09.024231 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" event={"ID":"16ec9cae-ecd4-45f9-97a0-524f68865c3f","Type":"ContainerStarted","Data":"c5d6146f5f6835fbbcf3a91738da2b4596355ad4a236b359a82945e09afe0e50"} Jun 13 03:53:09.024720 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:09.024310 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" Jun 13 03:53:09.026079 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:09.026056 2562 generic.go:356] "Generic (PLEG): container finished" podID="294e135f-2359-4994-82fb-fc8813ab7be8" containerID="8ff07a1dbd291d8a850be68c11c5c33b19dffa820a70ac77cf7139d91837a670" exitCode=0 Jun 13 03:53:09.026197 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:09.026124 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" event={"ID":"294e135f-2359-4994-82fb-fc8813ab7be8","Type":"ContainerDied","Data":"8ff07a1dbd291d8a850be68c11c5c33b19dffa820a70ac77cf7139d91837a670"} Jun 13 03:53:09.061050 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:09.061008 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" podStartSLOduration=4.130254396 podStartE2EDuration="7.060991167s" totalImagesPullingTime="2.930736771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:53:09.05946394 +0000 UTC m=+548.532957720" watchObservedRunningTime="2026-06-13 03:53:09.060991167 +0000 UTC m=+548.534484922" Jun 13 03:53:10.032916 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:10.032879 2562 generic.go:356] "Generic (PLEG): container finished" podID="294e135f-2359-4994-82fb-fc8813ab7be8" containerID="eda71079a92038f195302de4b1654684dbf4f3693690fda95ef9e9ca32ff03b1" exitCode=0 Jun 13 03:53:10.033412 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:10.032953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" event={"ID":"294e135f-2359-4994-82fb-fc8813ab7be8","Type":"ContainerDied","Data":"eda71079a92038f195302de4b1654684dbf4f3693690fda95ef9e9ca32ff03b1"} Jun 13 03:53:11.161402 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:11.161380 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" Jun 13 03:53:11.232462 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:11.232434 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/294e135f-2359-4994-82fb-fc8813ab7be8-util\") pod \"294e135f-2359-4994-82fb-fc8813ab7be8\" (UID: \"294e135f-2359-4994-82fb-fc8813ab7be8\") " Jun 13 03:53:11.232604 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:11.232525 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/294e135f-2359-4994-82fb-fc8813ab7be8-bundle\") pod \"294e135f-2359-4994-82fb-fc8813ab7be8\" (UID: \"294e135f-2359-4994-82fb-fc8813ab7be8\") " Jun 13 03:53:11.232604 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:11.232559 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndvj5\" (UniqueName: \"kubernetes.io/projected/294e135f-2359-4994-82fb-fc8813ab7be8-kube-api-access-ndvj5\") pod \"294e135f-2359-4994-82fb-fc8813ab7be8\" (UID: \"294e135f-2359-4994-82fb-fc8813ab7be8\") " Jun 13 03:53:11.233573 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:11.233542 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294e135f-2359-4994-82fb-fc8813ab7be8-bundle" (OuterVolumeSpecName: "bundle") pod "294e135f-2359-4994-82fb-fc8813ab7be8" (UID: "294e135f-2359-4994-82fb-fc8813ab7be8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:53:11.234606 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:11.234574 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/294e135f-2359-4994-82fb-fc8813ab7be8-kube-api-access-ndvj5" (OuterVolumeSpecName: "kube-api-access-ndvj5") pod "294e135f-2359-4994-82fb-fc8813ab7be8" (UID: "294e135f-2359-4994-82fb-fc8813ab7be8"). InnerVolumeSpecName "kube-api-access-ndvj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:53:11.298532 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:11.298479 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294e135f-2359-4994-82fb-fc8813ab7be8-util" (OuterVolumeSpecName: "util") pod "294e135f-2359-4994-82fb-fc8813ab7be8" (UID: "294e135f-2359-4994-82fb-fc8813ab7be8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:53:11.333936 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:11.333915 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/294e135f-2359-4994-82fb-fc8813ab7be8-bundle\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:53:11.333936 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:11.333935 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndvj5\" (UniqueName: \"kubernetes.io/projected/294e135f-2359-4994-82fb-fc8813ab7be8-kube-api-access-ndvj5\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:53:11.334057 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:11.333944 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/294e135f-2359-4994-82fb-fc8813ab7be8-util\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:53:12.044341 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:12.044308 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" event={"ID":"294e135f-2359-4994-82fb-fc8813ab7be8","Type":"ContainerDied","Data":"6b7ae08a2004bbfce419c117d30dbe76484131be76f0dbfa410a2d100ada97d0"} Jun 13 03:53:12.044341 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:12.044337 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064vjmn" Jun 13 03:53:12.044341 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:12.044354 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b7ae08a2004bbfce419c117d30dbe76484131be76f0dbfa410a2d100ada97d0" Jun 13 03:53:15.992946 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:15.992915 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-755dd474c5-gxn2g" Jun 13 03:53:20.035843 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:20.035805 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-mv47x" Jun 13 03:53:24.307037 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.307001 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s"] Jun 13 03:53:24.307465 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.307294 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294e135f-2359-4994-82fb-fc8813ab7be8" containerName="pull" Jun 13 03:53:24.307465 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.307305 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="294e135f-2359-4994-82fb-fc8813ab7be8" containerName="pull" Jun 13 03:53:24.307465 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.307317 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294e135f-2359-4994-82fb-fc8813ab7be8" containerName="extract" Jun 13 03:53:24.307465 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.307323 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="294e135f-2359-4994-82fb-fc8813ab7be8" containerName="extract" Jun 13 03:53:24.307465 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.307336 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294e135f-2359-4994-82fb-fc8813ab7be8" containerName="util" Jun 13 03:53:24.307465 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.307342 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="294e135f-2359-4994-82fb-fc8813ab7be8" containerName="util" Jun 13 03:53:24.307465 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.307416 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="294e135f-2359-4994-82fb-fc8813ab7be8" containerName="extract" Jun 13 03:53:24.315767 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.315746 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" Jun 13 03:53:24.318227 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.318203 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 03:53:24.318702 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.318677 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s"] Jun 13 03:53:24.319055 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.319033 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hf8qg\"" Jun 13 03:53:24.319055 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.319049 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 03:53:24.439949 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.439922 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f977be7-987a-41b6-8232-16a2dcceae31-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s\" (UID: \"4f977be7-987a-41b6-8232-16a2dcceae31\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" Jun 13 03:53:24.440095 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.439977 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7s59\" (UniqueName: \"kubernetes.io/projected/4f977be7-987a-41b6-8232-16a2dcceae31-kube-api-access-d7s59\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s\" (UID: \"4f977be7-987a-41b6-8232-16a2dcceae31\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" Jun 13 03:53:24.440095 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.440060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f977be7-987a-41b6-8232-16a2dcceae31-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s\" (UID: \"4f977be7-987a-41b6-8232-16a2dcceae31\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" Jun 13 03:53:24.540437 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.540410 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f977be7-987a-41b6-8232-16a2dcceae31-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s\" (UID: \"4f977be7-987a-41b6-8232-16a2dcceae31\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" Jun 13 03:53:24.540556 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.540451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f977be7-987a-41b6-8232-16a2dcceae31-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s\" (UID: \"4f977be7-987a-41b6-8232-16a2dcceae31\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" Jun 13 03:53:24.540556 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.540482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7s59\" (UniqueName: \"kubernetes.io/projected/4f977be7-987a-41b6-8232-16a2dcceae31-kube-api-access-d7s59\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s\" (UID: \"4f977be7-987a-41b6-8232-16a2dcceae31\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" Jun 13 03:53:24.540756 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.540738 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f977be7-987a-41b6-8232-16a2dcceae31-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s\" (UID: \"4f977be7-987a-41b6-8232-16a2dcceae31\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" Jun 13 03:53:24.540797 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.540778 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f977be7-987a-41b6-8232-16a2dcceae31-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s\" (UID: \"4f977be7-987a-41b6-8232-16a2dcceae31\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" Jun 13 03:53:24.550899 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.550869 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7s59\" (UniqueName: \"kubernetes.io/projected/4f977be7-987a-41b6-8232-16a2dcceae31-kube-api-access-d7s59\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s\" (UID: \"4f977be7-987a-41b6-8232-16a2dcceae31\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" Jun 13 03:53:24.626821 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.626802 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" Jun 13 03:53:24.757580 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:24.757551 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s"] Jun 13 03:53:24.759532 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:53:24.759506 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f977be7_987a_41b6_8232_16a2dcceae31.slice/crio-0893daf40616b6fbcf80861f5626ffc02dc47a2325fc8b6b3ba4521c1847867a WatchSource:0}: Error finding container 0893daf40616b6fbcf80861f5626ffc02dc47a2325fc8b6b3ba4521c1847867a: Status 404 returned error can't find the container with id 0893daf40616b6fbcf80861f5626ffc02dc47a2325fc8b6b3ba4521c1847867a Jun 13 03:53:25.108177 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:25.108106 2562 generic.go:356] "Generic (PLEG): container finished" podID="4f977be7-987a-41b6-8232-16a2dcceae31" containerID="412607a99c76b75141a03b747356330f28fe40d18bbd15dc0c1ef6f37ebc900c" exitCode=0 Jun 13 03:53:25.108177 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:25.108150 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" event={"ID":"4f977be7-987a-41b6-8232-16a2dcceae31","Type":"ContainerDied","Data":"412607a99c76b75141a03b747356330f28fe40d18bbd15dc0c1ef6f37ebc900c"} Jun 13 03:53:25.108330 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:25.108194 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" event={"ID":"4f977be7-987a-41b6-8232-16a2dcceae31","Type":"ContainerStarted","Data":"0893daf40616b6fbcf80861f5626ffc02dc47a2325fc8b6b3ba4521c1847867a"} Jun 13 03:53:26.114097 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:26.114072 2562 generic.go:356] "Generic (PLEG): container finished" podID="4f977be7-987a-41b6-8232-16a2dcceae31" containerID="a2bc9ab415c32b071f5b76c7a34c4eb1409967dcc55926b78ad8d18314edcc22" exitCode=0 Jun 13 03:53:26.114432 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:26.114140 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" event={"ID":"4f977be7-987a-41b6-8232-16a2dcceae31","Type":"ContainerDied","Data":"a2bc9ab415c32b071f5b76c7a34c4eb1409967dcc55926b78ad8d18314edcc22"} Jun 13 03:53:27.121258 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:27.121228 2562 generic.go:356] "Generic (PLEG): container finished" podID="4f977be7-987a-41b6-8232-16a2dcceae31" containerID="1befeafb6bcfe2a7f350d4036122dfb7d67ac2a409275bd59ae1062a4a9c862f" exitCode=0 Jun 13 03:53:27.121645 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:27.121305 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" event={"ID":"4f977be7-987a-41b6-8232-16a2dcceae31","Type":"ContainerDied","Data":"1befeafb6bcfe2a7f350d4036122dfb7d67ac2a409275bd59ae1062a4a9c862f"} Jun 13 03:53:28.250441 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:28.250416 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" Jun 13 03:53:28.370837 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:28.370802 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f977be7-987a-41b6-8232-16a2dcceae31-util\") pod \"4f977be7-987a-41b6-8232-16a2dcceae31\" (UID: \"4f977be7-987a-41b6-8232-16a2dcceae31\") " Jun 13 03:53:28.370837 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:28.370840 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7s59\" (UniqueName: \"kubernetes.io/projected/4f977be7-987a-41b6-8232-16a2dcceae31-kube-api-access-d7s59\") pod \"4f977be7-987a-41b6-8232-16a2dcceae31\" (UID: \"4f977be7-987a-41b6-8232-16a2dcceae31\") " Jun 13 03:53:28.371089 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:28.370909 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f977be7-987a-41b6-8232-16a2dcceae31-bundle\") pod \"4f977be7-987a-41b6-8232-16a2dcceae31\" (UID: \"4f977be7-987a-41b6-8232-16a2dcceae31\") " Jun 13 03:53:28.372105 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:28.372072 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f977be7-987a-41b6-8232-16a2dcceae31-bundle" (OuterVolumeSpecName: "bundle") pod "4f977be7-987a-41b6-8232-16a2dcceae31" (UID: "4f977be7-987a-41b6-8232-16a2dcceae31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:53:28.373013 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:28.372979 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f977be7-987a-41b6-8232-16a2dcceae31-kube-api-access-d7s59" (OuterVolumeSpecName: "kube-api-access-d7s59") pod "4f977be7-987a-41b6-8232-16a2dcceae31" (UID: "4f977be7-987a-41b6-8232-16a2dcceae31"). InnerVolumeSpecName "kube-api-access-d7s59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:53:28.377739 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:28.377689 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f977be7-987a-41b6-8232-16a2dcceae31-util" (OuterVolumeSpecName: "util") pod "4f977be7-987a-41b6-8232-16a2dcceae31" (UID: "4f977be7-987a-41b6-8232-16a2dcceae31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:53:28.477340 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:28.472983 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f977be7-987a-41b6-8232-16a2dcceae31-bundle\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:53:28.477340 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:28.473017 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f977be7-987a-41b6-8232-16a2dcceae31-util\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:53:28.477340 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:28.473033 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7s59\" (UniqueName: \"kubernetes.io/projected/4f977be7-987a-41b6-8232-16a2dcceae31-kube-api-access-d7s59\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:53:29.135323 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:29.133939 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" event={"ID":"4f977be7-987a-41b6-8232-16a2dcceae31","Type":"ContainerDied","Data":"0893daf40616b6fbcf80861f5626ffc02dc47a2325fc8b6b3ba4521c1847867a"} Jun 13 03:53:29.135323 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:29.134001 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0893daf40616b6fbcf80861f5626ffc02dc47a2325fc8b6b3ba4521c1847867a" Jun 13 03:53:29.135323 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:53:29.134083 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akpj2s" Jun 13 03:54:00.989881 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:00.989854 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 03:54:00.993072 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:00.993052 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 03:54:18.493299 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.493217 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c"] Jun 13 03:54:18.495788 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.493608 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f977be7-987a-41b6-8232-16a2dcceae31" containerName="extract" Jun 13 03:54:18.495788 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.493626 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f977be7-987a-41b6-8232-16a2dcceae31" containerName="extract" Jun 13 03:54:18.495788 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.493645 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f977be7-987a-41b6-8232-16a2dcceae31" containerName="pull" Jun 13 03:54:18.495788 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.493651 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f977be7-987a-41b6-8232-16a2dcceae31" containerName="pull" Jun 13 03:54:18.495788 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.493659 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f977be7-987a-41b6-8232-16a2dcceae31" containerName="util" Jun 13 03:54:18.495788 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.493664 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f977be7-987a-41b6-8232-16a2dcceae31" containerName="util" Jun 13 03:54:18.495788 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.493729 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f977be7-987a-41b6-8232-16a2dcceae31" containerName="extract" Jun 13 03:54:18.496731 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.496717 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" Jun 13 03:54:18.499173 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.499155 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hxt6z\"" Jun 13 03:54:18.499252 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.499172 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 03:54:18.500249 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.500230 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 03:54:18.504373 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.504338 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c"] Jun 13 03:54:18.555951 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.555912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c\" (UID: \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" Jun 13 03:54:18.556124 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.555975 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c\" (UID: \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" Jun 13 03:54:18.556124 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.556025 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmmgh\" (UniqueName: \"kubernetes.io/projected/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-kube-api-access-rmmgh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c\" (UID: \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" Jun 13 03:54:18.656621 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.656584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c\" (UID: \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" Jun 13 03:54:18.656799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.656633 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c\" (UID: \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" Jun 13 03:54:18.656799 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.656669 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmmgh\" (UniqueName: \"kubernetes.io/projected/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-kube-api-access-rmmgh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c\" (UID: \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" Jun 13 03:54:18.657012 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.656992 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c\" (UID: \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" Jun 13 03:54:18.657057 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.656992 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c\" (UID: \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" Jun 13 03:54:18.664735 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.664704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmmgh\" (UniqueName: \"kubernetes.io/projected/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-kube-api-access-rmmgh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c\" (UID: \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" Jun 13 03:54:18.807210 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.807127 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" Jun 13 03:54:18.936333 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:18.936304 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c"] Jun 13 03:54:18.938453 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:54:18.938419 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6cbbd3_1821_40c9_a84b_01dbcc51bc71.slice/crio-d91a814ae0d9e0c6024b1974451b2c8e4d1956fbebc33fe2a41c98291699fe14 WatchSource:0}: Error finding container d91a814ae0d9e0c6024b1974451b2c8e4d1956fbebc33fe2a41c98291699fe14: Status 404 returned error can't find the container with id d91a814ae0d9e0c6024b1974451b2c8e4d1956fbebc33fe2a41c98291699fe14 Jun 13 03:54:19.091773 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.091699 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc"] Jun 13 03:54:19.095151 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.095134 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" Jun 13 03:54:19.104500 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.104477 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc"] Jun 13 03:54:19.160933 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.160905 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/137f46fb-1026-497c-9ac6-773d19e4d26e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc\" (UID: \"137f46fb-1026-497c-9ac6-773d19e4d26e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" Jun 13 03:54:19.161105 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.160953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/137f46fb-1026-497c-9ac6-773d19e4d26e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc\" (UID: \"137f46fb-1026-497c-9ac6-773d19e4d26e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" Jun 13 03:54:19.161105 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.160978 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mkjx\" (UniqueName: \"kubernetes.io/projected/137f46fb-1026-497c-9ac6-773d19e4d26e-kube-api-access-5mkjx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc\" (UID: \"137f46fb-1026-497c-9ac6-773d19e4d26e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" Jun 13 03:54:19.261965 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.261923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/137f46fb-1026-497c-9ac6-773d19e4d26e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc\" (UID: \"137f46fb-1026-497c-9ac6-773d19e4d26e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" Jun 13 03:54:19.262132 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.261980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/137f46fb-1026-497c-9ac6-773d19e4d26e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc\" (UID: \"137f46fb-1026-497c-9ac6-773d19e4d26e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" Jun 13 03:54:19.262132 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.262004 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mkjx\" (UniqueName: \"kubernetes.io/projected/137f46fb-1026-497c-9ac6-773d19e4d26e-kube-api-access-5mkjx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc\" (UID: \"137f46fb-1026-497c-9ac6-773d19e4d26e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" Jun 13 03:54:19.262334 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.262316 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/137f46fb-1026-497c-9ac6-773d19e4d26e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc\" (UID: \"137f46fb-1026-497c-9ac6-773d19e4d26e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" Jun 13 03:54:19.262408 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.262342 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/137f46fb-1026-497c-9ac6-773d19e4d26e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc\" (UID: \"137f46fb-1026-497c-9ac6-773d19e4d26e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" Jun 13 03:54:19.270333 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.270312 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mkjx\" (UniqueName: \"kubernetes.io/projected/137f46fb-1026-497c-9ac6-773d19e4d26e-kube-api-access-5mkjx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc\" (UID: \"137f46fb-1026-497c-9ac6-773d19e4d26e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" Jun 13 03:54:19.367666 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.367574 2562 generic.go:356] "Generic (PLEG): container finished" podID="9b6cbbd3-1821-40c9-a84b-01dbcc51bc71" containerID="485ada83f31a306ad6731b103ad4180182e7665bab8453b71145641c48fee202" exitCode=0 Jun 13 03:54:19.367666 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.367643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" event={"ID":"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71","Type":"ContainerDied","Data":"485ada83f31a306ad6731b103ad4180182e7665bab8453b71145641c48fee202"} Jun 13 03:54:19.367899 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.367680 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" event={"ID":"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71","Type":"ContainerStarted","Data":"d91a814ae0d9e0c6024b1974451b2c8e4d1956fbebc33fe2a41c98291699fe14"} Jun 13 03:54:19.404556 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.404533 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" Jun 13 03:54:19.529851 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.529827 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc"] Jun 13 03:54:19.531700 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:54:19.531665 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod137f46fb_1026_497c_9ac6_773d19e4d26e.slice/crio-2266690c1b60a7948da3ff6fc1e0749e75760d5f6f99ff00b40c3c5b272344c7 WatchSource:0}: Error finding container 2266690c1b60a7948da3ff6fc1e0749e75760d5f6f99ff00b40c3c5b272344c7: Status 404 returned error can't find the container with id 2266690c1b60a7948da3ff6fc1e0749e75760d5f6f99ff00b40c3c5b272344c7 Jun 13 03:54:19.688825 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.688796 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp"] Jun 13 03:54:19.692105 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.692087 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" Jun 13 03:54:19.700287 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.700263 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp"] Jun 13 03:54:19.765715 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.765677 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprdn\" (UniqueName: \"kubernetes.io/projected/237b6016-529d-4b28-93ac-005706b854f5-kube-api-access-tprdn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp\" (UID: \"237b6016-529d-4b28-93ac-005706b854f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" Jun 13 03:54:19.765883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.765731 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/237b6016-529d-4b28-93ac-005706b854f5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp\" (UID: \"237b6016-529d-4b28-93ac-005706b854f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" Jun 13 03:54:19.765883 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.765804 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/237b6016-529d-4b28-93ac-005706b854f5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp\" (UID: \"237b6016-529d-4b28-93ac-005706b854f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" Jun 13 03:54:19.866547 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.866516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/237b6016-529d-4b28-93ac-005706b854f5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp\" (UID: \"237b6016-529d-4b28-93ac-005706b854f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" Jun 13 03:54:19.866726 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.866601 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tprdn\" (UniqueName: \"kubernetes.io/projected/237b6016-529d-4b28-93ac-005706b854f5-kube-api-access-tprdn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp\" (UID: \"237b6016-529d-4b28-93ac-005706b854f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" Jun 13 03:54:19.866726 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.866639 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/237b6016-529d-4b28-93ac-005706b854f5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp\" (UID: \"237b6016-529d-4b28-93ac-005706b854f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" Jun 13 03:54:19.866871 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.866850 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/237b6016-529d-4b28-93ac-005706b854f5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp\" (UID: \"237b6016-529d-4b28-93ac-005706b854f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" Jun 13 03:54:19.866979 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.866961 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/237b6016-529d-4b28-93ac-005706b854f5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp\" (UID: \"237b6016-529d-4b28-93ac-005706b854f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" Jun 13 03:54:19.874019 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:19.873989 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprdn\" (UniqueName: \"kubernetes.io/projected/237b6016-529d-4b28-93ac-005706b854f5-kube-api-access-tprdn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp\" (UID: \"237b6016-529d-4b28-93ac-005706b854f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" Jun 13 03:54:20.001093 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.001061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" Jun 13 03:54:20.095849 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.095821 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r"] Jun 13 03:54:20.099840 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.099816 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" Jun 13 03:54:20.107667 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.107635 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r"] Jun 13 03:54:20.131776 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.131748 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp"] Jun 13 03:54:20.168644 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.168616 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r\" (UID: \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" Jun 13 03:54:20.168815 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.168661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r\" (UID: \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" Jun 13 03:54:20.168815 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.168725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnchz\" (UniqueName: \"kubernetes.io/projected/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-kube-api-access-rnchz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r\" (UID: \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" Jun 13 03:54:20.185981 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:54:20.185949 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod237b6016_529d_4b28_93ac_005706b854f5.slice/crio-6bd75af2dc577d049e15d0a4c640af48a436132aad41062a2ae940df82e3f447 WatchSource:0}: Error finding container 6bd75af2dc577d049e15d0a4c640af48a436132aad41062a2ae940df82e3f447: Status 404 returned error can't find the container with id 6bd75af2dc577d049e15d0a4c640af48a436132aad41062a2ae940df82e3f447 Jun 13 03:54:20.270101 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.270077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnchz\" (UniqueName: \"kubernetes.io/projected/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-kube-api-access-rnchz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r\" (UID: \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" Jun 13 03:54:20.270215 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.270147 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r\" (UID: \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" Jun 13 03:54:20.270215 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.270191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r\" (UID: \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" Jun 13 03:54:20.270607 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.270588 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r\" (UID: \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" Jun 13 03:54:20.270658 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.270592 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r\" (UID: \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" Jun 13 03:54:20.277902 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.277881 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnchz\" (UniqueName: \"kubernetes.io/projected/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-kube-api-access-rnchz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r\" (UID: \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" Jun 13 03:54:20.373560 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.373531 2562 generic.go:356] "Generic (PLEG): container finished" podID="137f46fb-1026-497c-9ac6-773d19e4d26e" containerID="cddaa4d3e4e668f2c74dbcfa0b4735938c6f6aeb4bd9804778fd0a8683530c05" exitCode=0 Jun 13 03:54:20.373668 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.373618 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" event={"ID":"137f46fb-1026-497c-9ac6-773d19e4d26e","Type":"ContainerDied","Data":"cddaa4d3e4e668f2c74dbcfa0b4735938c6f6aeb4bd9804778fd0a8683530c05"} Jun 13 03:54:20.373725 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.373678 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" event={"ID":"137f46fb-1026-497c-9ac6-773d19e4d26e","Type":"ContainerStarted","Data":"2266690c1b60a7948da3ff6fc1e0749e75760d5f6f99ff00b40c3c5b272344c7"} Jun 13 03:54:20.375509 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.375483 2562 generic.go:356] "Generic (PLEG): container finished" podID="9b6cbbd3-1821-40c9-a84b-01dbcc51bc71" containerID="749b4311d9e23a3c43a7e085ecbe123509e9655b4fff2423be20d2ef3e4257e4" exitCode=0 Jun 13 03:54:20.375618 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.375556 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" event={"ID":"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71","Type":"ContainerDied","Data":"749b4311d9e23a3c43a7e085ecbe123509e9655b4fff2423be20d2ef3e4257e4"} Jun 13 03:54:20.377103 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.377069 2562 generic.go:356] "Generic (PLEG): container finished" podID="237b6016-529d-4b28-93ac-005706b854f5" containerID="2f6217933adb4d53a36592ea34f0f27f6848db6f4209f00651b8e8aa8a414571" exitCode=0 Jun 13 03:54:20.377162 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.377095 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" event={"ID":"237b6016-529d-4b28-93ac-005706b854f5","Type":"ContainerDied","Data":"2f6217933adb4d53a36592ea34f0f27f6848db6f4209f00651b8e8aa8a414571"} Jun 13 03:54:20.377162 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.377152 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" event={"ID":"237b6016-529d-4b28-93ac-005706b854f5","Type":"ContainerStarted","Data":"6bd75af2dc577d049e15d0a4c640af48a436132aad41062a2ae940df82e3f447"} Jun 13 03:54:20.413782 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.413760 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" Jun 13 03:54:20.564431 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:20.564397 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r"] Jun 13 03:54:20.612106 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:54:20.612079 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c88e1fa_6c0d_4542_b754_a1139ed7cd59.slice/crio-20ef00ff0a7358129b2387e0538197934e3d51ab4885be459bf15f59fed49c5f WatchSource:0}: Error finding container 20ef00ff0a7358129b2387e0538197934e3d51ab4885be459bf15f59fed49c5f: Status 404 returned error can't find the container with id 20ef00ff0a7358129b2387e0538197934e3d51ab4885be459bf15f59fed49c5f Jun 13 03:54:21.384898 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:21.384871 2562 generic.go:356] "Generic (PLEG): container finished" podID="137f46fb-1026-497c-9ac6-773d19e4d26e" containerID="899931c804ed7042ac035d9177c45f7ff96630f2bfd879ef5171e3df37146fa2" exitCode=0 Jun 13 03:54:21.385086 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:21.384959 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" event={"ID":"137f46fb-1026-497c-9ac6-773d19e4d26e","Type":"ContainerDied","Data":"899931c804ed7042ac035d9177c45f7ff96630f2bfd879ef5171e3df37146fa2"} Jun 13 03:54:21.387110 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:21.387086 2562 generic.go:356] "Generic (PLEG): container finished" podID="9b6cbbd3-1821-40c9-a84b-01dbcc51bc71" containerID="c6a29817cbfe97d84d059b4e58b5e5bdb6f80c6d7fbc9fbde93d857aca4f2111" exitCode=0 Jun 13 03:54:21.387210 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:21.387163 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" event={"ID":"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71","Type":"ContainerDied","Data":"c6a29817cbfe97d84d059b4e58b5e5bdb6f80c6d7fbc9fbde93d857aca4f2111"} Jun 13 03:54:21.388884 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:21.388861 2562 generic.go:356] "Generic (PLEG): container finished" podID="237b6016-529d-4b28-93ac-005706b854f5" containerID="fed37220285f662d32e096aecd19f2976e5e19778ce1c0c05a83630bcb432804" exitCode=0 Jun 13 03:54:21.388978 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:21.388945 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" event={"ID":"237b6016-529d-4b28-93ac-005706b854f5","Type":"ContainerDied","Data":"fed37220285f662d32e096aecd19f2976e5e19778ce1c0c05a83630bcb432804"} Jun 13 03:54:21.390507 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:21.390486 2562 generic.go:356] "Generic (PLEG): container finished" podID="8c88e1fa-6c0d-4542-b754-a1139ed7cd59" containerID="2fe47f90733122444232789d40845cf05f3d239c72f89d42e1da9233dacfa038" exitCode=0 Jun 13 03:54:21.390627 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:21.390518 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" event={"ID":"8c88e1fa-6c0d-4542-b754-a1139ed7cd59","Type":"ContainerDied","Data":"2fe47f90733122444232789d40845cf05f3d239c72f89d42e1da9233dacfa038"} Jun 13 03:54:21.390627 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:21.390551 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" event={"ID":"8c88e1fa-6c0d-4542-b754-a1139ed7cd59","Type":"ContainerStarted","Data":"20ef00ff0a7358129b2387e0538197934e3d51ab4885be459bf15f59fed49c5f"} Jun 13 03:54:22.397708 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.397670 2562 generic.go:356] "Generic (PLEG): container finished" podID="137f46fb-1026-497c-9ac6-773d19e4d26e" containerID="e46a7d96333ef287fb9fcba508bf3b2ba62e1649b95115065501ff3f83307e73" exitCode=0 Jun 13 03:54:22.398165 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.397755 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" event={"ID":"137f46fb-1026-497c-9ac6-773d19e4d26e","Type":"ContainerDied","Data":"e46a7d96333ef287fb9fcba508bf3b2ba62e1649b95115065501ff3f83307e73"} Jun 13 03:54:22.399770 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.399733 2562 generic.go:356] "Generic (PLEG): container finished" podID="237b6016-529d-4b28-93ac-005706b854f5" containerID="856aa20ddc5a311453848c30cd6bf931b76a2639ed356e279b5a824b78288cff" exitCode=0 Jun 13 03:54:22.399874 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.399814 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" event={"ID":"237b6016-529d-4b28-93ac-005706b854f5","Type":"ContainerDied","Data":"856aa20ddc5a311453848c30cd6bf931b76a2639ed356e279b5a824b78288cff"} Jun 13 03:54:22.401511 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.401490 2562 generic.go:356] "Generic (PLEG): container finished" podID="8c88e1fa-6c0d-4542-b754-a1139ed7cd59" containerID="f96b1f8b50dfd8e314faae6abb3126f9f0db69b2cf4ee447d50d366a03de1dd2" exitCode=0 Jun 13 03:54:22.401600 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.401555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" event={"ID":"8c88e1fa-6c0d-4542-b754-a1139ed7cd59","Type":"ContainerDied","Data":"f96b1f8b50dfd8e314faae6abb3126f9f0db69b2cf4ee447d50d366a03de1dd2"} Jun 13 03:54:22.535564 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.535536 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" Jun 13 03:54:22.589056 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.589027 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmmgh\" (UniqueName: \"kubernetes.io/projected/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-kube-api-access-rmmgh\") pod \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\" (UID: \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\") " Jun 13 03:54:22.589157 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.589071 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-util\") pod \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\" (UID: \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\") " Jun 13 03:54:22.589157 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.589133 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-bundle\") pod \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\" (UID: \"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71\") " Jun 13 03:54:22.589624 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.589588 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-bundle" (OuterVolumeSpecName: "bundle") pod "9b6cbbd3-1821-40c9-a84b-01dbcc51bc71" (UID: "9b6cbbd3-1821-40c9-a84b-01dbcc51bc71"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:54:22.591013 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.590987 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-kube-api-access-rmmgh" (OuterVolumeSpecName: "kube-api-access-rmmgh") pod "9b6cbbd3-1821-40c9-a84b-01dbcc51bc71" (UID: "9b6cbbd3-1821-40c9-a84b-01dbcc51bc71"). InnerVolumeSpecName "kube-api-access-rmmgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:54:22.594658 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.594625 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-util" (OuterVolumeSpecName: "util") pod "9b6cbbd3-1821-40c9-a84b-01dbcc51bc71" (UID: "9b6cbbd3-1821-40c9-a84b-01dbcc51bc71"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:54:22.690405 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.690374 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmmgh\" (UniqueName: \"kubernetes.io/projected/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-kube-api-access-rmmgh\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:54:22.690519 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.690411 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-util\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:54:22.690519 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:22.690428 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b6cbbd3-1821-40c9-a84b-01dbcc51bc71-bundle\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:54:23.408853 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.408823 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" Jun 13 03:54:23.409252 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.408824 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c" event={"ID":"9b6cbbd3-1821-40c9-a84b-01dbcc51bc71","Type":"ContainerDied","Data":"d91a814ae0d9e0c6024b1974451b2c8e4d1956fbebc33fe2a41c98291699fe14"} Jun 13 03:54:23.409252 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.408967 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d91a814ae0d9e0c6024b1974451b2c8e4d1956fbebc33fe2a41c98291699fe14" Jun 13 03:54:23.411210 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.411185 2562 generic.go:356] "Generic (PLEG): container finished" podID="8c88e1fa-6c0d-4542-b754-a1139ed7cd59" containerID="6a0e948539d5769d37c5eb41457298af1e0f23794f70cd823e674af7c9cfb090" exitCode=0 Jun 13 03:54:23.411335 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.411286 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" event={"ID":"8c88e1fa-6c0d-4542-b754-a1139ed7cd59","Type":"ContainerDied","Data":"6a0e948539d5769d37c5eb41457298af1e0f23794f70cd823e674af7c9cfb090"} Jun 13 03:54:23.555033 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.555002 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" Jun 13 03:54:23.557692 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.557672 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" Jun 13 03:54:23.598960 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.598932 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/137f46fb-1026-497c-9ac6-773d19e4d26e-bundle\") pod \"137f46fb-1026-497c-9ac6-773d19e4d26e\" (UID: \"137f46fb-1026-497c-9ac6-773d19e4d26e\") " Jun 13 03:54:23.599113 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.598990 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/137f46fb-1026-497c-9ac6-773d19e4d26e-util\") pod \"137f46fb-1026-497c-9ac6-773d19e4d26e\" (UID: \"137f46fb-1026-497c-9ac6-773d19e4d26e\") " Jun 13 03:54:23.599113 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.599018 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tprdn\" (UniqueName: \"kubernetes.io/projected/237b6016-529d-4b28-93ac-005706b854f5-kube-api-access-tprdn\") pod \"237b6016-529d-4b28-93ac-005706b854f5\" (UID: \"237b6016-529d-4b28-93ac-005706b854f5\") " Jun 13 03:54:23.599113 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.599046 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/237b6016-529d-4b28-93ac-005706b854f5-util\") pod \"237b6016-529d-4b28-93ac-005706b854f5\" (UID: \"237b6016-529d-4b28-93ac-005706b854f5\") " Jun 13 03:54:23.599113 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.599067 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mkjx\" (UniqueName: \"kubernetes.io/projected/137f46fb-1026-497c-9ac6-773d19e4d26e-kube-api-access-5mkjx\") pod \"137f46fb-1026-497c-9ac6-773d19e4d26e\" (UID: \"137f46fb-1026-497c-9ac6-773d19e4d26e\") " Jun 13 03:54:23.599330 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.599119 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/237b6016-529d-4b28-93ac-005706b854f5-bundle\") pod \"237b6016-529d-4b28-93ac-005706b854f5\" (UID: \"237b6016-529d-4b28-93ac-005706b854f5\") " Jun 13 03:54:23.599735 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.599705 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137f46fb-1026-497c-9ac6-773d19e4d26e-bundle" (OuterVolumeSpecName: "bundle") pod "137f46fb-1026-497c-9ac6-773d19e4d26e" (UID: "137f46fb-1026-497c-9ac6-773d19e4d26e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:54:23.599848 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.599733 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/237b6016-529d-4b28-93ac-005706b854f5-bundle" (OuterVolumeSpecName: "bundle") pod "237b6016-529d-4b28-93ac-005706b854f5" (UID: "237b6016-529d-4b28-93ac-005706b854f5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:54:23.601631 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.601606 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/137f46fb-1026-497c-9ac6-773d19e4d26e-kube-api-access-5mkjx" (OuterVolumeSpecName: "kube-api-access-5mkjx") pod "137f46fb-1026-497c-9ac6-773d19e4d26e" (UID: "137f46fb-1026-497c-9ac6-773d19e4d26e"). InnerVolumeSpecName "kube-api-access-5mkjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:54:23.601758 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.601736 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/237b6016-529d-4b28-93ac-005706b854f5-kube-api-access-tprdn" (OuterVolumeSpecName: "kube-api-access-tprdn") pod "237b6016-529d-4b28-93ac-005706b854f5" (UID: "237b6016-529d-4b28-93ac-005706b854f5"). InnerVolumeSpecName "kube-api-access-tprdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:54:23.605420 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.605398 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/237b6016-529d-4b28-93ac-005706b854f5-util" (OuterVolumeSpecName: "util") pod "237b6016-529d-4b28-93ac-005706b854f5" (UID: "237b6016-529d-4b28-93ac-005706b854f5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:54:23.606024 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.606003 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137f46fb-1026-497c-9ac6-773d19e4d26e-util" (OuterVolumeSpecName: "util") pod "137f46fb-1026-497c-9ac6-773d19e4d26e" (UID: "137f46fb-1026-497c-9ac6-773d19e4d26e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:54:23.700374 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.700331 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/237b6016-529d-4b28-93ac-005706b854f5-util\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:54:23.700471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.700355 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mkjx\" (UniqueName: \"kubernetes.io/projected/137f46fb-1026-497c-9ac6-773d19e4d26e-kube-api-access-5mkjx\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:54:23.700471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.700387 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/237b6016-529d-4b28-93ac-005706b854f5-bundle\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:54:23.700471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.700396 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/137f46fb-1026-497c-9ac6-773d19e4d26e-bundle\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:54:23.700471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.700403 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/137f46fb-1026-497c-9ac6-773d19e4d26e-util\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:54:23.700471 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:23.700411 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tprdn\" (UniqueName: \"kubernetes.io/projected/237b6016-529d-4b28-93ac-005706b854f5-kube-api-access-tprdn\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:54:24.417564 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.417536 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" Jun 13 03:54:24.418000 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.417564 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp" event={"ID":"237b6016-529d-4b28-93ac-005706b854f5","Type":"ContainerDied","Data":"6bd75af2dc577d049e15d0a4c640af48a436132aad41062a2ae940df82e3f447"} Jun 13 03:54:24.418000 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.417614 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bd75af2dc577d049e15d0a4c640af48a436132aad41062a2ae940df82e3f447" Jun 13 03:54:24.419538 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.419516 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" Jun 13 03:54:24.419674 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.419541 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc" event={"ID":"137f46fb-1026-497c-9ac6-773d19e4d26e","Type":"ContainerDied","Data":"2266690c1b60a7948da3ff6fc1e0749e75760d5f6f99ff00b40c3c5b272344c7"} Jun 13 03:54:24.419674 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.419585 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2266690c1b60a7948da3ff6fc1e0749e75760d5f6f99ff00b40c3c5b272344c7" Jun 13 03:54:24.546165 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.546143 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" Jun 13 03:54:24.606933 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.606910 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-bundle\") pod \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\" (UID: \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\") " Jun 13 03:54:24.607048 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.606992 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-util\") pod \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\" (UID: \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\") " Jun 13 03:54:24.607048 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.607018 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnchz\" (UniqueName: \"kubernetes.io/projected/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-kube-api-access-rnchz\") pod \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\" (UID: \"8c88e1fa-6c0d-4542-b754-a1139ed7cd59\") " Jun 13 03:54:24.607531 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.607498 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-bundle" (OuterVolumeSpecName: "bundle") pod "8c88e1fa-6c0d-4542-b754-a1139ed7cd59" (UID: "8c88e1fa-6c0d-4542-b754-a1139ed7cd59"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:54:24.609087 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.609060 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-kube-api-access-rnchz" (OuterVolumeSpecName: "kube-api-access-rnchz") pod "8c88e1fa-6c0d-4542-b754-a1139ed7cd59" (UID: "8c88e1fa-6c0d-4542-b754-a1139ed7cd59"). InnerVolumeSpecName "kube-api-access-rnchz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:54:24.612609 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.612573 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-util" (OuterVolumeSpecName: "util") pod "8c88e1fa-6c0d-4542-b754-a1139ed7cd59" (UID: "8c88e1fa-6c0d-4542-b754-a1139ed7cd59"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:54:24.707653 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.707604 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-util\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:54:24.707653 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.707623 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnchz\" (UniqueName: \"kubernetes.io/projected/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-kube-api-access-rnchz\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:54:24.707653 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:24.707632 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c88e1fa-6c0d-4542-b754-a1139ed7cd59-bundle\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:54:25.426191 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:25.426167 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" Jun 13 03:54:25.426191 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:25.426183 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r" event={"ID":"8c88e1fa-6c0d-4542-b754-a1139ed7cd59","Type":"ContainerDied","Data":"20ef00ff0a7358129b2387e0538197934e3d51ab4885be459bf15f59fed49c5f"} Jun 13 03:54:25.426653 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:25.426219 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20ef00ff0a7358129b2387e0538197934e3d51ab4885be459bf15f59fed49c5f" Jun 13 03:54:47.532724 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:47.532688 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c796d8ff-nt7sq"] Jun 13 03:54:55.406722 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.406687 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp"] Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.406986 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="137f46fb-1026-497c-9ac6-773d19e4d26e" containerName="extract" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.406996 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="137f46fb-1026-497c-9ac6-773d19e4d26e" containerName="extract" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407004 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="237b6016-529d-4b28-93ac-005706b854f5" containerName="extract" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407011 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="237b6016-529d-4b28-93ac-005706b854f5" containerName="extract" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407017 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c88e1fa-6c0d-4542-b754-a1139ed7cd59" containerName="util" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407023 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c88e1fa-6c0d-4542-b754-a1139ed7cd59" containerName="util" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407033 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b6cbbd3-1821-40c9-a84b-01dbcc51bc71" containerName="util" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407038 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b6cbbd3-1821-40c9-a84b-01dbcc51bc71" containerName="util" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407043 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="237b6016-529d-4b28-93ac-005706b854f5" containerName="util" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407048 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="237b6016-529d-4b28-93ac-005706b854f5" containerName="util" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407054 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c88e1fa-6c0d-4542-b754-a1139ed7cd59" containerName="extract" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407059 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c88e1fa-6c0d-4542-b754-a1139ed7cd59" containerName="extract" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407066 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="137f46fb-1026-497c-9ac6-773d19e4d26e" containerName="util" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407070 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="137f46fb-1026-497c-9ac6-773d19e4d26e" containerName="util" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407084 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c88e1fa-6c0d-4542-b754-a1139ed7cd59" containerName="pull" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407089 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c88e1fa-6c0d-4542-b754-a1139ed7cd59" containerName="pull" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407095 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="237b6016-529d-4b28-93ac-005706b854f5" containerName="pull" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407100 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="237b6016-529d-4b28-93ac-005706b854f5" containerName="pull" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407107 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b6cbbd3-1821-40c9-a84b-01dbcc51bc71" containerName="pull" Jun 13 03:54:55.407102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407112 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b6cbbd3-1821-40c9-a84b-01dbcc51bc71" containerName="pull" Jun 13 03:54:55.407694 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407119 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b6cbbd3-1821-40c9-a84b-01dbcc51bc71" containerName="extract" Jun 13 03:54:55.407694 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407123 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b6cbbd3-1821-40c9-a84b-01dbcc51bc71" containerName="extract" Jun 13 03:54:55.407694 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407129 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="137f46fb-1026-497c-9ac6-773d19e4d26e" containerName="pull" Jun 13 03:54:55.407694 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407134 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="137f46fb-1026-497c-9ac6-773d19e4d26e" containerName="pull" Jun 13 03:54:55.407694 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407180 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="237b6016-529d-4b28-93ac-005706b854f5" containerName="extract" Jun 13 03:54:55.407694 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407186 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="137f46fb-1026-497c-9ac6-773d19e4d26e" containerName="extract" Jun 13 03:54:55.407694 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407196 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c88e1fa-6c0d-4542-b754-a1139ed7cd59" containerName="extract" Jun 13 03:54:55.407694 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.407205 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b6cbbd3-1821-40c9-a84b-01dbcc51bc71" containerName="extract" Jun 13 03:54:55.411732 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.411715 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" Jun 13 03:54:55.416473 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.416449 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 13 03:54:55.416778 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.416757 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 13 03:54:55.416972 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.416894 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 03:54:55.417658 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.417639 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 03:54:55.418002 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.417825 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hxt6z\"" Jun 13 03:54:55.420103 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.420080 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp"] Jun 13 03:54:55.547100 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.547065 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/63dc59be-d5f5-481d-8879-0120948f421a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ccftp\" (UID: \"63dc59be-d5f5-481d-8879-0120948f421a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" Jun 13 03:54:55.547280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.547110 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63dc59be-d5f5-481d-8879-0120948f421a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ccftp\" (UID: \"63dc59be-d5f5-481d-8879-0120948f421a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" Jun 13 03:54:55.547280 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.547131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwpl7\" (UniqueName: \"kubernetes.io/projected/63dc59be-d5f5-481d-8879-0120948f421a-kube-api-access-cwpl7\") pod \"kuadrant-console-plugin-66b5774985-ccftp\" (UID: \"63dc59be-d5f5-481d-8879-0120948f421a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" Jun 13 03:54:55.648459 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.648427 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63dc59be-d5f5-481d-8879-0120948f421a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ccftp\" (UID: \"63dc59be-d5f5-481d-8879-0120948f421a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" Jun 13 03:54:55.648459 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.648458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwpl7\" (UniqueName: \"kubernetes.io/projected/63dc59be-d5f5-481d-8879-0120948f421a-kube-api-access-cwpl7\") pod \"kuadrant-console-plugin-66b5774985-ccftp\" (UID: \"63dc59be-d5f5-481d-8879-0120948f421a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" Jun 13 03:54:55.648702 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.648521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/63dc59be-d5f5-481d-8879-0120948f421a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ccftp\" (UID: \"63dc59be-d5f5-481d-8879-0120948f421a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" Jun 13 03:54:55.649077 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.649053 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63dc59be-d5f5-481d-8879-0120948f421a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ccftp\" (UID: \"63dc59be-d5f5-481d-8879-0120948f421a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" Jun 13 03:54:55.650902 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.650879 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/63dc59be-d5f5-481d-8879-0120948f421a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ccftp\" (UID: \"63dc59be-d5f5-481d-8879-0120948f421a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" Jun 13 03:54:55.655917 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.655894 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwpl7\" (UniqueName: \"kubernetes.io/projected/63dc59be-d5f5-481d-8879-0120948f421a-kube-api-access-cwpl7\") pod \"kuadrant-console-plugin-66b5774985-ccftp\" (UID: \"63dc59be-d5f5-481d-8879-0120948f421a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" Jun 13 03:54:55.721175 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.721114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" Jun 13 03:54:55.847763 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:55.847731 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp"] Jun 13 03:54:55.849297 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:54:55.849272 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63dc59be_d5f5_481d_8879_0120948f421a.slice/crio-284c1ee8a7ab1150f209f9988d177fd1863a300c94d3ea0de19028377a7ae021 WatchSource:0}: Error finding container 284c1ee8a7ab1150f209f9988d177fd1863a300c94d3ea0de19028377a7ae021: Status 404 returned error can't find the container with id 284c1ee8a7ab1150f209f9988d177fd1863a300c94d3ea0de19028377a7ae021 Jun 13 03:54:56.583668 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:54:56.583629 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" event={"ID":"63dc59be-d5f5-481d-8879-0120948f421a","Type":"ContainerStarted","Data":"284c1ee8a7ab1150f209f9988d177fd1863a300c94d3ea0de19028377a7ae021"} Jun 13 03:55:12.553293 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:12.553230 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-84c796d8ff-nt7sq" podUID="3211d457-774f-4335-b98b-7655a207c3e4" containerName="console" containerID="cri-o://9acea30520e109f06eb45443811a373172baf9c8ceadc7b49c6095829277889d" gracePeriod=15 Jun 13 03:55:13.400568 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:13.400527 2562 patch_prober.go:28] interesting pod/console-84c796d8ff-nt7sq container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 13 03:55:13.400752 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:13.400594 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-84c796d8ff-nt7sq" podUID="3211d457-774f-4335-b98b-7655a207c3e4" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 13 03:55:19.519552 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.519525 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:55:19.668689 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.668655 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3211d457-774f-4335-b98b-7655a207c3e4-console-oauth-config\") pod \"3211d457-774f-4335-b98b-7655a207c3e4\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " Jun 13 03:55:19.668689 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.668690 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-trusted-ca-bundle\") pod \"3211d457-774f-4335-b98b-7655a207c3e4\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " Jun 13 03:55:19.668926 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.668709 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3211d457-774f-4335-b98b-7655a207c3e4-console-serving-cert\") pod \"3211d457-774f-4335-b98b-7655a207c3e4\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " Jun 13 03:55:19.668926 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.668747 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bztds\" (UniqueName: \"kubernetes.io/projected/3211d457-774f-4335-b98b-7655a207c3e4-kube-api-access-bztds\") pod \"3211d457-774f-4335-b98b-7655a207c3e4\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " Jun 13 03:55:19.668926 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.668867 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-service-ca\") pod \"3211d457-774f-4335-b98b-7655a207c3e4\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " Jun 13 03:55:19.668926 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.668902 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-oauth-serving-cert\") pod \"3211d457-774f-4335-b98b-7655a207c3e4\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " Jun 13 03:55:19.669155 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.668930 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-console-config\") pod \"3211d457-774f-4335-b98b-7655a207c3e4\" (UID: \"3211d457-774f-4335-b98b-7655a207c3e4\") " Jun 13 03:55:19.669215 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.669165 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3211d457-774f-4335-b98b-7655a207c3e4" (UID: "3211d457-774f-4335-b98b-7655a207c3e4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:55:19.669489 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.669412 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3211d457-774f-4335-b98b-7655a207c3e4" (UID: "3211d457-774f-4335-b98b-7655a207c3e4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:55:19.669489 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.669480 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-console-config" (OuterVolumeSpecName: "console-config") pod "3211d457-774f-4335-b98b-7655a207c3e4" (UID: "3211d457-774f-4335-b98b-7655a207c3e4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:55:19.669686 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.669604 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-service-ca" (OuterVolumeSpecName: "service-ca") pod "3211d457-774f-4335-b98b-7655a207c3e4" (UID: "3211d457-774f-4335-b98b-7655a207c3e4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:55:19.670931 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.670907 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3211d457-774f-4335-b98b-7655a207c3e4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3211d457-774f-4335-b98b-7655a207c3e4" (UID: "3211d457-774f-4335-b98b-7655a207c3e4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:55:19.671040 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.670949 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3211d457-774f-4335-b98b-7655a207c3e4-kube-api-access-bztds" (OuterVolumeSpecName: "kube-api-access-bztds") pod "3211d457-774f-4335-b98b-7655a207c3e4" (UID: "3211d457-774f-4335-b98b-7655a207c3e4"). InnerVolumeSpecName "kube-api-access-bztds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:55:19.672615 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.672597 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3211d457-774f-4335-b98b-7655a207c3e4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3211d457-774f-4335-b98b-7655a207c3e4" (UID: "3211d457-774f-4335-b98b-7655a207c3e4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:55:19.723403 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.723347 2562 generic.go:356] "Generic (PLEG): container finished" podID="3211d457-774f-4335-b98b-7655a207c3e4" containerID="9acea30520e109f06eb45443811a373172baf9c8ceadc7b49c6095829277889d" exitCode=0 Jun 13 03:55:19.723520 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.723398 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c796d8ff-nt7sq" event={"ID":"3211d457-774f-4335-b98b-7655a207c3e4","Type":"ContainerDied","Data":"9acea30520e109f06eb45443811a373172baf9c8ceadc7b49c6095829277889d"} Jun 13 03:55:19.723520 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.723465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c796d8ff-nt7sq" event={"ID":"3211d457-774f-4335-b98b-7655a207c3e4","Type":"ContainerDied","Data":"c8420adcc31822fbbd356740c98f32b62b9ce20fae17033224fb4661ffc1cc71"} Jun 13 03:55:19.723520 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.723406 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c796d8ff-nt7sq" Jun 13 03:55:19.723679 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.723493 2562 scope.go:117] "RemoveContainer" containerID="9acea30520e109f06eb45443811a373172baf9c8ceadc7b49c6095829277889d" Jun 13 03:55:19.733927 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.733910 2562 scope.go:117] "RemoveContainer" containerID="9acea30520e109f06eb45443811a373172baf9c8ceadc7b49c6095829277889d" Jun 13 03:55:19.734219 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:55:19.734199 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9acea30520e109f06eb45443811a373172baf9c8ceadc7b49c6095829277889d\": container with ID starting with 9acea30520e109f06eb45443811a373172baf9c8ceadc7b49c6095829277889d not found: ID does not exist" containerID="9acea30520e109f06eb45443811a373172baf9c8ceadc7b49c6095829277889d" Jun 13 03:55:19.734275 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.734227 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9acea30520e109f06eb45443811a373172baf9c8ceadc7b49c6095829277889d"} err="failed to get container status \"9acea30520e109f06eb45443811a373172baf9c8ceadc7b49c6095829277889d\": rpc error: code = NotFound desc = could not find container \"9acea30520e109f06eb45443811a373172baf9c8ceadc7b49c6095829277889d\": container with ID starting with 9acea30520e109f06eb45443811a373172baf9c8ceadc7b49c6095829277889d not found: ID does not exist" Jun 13 03:55:19.750867 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.750842 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c796d8ff-nt7sq"] Jun 13 03:55:19.754916 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.754896 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84c796d8ff-nt7sq"] Jun 13 03:55:19.770486 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.770465 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-service-ca\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:55:19.770486 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.770486 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-oauth-serving-cert\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:55:19.770611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.770496 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-console-config\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:55:19.770611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.770505 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3211d457-774f-4335-b98b-7655a207c3e4-console-oauth-config\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:55:19.770611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.770513 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3211d457-774f-4335-b98b-7655a207c3e4-trusted-ca-bundle\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:55:19.770611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.770522 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3211d457-774f-4335-b98b-7655a207c3e4-console-serving-cert\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:55:19.770611 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:19.770532 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bztds\" (UniqueName: \"kubernetes.io/projected/3211d457-774f-4335-b98b-7655a207c3e4-kube-api-access-bztds\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:55:20.730827 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:20.730788 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" event={"ID":"63dc59be-d5f5-481d-8879-0120948f421a","Type":"ContainerStarted","Data":"5ad8ecb3e3932faf3ca2267413bccf7a55fdfd50fd2d3d31b094290388f7007b"} Jun 13 03:55:20.746805 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:20.746761 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ccftp" podStartSLOduration=1.877205827 podStartE2EDuration="25.746745239s" totalImagesPullingTime="23.869539412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:55:20.744443039 +0000 UTC m=+680.217936786" watchObservedRunningTime="2026-06-13 03:55:20.746745239 +0000 UTC m=+680.220238996" Jun 13 03:55:21.016097 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:21.016023 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3211d457-774f-4335-b98b-7655a207c3e4" path="/var/lib/kubelet/pods/3211d457-774f-4335-b98b-7655a207c3e4/volumes" Jun 13 03:55:50.045257 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.045220 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-927tf"] Jun 13 03:55:50.045733 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.045545 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3211d457-774f-4335-b98b-7655a207c3e4" containerName="console" Jun 13 03:55:50.045733 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.045557 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3211d457-774f-4335-b98b-7655a207c3e4" containerName="console" Jun 13 03:55:50.045733 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.045622 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3211d457-774f-4335-b98b-7655a207c3e4" containerName="console" Jun 13 03:55:50.063797 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.063761 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-927tf"] Jun 13 03:55:50.063952 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.063917 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" Jun 13 03:55:50.066442 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.066409 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 13 03:55:50.098551 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.098524 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4eee19c5-30c0-4f32-ad29-04a60fde4656-config-file\") pod \"limitador-limitador-64c94fd64f-927tf\" (UID: \"4eee19c5-30c0-4f32-ad29-04a60fde4656\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" Jun 13 03:55:50.098680 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.098657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rcj2\" (UniqueName: \"kubernetes.io/projected/4eee19c5-30c0-4f32-ad29-04a60fde4656-kube-api-access-6rcj2\") pod \"limitador-limitador-64c94fd64f-927tf\" (UID: \"4eee19c5-30c0-4f32-ad29-04a60fde4656\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" Jun 13 03:55:50.139152 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.139114 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-927tf"] Jun 13 03:55:50.199647 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.199619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4eee19c5-30c0-4f32-ad29-04a60fde4656-config-file\") pod \"limitador-limitador-64c94fd64f-927tf\" (UID: \"4eee19c5-30c0-4f32-ad29-04a60fde4656\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" Jun 13 03:55:50.199794 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.199717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rcj2\" (UniqueName: \"kubernetes.io/projected/4eee19c5-30c0-4f32-ad29-04a60fde4656-kube-api-access-6rcj2\") pod \"limitador-limitador-64c94fd64f-927tf\" (UID: \"4eee19c5-30c0-4f32-ad29-04a60fde4656\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" Jun 13 03:55:50.200285 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.200269 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4eee19c5-30c0-4f32-ad29-04a60fde4656-config-file\") pod \"limitador-limitador-64c94fd64f-927tf\" (UID: \"4eee19c5-30c0-4f32-ad29-04a60fde4656\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" Jun 13 03:55:50.207205 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.207179 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rcj2\" (UniqueName: \"kubernetes.io/projected/4eee19c5-30c0-4f32-ad29-04a60fde4656-kube-api-access-6rcj2\") pod \"limitador-limitador-64c94fd64f-927tf\" (UID: \"4eee19c5-30c0-4f32-ad29-04a60fde4656\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" Jun 13 03:55:50.377448 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.377423 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" Jun 13 03:55:50.537115 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.537084 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-927tf"] Jun 13 03:55:50.839114 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.839044 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-kpbbf"] Jun 13 03:55:50.841789 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.841767 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kpbbf" Jun 13 03:55:50.844277 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.844252 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jnkcc\"" Jun 13 03:55:50.846517 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.846497 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kpbbf"] Jun 13 03:55:50.882549 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.882519 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" event={"ID":"4eee19c5-30c0-4f32-ad29-04a60fde4656","Type":"ContainerStarted","Data":"9f85b14d710218c2a700e84de2a2ff1fe21155cb5b52bb9d01d4da6fa4d25ca4"} Jun 13 03:55:50.904941 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:50.904919 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts7sx\" (UniqueName: \"kubernetes.io/projected/4a7ac813-c615-4e9b-aadc-40c374687907-kube-api-access-ts7sx\") pod \"authorino-58cd955675-kpbbf\" (UID: \"4a7ac813-c615-4e9b-aadc-40c374687907\") " pod="kuadrant-system/authorino-58cd955675-kpbbf" Jun 13 03:55:51.005702 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.005670 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts7sx\" (UniqueName: \"kubernetes.io/projected/4a7ac813-c615-4e9b-aadc-40c374687907-kube-api-access-ts7sx\") pod \"authorino-58cd955675-kpbbf\" (UID: \"4a7ac813-c615-4e9b-aadc-40c374687907\") " pod="kuadrant-system/authorino-58cd955675-kpbbf" Jun 13 03:55:51.016622 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.016596 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts7sx\" (UniqueName: \"kubernetes.io/projected/4a7ac813-c615-4e9b-aadc-40c374687907-kube-api-access-ts7sx\") pod \"authorino-58cd955675-kpbbf\" (UID: \"4a7ac813-c615-4e9b-aadc-40c374687907\") " pod="kuadrant-system/authorino-58cd955675-kpbbf" Jun 13 03:55:51.031639 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.031616 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-rgc7x"] Jun 13 03:55:51.033618 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.033604 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rgc7x" Jun 13 03:55:51.044175 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.044152 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rgc7x"] Jun 13 03:55:51.106283 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.106229 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zjl4\" (UniqueName: \"kubernetes.io/projected/08d28844-d9c8-4c54-8a4f-c7684b3c9fb7-kube-api-access-8zjl4\") pod \"authorino-75d556bd77-rgc7x\" (UID: \"08d28844-d9c8-4c54-8a4f-c7684b3c9fb7\") " pod="kuadrant-system/authorino-75d556bd77-rgc7x" Jun 13 03:55:51.152549 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.152526 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kpbbf" Jun 13 03:55:51.207109 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.207079 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zjl4\" (UniqueName: \"kubernetes.io/projected/08d28844-d9c8-4c54-8a4f-c7684b3c9fb7-kube-api-access-8zjl4\") pod \"authorino-75d556bd77-rgc7x\" (UID: \"08d28844-d9c8-4c54-8a4f-c7684b3c9fb7\") " pod="kuadrant-system/authorino-75d556bd77-rgc7x" Jun 13 03:55:51.214595 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.214571 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zjl4\" (UniqueName: \"kubernetes.io/projected/08d28844-d9c8-4c54-8a4f-c7684b3c9fb7-kube-api-access-8zjl4\") pod \"authorino-75d556bd77-rgc7x\" (UID: \"08d28844-d9c8-4c54-8a4f-c7684b3c9fb7\") " pod="kuadrant-system/authorino-75d556bd77-rgc7x" Jun 13 03:55:51.284742 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.284710 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kpbbf"] Jun 13 03:55:51.286996 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:55:51.286965 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a7ac813_c615_4e9b_aadc_40c374687907.slice/crio-ea683fb67986dc50cd52f728d4089351a828f06e4eaba9a1c34353241264e55b WatchSource:0}: Error finding container ea683fb67986dc50cd52f728d4089351a828f06e4eaba9a1c34353241264e55b: Status 404 returned error can't find the container with id ea683fb67986dc50cd52f728d4089351a828f06e4eaba9a1c34353241264e55b Jun 13 03:55:51.342259 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.342231 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rgc7x" Jun 13 03:55:51.511259 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.511225 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rgc7x"] Jun 13 03:55:51.512147 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:55:51.512120 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08d28844_d9c8_4c54_8a4f_c7684b3c9fb7.slice/crio-df095c08218cf0fc2a2f5ee26275dda600f06f8fe85205868f7943a41e247cbf WatchSource:0}: Error finding container df095c08218cf0fc2a2f5ee26275dda600f06f8fe85205868f7943a41e247cbf: Status 404 returned error can't find the container with id df095c08218cf0fc2a2f5ee26275dda600f06f8fe85205868f7943a41e247cbf Jun 13 03:55:51.890530 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.890490 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rgc7x" event={"ID":"08d28844-d9c8-4c54-8a4f-c7684b3c9fb7","Type":"ContainerStarted","Data":"df095c08218cf0fc2a2f5ee26275dda600f06f8fe85205868f7943a41e247cbf"} Jun 13 03:55:51.891846 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:51.891807 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kpbbf" event={"ID":"4a7ac813-c615-4e9b-aadc-40c374687907","Type":"ContainerStarted","Data":"ea683fb67986dc50cd52f728d4089351a828f06e4eaba9a1c34353241264e55b"} Jun 13 03:55:55.922410 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:55.922355 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rgc7x" event={"ID":"08d28844-d9c8-4c54-8a4f-c7684b3c9fb7","Type":"ContainerStarted","Data":"740b3340174cbdce881779bd38a72c3e3e4abe81324a688d32135f9942a32908"} Jun 13 03:55:55.923925 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:55.923896 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kpbbf" event={"ID":"4a7ac813-c615-4e9b-aadc-40c374687907","Type":"ContainerStarted","Data":"a7f2a62d0e82203c0119edf3c5ad5bfe7e7bd13b299d06645ff244c380923931"} Jun 13 03:55:55.925490 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:55.925465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" event={"ID":"4eee19c5-30c0-4f32-ad29-04a60fde4656","Type":"ContainerStarted","Data":"d09956a51b3370cb04cb7002d278ad1ed6c991bba7ba62882cbb0162052b11e7"} Jun 13 03:55:55.925608 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:55.925593 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" Jun 13 03:55:55.937582 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:55.937541 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-rgc7x" podStartSLOduration=0.747503304 podStartE2EDuration="4.937527356s" totalImagesPullingTime="4.190024052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:55:55.935590112 +0000 UTC m=+715.409083864" watchObservedRunningTime="2026-06-13 03:55:55.937527356 +0000 UTC m=+715.411021109" Jun 13 03:55:55.951877 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:55.951831 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" podStartSLOduration=0.74063568 podStartE2EDuration="5.951814339s" totalImagesPullingTime="5.211178659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:55:55.949403156 +0000 UTC m=+715.422896932" watchObservedRunningTime="2026-06-13 03:55:55.951814339 +0000 UTC m=+715.425308094" Jun 13 03:55:55.964867 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:55.964843 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kpbbf"] Jun 13 03:55:55.974781 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:55.974743 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-kpbbf" podStartSLOduration=1.518279583 podStartE2EDuration="5.974726663s" totalImagesPullingTime="4.45644708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:55:55.97265999 +0000 UTC m=+715.446153771" watchObservedRunningTime="2026-06-13 03:55:55.974726663 +0000 UTC m=+715.448220417" Jun 13 03:55:57.937491 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:57.937452 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-kpbbf" podUID="4a7ac813-c615-4e9b-aadc-40c374687907" containerName="authorino" containerID="cri-o://a7f2a62d0e82203c0119edf3c5ad5bfe7e7bd13b299d06645ff244c380923931" gracePeriod=30 Jun 13 03:55:58.184616 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:58.184592 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kpbbf" Jun 13 03:55:58.271797 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:58.271719 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts7sx\" (UniqueName: \"kubernetes.io/projected/4a7ac813-c615-4e9b-aadc-40c374687907-kube-api-access-ts7sx\") pod \"4a7ac813-c615-4e9b-aadc-40c374687907\" (UID: \"4a7ac813-c615-4e9b-aadc-40c374687907\") " Jun 13 03:55:58.273689 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:58.273664 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a7ac813-c615-4e9b-aadc-40c374687907-kube-api-access-ts7sx" (OuterVolumeSpecName: "kube-api-access-ts7sx") pod "4a7ac813-c615-4e9b-aadc-40c374687907" (UID: "4a7ac813-c615-4e9b-aadc-40c374687907"). InnerVolumeSpecName "kube-api-access-ts7sx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:55:58.373251 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:58.373225 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts7sx\" (UniqueName: \"kubernetes.io/projected/4a7ac813-c615-4e9b-aadc-40c374687907-kube-api-access-ts7sx\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:55:58.943455 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:58.943417 2562 generic.go:356] "Generic (PLEG): container finished" podID="4a7ac813-c615-4e9b-aadc-40c374687907" containerID="a7f2a62d0e82203c0119edf3c5ad5bfe7e7bd13b299d06645ff244c380923931" exitCode=0 Jun 13 03:55:58.943867 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:58.943464 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kpbbf" Jun 13 03:55:58.943867 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:58.943506 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kpbbf" event={"ID":"4a7ac813-c615-4e9b-aadc-40c374687907","Type":"ContainerDied","Data":"a7f2a62d0e82203c0119edf3c5ad5bfe7e7bd13b299d06645ff244c380923931"} Jun 13 03:55:58.943867 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:58.943550 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kpbbf" event={"ID":"4a7ac813-c615-4e9b-aadc-40c374687907","Type":"ContainerDied","Data":"ea683fb67986dc50cd52f728d4089351a828f06e4eaba9a1c34353241264e55b"} Jun 13 03:55:58.943867 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:58.943567 2562 scope.go:117] "RemoveContainer" containerID="a7f2a62d0e82203c0119edf3c5ad5bfe7e7bd13b299d06645ff244c380923931" Jun 13 03:55:58.953117 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:58.953073 2562 scope.go:117] "RemoveContainer" containerID="a7f2a62d0e82203c0119edf3c5ad5bfe7e7bd13b299d06645ff244c380923931" Jun 13 03:55:58.953728 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:55:58.953689 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7f2a62d0e82203c0119edf3c5ad5bfe7e7bd13b299d06645ff244c380923931\": container with ID starting with a7f2a62d0e82203c0119edf3c5ad5bfe7e7bd13b299d06645ff244c380923931 not found: ID does not exist" containerID="a7f2a62d0e82203c0119edf3c5ad5bfe7e7bd13b299d06645ff244c380923931" Jun 13 03:55:58.953831 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:58.953735 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f2a62d0e82203c0119edf3c5ad5bfe7e7bd13b299d06645ff244c380923931"} err="failed to get container status \"a7f2a62d0e82203c0119edf3c5ad5bfe7e7bd13b299d06645ff244c380923931\": rpc error: code = NotFound desc = could not find container \"a7f2a62d0e82203c0119edf3c5ad5bfe7e7bd13b299d06645ff244c380923931\": container with ID starting with a7f2a62d0e82203c0119edf3c5ad5bfe7e7bd13b299d06645ff244c380923931 not found: ID does not exist" Jun 13 03:55:58.969060 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:58.969037 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kpbbf"] Jun 13 03:55:58.971979 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:58.971955 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-kpbbf"] Jun 13 03:55:59.015134 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:55:59.015113 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a7ac813-c615-4e9b-aadc-40c374687907" path="/var/lib/kubelet/pods/4a7ac813-c615-4e9b-aadc-40c374687907/volumes" Jun 13 03:56:04.875456 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:04.875413 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-927tf"] Jun 13 03:56:04.875862 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:04.875633 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" podUID="4eee19c5-30c0-4f32-ad29-04a60fde4656" containerName="limitador" containerID="cri-o://d09956a51b3370cb04cb7002d278ad1ed6c991bba7ba62882cbb0162052b11e7" gracePeriod=30 Jun 13 03:56:04.876305 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:04.876287 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" Jun 13 03:56:05.821417 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:05.821389 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" Jun 13 03:56:05.936566 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:05.936532 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4eee19c5-30c0-4f32-ad29-04a60fde4656-config-file\") pod \"4eee19c5-30c0-4f32-ad29-04a60fde4656\" (UID: \"4eee19c5-30c0-4f32-ad29-04a60fde4656\") " Jun 13 03:56:05.936988 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:05.936598 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rcj2\" (UniqueName: \"kubernetes.io/projected/4eee19c5-30c0-4f32-ad29-04a60fde4656-kube-api-access-6rcj2\") pod \"4eee19c5-30c0-4f32-ad29-04a60fde4656\" (UID: \"4eee19c5-30c0-4f32-ad29-04a60fde4656\") " Jun 13 03:56:05.936988 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:05.936887 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eee19c5-30c0-4f32-ad29-04a60fde4656-config-file" (OuterVolumeSpecName: "config-file") pod "4eee19c5-30c0-4f32-ad29-04a60fde4656" (UID: "4eee19c5-30c0-4f32-ad29-04a60fde4656"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 03:56:05.938573 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:05.938550 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eee19c5-30c0-4f32-ad29-04a60fde4656-kube-api-access-6rcj2" (OuterVolumeSpecName: "kube-api-access-6rcj2") pod "4eee19c5-30c0-4f32-ad29-04a60fde4656" (UID: "4eee19c5-30c0-4f32-ad29-04a60fde4656"). InnerVolumeSpecName "kube-api-access-6rcj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:56:05.981102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:05.981070 2562 generic.go:356] "Generic (PLEG): container finished" podID="4eee19c5-30c0-4f32-ad29-04a60fde4656" containerID="d09956a51b3370cb04cb7002d278ad1ed6c991bba7ba62882cbb0162052b11e7" exitCode=0 Jun 13 03:56:05.981268 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:05.981113 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" Jun 13 03:56:05.981268 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:05.981112 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" event={"ID":"4eee19c5-30c0-4f32-ad29-04a60fde4656","Type":"ContainerDied","Data":"d09956a51b3370cb04cb7002d278ad1ed6c991bba7ba62882cbb0162052b11e7"} Jun 13 03:56:05.981268 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:05.981231 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-927tf" event={"ID":"4eee19c5-30c0-4f32-ad29-04a60fde4656","Type":"ContainerDied","Data":"9f85b14d710218c2a700e84de2a2ff1fe21155cb5b52bb9d01d4da6fa4d25ca4"} Jun 13 03:56:05.981268 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:05.981254 2562 scope.go:117] "RemoveContainer" containerID="d09956a51b3370cb04cb7002d278ad1ed6c991bba7ba62882cbb0162052b11e7" Jun 13 03:56:05.990160 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:05.990142 2562 scope.go:117] "RemoveContainer" containerID="d09956a51b3370cb04cb7002d278ad1ed6c991bba7ba62882cbb0162052b11e7" Jun 13 03:56:05.990428 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:56:05.990408 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d09956a51b3370cb04cb7002d278ad1ed6c991bba7ba62882cbb0162052b11e7\": container with ID starting with d09956a51b3370cb04cb7002d278ad1ed6c991bba7ba62882cbb0162052b11e7 not found: ID does not exist" containerID="d09956a51b3370cb04cb7002d278ad1ed6c991bba7ba62882cbb0162052b11e7" Jun 13 03:56:05.990480 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:05.990438 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d09956a51b3370cb04cb7002d278ad1ed6c991bba7ba62882cbb0162052b11e7"} err="failed to get container status \"d09956a51b3370cb04cb7002d278ad1ed6c991bba7ba62882cbb0162052b11e7\": rpc error: code = NotFound desc = could not find container \"d09956a51b3370cb04cb7002d278ad1ed6c991bba7ba62882cbb0162052b11e7\": container with ID starting with d09956a51b3370cb04cb7002d278ad1ed6c991bba7ba62882cbb0162052b11e7 not found: ID does not exist" Jun 13 03:56:06.002452 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:06.002426 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-927tf"] Jun 13 03:56:06.004299 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:06.004281 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-927tf"] Jun 13 03:56:06.037476 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:06.037450 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rcj2\" (UniqueName: \"kubernetes.io/projected/4eee19c5-30c0-4f32-ad29-04a60fde4656-kube-api-access-6rcj2\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:56:06.037476 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:06.037475 2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4eee19c5-30c0-4f32-ad29-04a60fde4656-config-file\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:56:07.015610 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.015579 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eee19c5-30c0-4f32-ad29-04a60fde4656" path="/var/lib/kubelet/pods/4eee19c5-30c0-4f32-ad29-04a60fde4656/volumes" Jun 13 03:56:07.466533 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.466500 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-llz7t"] Jun 13 03:56:07.466885 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.466867 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a7ac813-c615-4e9b-aadc-40c374687907" containerName="authorino" Jun 13 03:56:07.466962 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.466888 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a7ac813-c615-4e9b-aadc-40c374687907" containerName="authorino" Jun 13 03:56:07.466962 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.466914 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eee19c5-30c0-4f32-ad29-04a60fde4656" containerName="limitador" Jun 13 03:56:07.466962 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.466920 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eee19c5-30c0-4f32-ad29-04a60fde4656" containerName="limitador" Jun 13 03:56:07.467116 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.466977 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a7ac813-c615-4e9b-aadc-40c374687907" containerName="authorino" Jun 13 03:56:07.467116 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.466989 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eee19c5-30c0-4f32-ad29-04a60fde4656" containerName="limitador" Jun 13 03:56:07.471402 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.471378 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-llz7t" Jun 13 03:56:07.474827 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.474578 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 13 03:56:07.474827 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.474589 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-64jhs\"" Jun 13 03:56:07.477102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.477076 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-llz7t"] Jun 13 03:56:07.547128 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.547091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r95p\" (UniqueName: \"kubernetes.io/projected/5868b402-1afc-434b-9f67-ca18ea32a685-kube-api-access-2r95p\") pod \"postgres-69fb4594cf-llz7t\" (UID: \"5868b402-1afc-434b-9f67-ca18ea32a685\") " pod="opendatahub/postgres-69fb4594cf-llz7t" Jun 13 03:56:07.547128 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.547124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5868b402-1afc-434b-9f67-ca18ea32a685-data\") pod \"postgres-69fb4594cf-llz7t\" (UID: \"5868b402-1afc-434b-9f67-ca18ea32a685\") " pod="opendatahub/postgres-69fb4594cf-llz7t" Jun 13 03:56:07.647866 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.647831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r95p\" (UniqueName: \"kubernetes.io/projected/5868b402-1afc-434b-9f67-ca18ea32a685-kube-api-access-2r95p\") pod \"postgres-69fb4594cf-llz7t\" (UID: \"5868b402-1afc-434b-9f67-ca18ea32a685\") " pod="opendatahub/postgres-69fb4594cf-llz7t" Jun 13 03:56:07.647866 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.647870 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5868b402-1afc-434b-9f67-ca18ea32a685-data\") pod \"postgres-69fb4594cf-llz7t\" (UID: \"5868b402-1afc-434b-9f67-ca18ea32a685\") " pod="opendatahub/postgres-69fb4594cf-llz7t" Jun 13 03:56:07.648252 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.648237 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5868b402-1afc-434b-9f67-ca18ea32a685-data\") pod \"postgres-69fb4594cf-llz7t\" (UID: \"5868b402-1afc-434b-9f67-ca18ea32a685\") " pod="opendatahub/postgres-69fb4594cf-llz7t" Jun 13 03:56:07.655409 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.655387 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r95p\" (UniqueName: \"kubernetes.io/projected/5868b402-1afc-434b-9f67-ca18ea32a685-kube-api-access-2r95p\") pod \"postgres-69fb4594cf-llz7t\" (UID: \"5868b402-1afc-434b-9f67-ca18ea32a685\") " pod="opendatahub/postgres-69fb4594cf-llz7t" Jun 13 03:56:07.783234 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.783137 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-llz7t" Jun 13 03:56:07.910013 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.909985 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-llz7t"] Jun 13 03:56:07.911583 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:56:07.911553 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5868b402_1afc_434b_9f67_ca18ea32a685.slice/crio-8138d3d25e5e203fff24563e0054f5769ad59bf750552e04cb1b41367b9d22b7 WatchSource:0}: Error finding container 8138d3d25e5e203fff24563e0054f5769ad59bf750552e04cb1b41367b9d22b7: Status 404 returned error can't find the container with id 8138d3d25e5e203fff24563e0054f5769ad59bf750552e04cb1b41367b9d22b7 Jun 13 03:56:07.993428 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:07.993389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-llz7t" event={"ID":"5868b402-1afc-434b-9f67-ca18ea32a685","Type":"ContainerStarted","Data":"8138d3d25e5e203fff24563e0054f5769ad59bf750552e04cb1b41367b9d22b7"} Jun 13 03:56:11.015447 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:11.015419 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-llz7t" Jun 13 03:56:11.015925 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:11.015465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-llz7t" event={"ID":"5868b402-1afc-434b-9f67-ca18ea32a685","Type":"ContainerStarted","Data":"577fb3934889ecd2736894483d70962b33d8a89e8f74d2aae26fb9720b1c68fd"} Jun 13 03:56:11.030085 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:11.030041 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-llz7t" podStartSLOduration=1.075007667 podStartE2EDuration="4.030027704s" totalImagesPullingTime="2.955020037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:56:11.028693444 +0000 UTC m=+730.502187197" watchObservedRunningTime="2026-06-13 03:56:11.030027704 +0000 UTC m=+730.503521456" Jun 13 03:56:17.050440 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:17.050412 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-llz7t" Jun 13 03:56:18.420252 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.420215 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks"] Jun 13 03:56:18.425374 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.425338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" Jun 13 03:56:18.428008 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.427986 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 03:56:18.429208 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.429184 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 03:56:18.429311 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.429194 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hf8qg\"" Jun 13 03:56:18.431898 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.431876 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks"] Jun 13 03:56:18.539841 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.539812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914c9925-1e02-48d5-84ac-04a29457f2d9-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks\" (UID: \"914c9925-1e02-48d5-84ac-04a29457f2d9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" Jun 13 03:56:18.540012 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.539866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78zc6\" (UniqueName: \"kubernetes.io/projected/914c9925-1e02-48d5-84ac-04a29457f2d9-kube-api-access-78zc6\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks\" (UID: \"914c9925-1e02-48d5-84ac-04a29457f2d9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" Jun 13 03:56:18.540012 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.539897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914c9925-1e02-48d5-84ac-04a29457f2d9-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks\" (UID: \"914c9925-1e02-48d5-84ac-04a29457f2d9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" Jun 13 03:56:18.640599 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.640564 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914c9925-1e02-48d5-84ac-04a29457f2d9-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks\" (UID: \"914c9925-1e02-48d5-84ac-04a29457f2d9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" Jun 13 03:56:18.640782 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.640609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78zc6\" (UniqueName: \"kubernetes.io/projected/914c9925-1e02-48d5-84ac-04a29457f2d9-kube-api-access-78zc6\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks\" (UID: \"914c9925-1e02-48d5-84ac-04a29457f2d9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" Jun 13 03:56:18.640782 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.640626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914c9925-1e02-48d5-84ac-04a29457f2d9-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks\" (UID: \"914c9925-1e02-48d5-84ac-04a29457f2d9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" Jun 13 03:56:18.640983 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.640965 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914c9925-1e02-48d5-84ac-04a29457f2d9-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks\" (UID: \"914c9925-1e02-48d5-84ac-04a29457f2d9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" Jun 13 03:56:18.641070 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.641045 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914c9925-1e02-48d5-84ac-04a29457f2d9-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks\" (UID: \"914c9925-1e02-48d5-84ac-04a29457f2d9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" Jun 13 03:56:18.648798 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.648772 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78zc6\" (UniqueName: \"kubernetes.io/projected/914c9925-1e02-48d5-84ac-04a29457f2d9-kube-api-access-78zc6\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks\" (UID: \"914c9925-1e02-48d5-84ac-04a29457f2d9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" Jun 13 03:56:18.735687 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.735599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" Jun 13 03:56:18.862196 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:18.862167 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks"] Jun 13 03:56:18.863593 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:56:18.863552 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914c9925_1e02_48d5_84ac_04a29457f2d9.slice/crio-705cadd93f8214dfb0e2ce439224234582a6b8e277ca385889050add7c21a936 WatchSource:0}: Error finding container 705cadd93f8214dfb0e2ce439224234582a6b8e277ca385889050add7c21a936: Status 404 returned error can't find the container with id 705cadd93f8214dfb0e2ce439224234582a6b8e277ca385889050add7c21a936 Jun 13 03:56:19.053425 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:19.053334 2562 generic.go:356] "Generic (PLEG): container finished" podID="914c9925-1e02-48d5-84ac-04a29457f2d9" containerID="348ea50651096df253aef571a7a13489844d57e3b7134ce35267fcf187309bd0" exitCode=0 Jun 13 03:56:19.053425 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:19.053395 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" event={"ID":"914c9925-1e02-48d5-84ac-04a29457f2d9","Type":"ContainerDied","Data":"348ea50651096df253aef571a7a13489844d57e3b7134ce35267fcf187309bd0"} Jun 13 03:56:19.053610 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:19.053435 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" event={"ID":"914c9925-1e02-48d5-84ac-04a29457f2d9","Type":"ContainerStarted","Data":"705cadd93f8214dfb0e2ce439224234582a6b8e277ca385889050add7c21a936"} Jun 13 03:56:20.059902 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:20.059804 2562 generic.go:356] "Generic (PLEG): container finished" podID="914c9925-1e02-48d5-84ac-04a29457f2d9" containerID="8bcdc85a8d2facaae229fa78b7fbece1d875c6e2f43ab7c28a011103d013cd2b" exitCode=0 Jun 13 03:56:20.060251 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:20.059895 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" event={"ID":"914c9925-1e02-48d5-84ac-04a29457f2d9","Type":"ContainerDied","Data":"8bcdc85a8d2facaae229fa78b7fbece1d875c6e2f43ab7c28a011103d013cd2b"} Jun 13 03:56:21.067211 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:21.067168 2562 generic.go:356] "Generic (PLEG): container finished" podID="914c9925-1e02-48d5-84ac-04a29457f2d9" containerID="f348d4d511d612850190e6bcab5caa7cc19d19b2488940087f9fcd1c7d8324bf" exitCode=0 Jun 13 03:56:21.067211 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:21.067204 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" event={"ID":"914c9925-1e02-48d5-84ac-04a29457f2d9","Type":"ContainerDied","Data":"f348d4d511d612850190e6bcab5caa7cc19d19b2488940087f9fcd1c7d8324bf"} Jun 13 03:56:22.258882 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:22.258851 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" Jun 13 03:56:22.372527 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:22.372459 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78zc6\" (UniqueName: \"kubernetes.io/projected/914c9925-1e02-48d5-84ac-04a29457f2d9-kube-api-access-78zc6\") pod \"914c9925-1e02-48d5-84ac-04a29457f2d9\" (UID: \"914c9925-1e02-48d5-84ac-04a29457f2d9\") " Jun 13 03:56:22.372658 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:22.372560 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914c9925-1e02-48d5-84ac-04a29457f2d9-bundle\") pod \"914c9925-1e02-48d5-84ac-04a29457f2d9\" (UID: \"914c9925-1e02-48d5-84ac-04a29457f2d9\") " Jun 13 03:56:22.372658 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:22.372579 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914c9925-1e02-48d5-84ac-04a29457f2d9-util\") pod \"914c9925-1e02-48d5-84ac-04a29457f2d9\" (UID: \"914c9925-1e02-48d5-84ac-04a29457f2d9\") " Jun 13 03:56:22.373045 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:22.373013 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914c9925-1e02-48d5-84ac-04a29457f2d9-bundle" (OuterVolumeSpecName: "bundle") pod "914c9925-1e02-48d5-84ac-04a29457f2d9" (UID: "914c9925-1e02-48d5-84ac-04a29457f2d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:56:22.374498 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:22.374477 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/914c9925-1e02-48d5-84ac-04a29457f2d9-kube-api-access-78zc6" (OuterVolumeSpecName: "kube-api-access-78zc6") pod "914c9925-1e02-48d5-84ac-04a29457f2d9" (UID: "914c9925-1e02-48d5-84ac-04a29457f2d9"). InnerVolumeSpecName "kube-api-access-78zc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:56:22.377959 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:22.377936 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914c9925-1e02-48d5-84ac-04a29457f2d9-util" (OuterVolumeSpecName: "util") pod "914c9925-1e02-48d5-84ac-04a29457f2d9" (UID: "914c9925-1e02-48d5-84ac-04a29457f2d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 03:56:22.473773 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:22.473741 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914c9925-1e02-48d5-84ac-04a29457f2d9-bundle\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:56:22.473773 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:22.473764 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914c9925-1e02-48d5-84ac-04a29457f2d9-util\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:56:22.473773 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:22.473773 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78zc6\" (UniqueName: \"kubernetes.io/projected/914c9925-1e02-48d5-84ac-04a29457f2d9-kube-api-access-78zc6\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:56:23.079138 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:23.079105 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" event={"ID":"914c9925-1e02-48d5-84ac-04a29457f2d9","Type":"ContainerDied","Data":"705cadd93f8214dfb0e2ce439224234582a6b8e277ca385889050add7c21a936"} Jun 13 03:56:23.079304 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:23.079150 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="705cadd93f8214dfb0e2ce439224234582a6b8e277ca385889050add7c21a936" Jun 13 03:56:23.079304 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:23.079160 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748q8rks" Jun 13 03:56:40.943699 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.943670 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 03:56:40.944139 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.944007 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914c9925-1e02-48d5-84ac-04a29457f2d9" containerName="pull" Jun 13 03:56:40.944139 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.944020 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="914c9925-1e02-48d5-84ac-04a29457f2d9" containerName="pull" Jun 13 03:56:40.944139 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.944029 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914c9925-1e02-48d5-84ac-04a29457f2d9" containerName="util" Jun 13 03:56:40.944139 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.944034 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="914c9925-1e02-48d5-84ac-04a29457f2d9" containerName="util" Jun 13 03:56:40.944139 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.944044 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914c9925-1e02-48d5-84ac-04a29457f2d9" containerName="extract" Jun 13 03:56:40.944139 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.944049 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="914c9925-1e02-48d5-84ac-04a29457f2d9" containerName="extract" Jun 13 03:56:40.944139 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.944103 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="914c9925-1e02-48d5-84ac-04a29457f2d9" containerName="extract" Jun 13 03:56:40.950819 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.950797 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 03:56:40.953510 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.953488 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 13 03:56:40.953717 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.953512 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lhvr9\"" Jun 13 03:56:40.953795 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.953568 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 03:56:40.953795 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.953579 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 03:56:40.955834 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:40.955810 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 03:56:41.115002 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:41.114977 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bljsq\" (UniqueName: \"kubernetes.io/projected/f88c9dac-1813-4395-b8f2-b95a82922cdb-kube-api-access-bljsq\") pod \"maas-keycloak-0\" (UID: \"f88c9dac-1813-4395-b8f2-b95a82922cdb\") " pod="keycloak-system/maas-keycloak-0" Jun 13 03:56:41.216386 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:41.216304 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bljsq\" (UniqueName: \"kubernetes.io/projected/f88c9dac-1813-4395-b8f2-b95a82922cdb-kube-api-access-bljsq\") pod \"maas-keycloak-0\" (UID: \"f88c9dac-1813-4395-b8f2-b95a82922cdb\") " pod="keycloak-system/maas-keycloak-0" Jun 13 03:56:41.225710 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:41.225686 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bljsq\" (UniqueName: \"kubernetes.io/projected/f88c9dac-1813-4395-b8f2-b95a82922cdb-kube-api-access-bljsq\") pod \"maas-keycloak-0\" (UID: \"f88c9dac-1813-4395-b8f2-b95a82922cdb\") " pod="keycloak-system/maas-keycloak-0" Jun 13 03:56:41.261102 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:41.261078 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 03:56:41.389417 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:41.389385 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 03:56:41.390170 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:56:41.390139 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88c9dac_1813_4395_b8f2_b95a82922cdb.slice/crio-bba8fbded2c1e830fe841da45f466a3b88646c5b529409f1b7793c169581d047 WatchSource:0}: Error finding container bba8fbded2c1e830fe841da45f466a3b88646c5b529409f1b7793c169581d047: Status 404 returned error can't find the container with id bba8fbded2c1e830fe841da45f466a3b88646c5b529409f1b7793c169581d047 Jun 13 03:56:42.177588 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:42.177543 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f88c9dac-1813-4395-b8f2-b95a82922cdb","Type":"ContainerStarted","Data":"bba8fbded2c1e830fe841da45f466a3b88646c5b529409f1b7793c169581d047"} Jun 13 03:56:47.212973 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:47.212926 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f88c9dac-1813-4395-b8f2-b95a82922cdb","Type":"ContainerStarted","Data":"80a6848cdca635fd243ea04c782a502c58f6da8e52a959c84b767a83c97e7be8"} Jun 13 03:56:47.229747 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:47.229689 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.932911602 podStartE2EDuration="7.229651963s" totalImagesPullingTime="5.296740361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:56:47.229372936 +0000 UTC m=+766.702866688" watchObservedRunningTime="2026-06-13 03:56:47.229651963 +0000 UTC m=+766.703145716" Jun 13 03:56:47.262339 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:47.262308 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 13 03:56:47.264218 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:47.264184 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 13 03:56:48.261839 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:48.261783 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 13 03:56:49.261872 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:49.261834 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 13 03:56:50.262298 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:50.262240 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 13 03:56:51.261543 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:51.261501 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 13 03:56:51.261813 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:51.261773 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 13 03:56:52.261730 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:52.261684 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 13 03:56:53.261591 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:53.261542 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 13 03:56:54.262445 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:54.262399 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 13 03:56:55.261659 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:55.261605 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 13 03:56:56.262624 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:56.262577 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 13 03:56:57.261734 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:57.261673 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 13 03:56:58.262348 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:58.262296 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 13 03:56:59.262233 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:56:59.262177 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 13 03:57:00.390926 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:00.390887 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 13 03:57:00.408634 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:00.408578 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 03:57:10.398192 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:10.398162 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 13 03:57:11.255801 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.255771 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-scpgw"] Jun 13 03:57:11.264869 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.264841 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-scpgw" Jun 13 03:57:11.265085 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.265063 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-scpgw"] Jun 13 03:57:11.376985 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.376956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8882\" (UniqueName: \"kubernetes.io/projected/b883dfc7-7081-47de-9d41-b3cbda4a215e-kube-api-access-n8882\") pod \"authorino-5d4b67c446-scpgw\" (UID: \"b883dfc7-7081-47de-9d41-b3cbda4a215e\") " pod="kuadrant-system/authorino-5d4b67c446-scpgw" Jun 13 03:57:11.438406 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.438357 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-scpgw"] Jun 13 03:57:11.438766 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:57:11.438599 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-n8882], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-scpgw" podUID="b883dfc7-7081-47de-9d41-b3cbda4a215e" Jun 13 03:57:11.459436 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.459407 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-cj6b7"] Jun 13 03:57:11.461710 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.461695 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-cj6b7" Jun 13 03:57:11.464085 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.464064 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 13 03:57:11.471368 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.471334 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-cj6b7"] Jun 13 03:57:11.478323 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.478302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8882\" (UniqueName: \"kubernetes.io/projected/b883dfc7-7081-47de-9d41-b3cbda4a215e-kube-api-access-n8882\") pod \"authorino-5d4b67c446-scpgw\" (UID: \"b883dfc7-7081-47de-9d41-b3cbda4a215e\") " pod="kuadrant-system/authorino-5d4b67c446-scpgw" Jun 13 03:57:11.485726 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.485702 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8882\" (UniqueName: \"kubernetes.io/projected/b883dfc7-7081-47de-9d41-b3cbda4a215e-kube-api-access-n8882\") pod \"authorino-5d4b67c446-scpgw\" (UID: \"b883dfc7-7081-47de-9d41-b3cbda4a215e\") " pod="kuadrant-system/authorino-5d4b67c446-scpgw" Jun 13 03:57:11.508974 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.508916 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-cj6b7"] Jun 13 03:57:11.509132 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:57:11.509112 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5lsxq tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-5lsxq tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-cj6b7" podUID="dc69c9f8-e180-436e-9199-a740e72c8454" Jun 13 03:57:11.530277 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.530253 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d77fdb948-6g9q7"] Jun 13 03:57:11.532448 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.532434 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d77fdb948-6g9q7" Jun 13 03:57:11.542197 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.542176 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d77fdb948-6g9q7"] Jun 13 03:57:11.579022 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.578998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc69c9f8-e180-436e-9199-a740e72c8454-tls-cert\") pod \"authorino-76877994-cj6b7\" (UID: \"dc69c9f8-e180-436e-9199-a740e72c8454\") " pod="kuadrant-system/authorino-76877994-cj6b7" Jun 13 03:57:11.579118 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.579042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lsxq\" (UniqueName: \"kubernetes.io/projected/dc69c9f8-e180-436e-9199-a740e72c8454-kube-api-access-5lsxq\") pod \"authorino-76877994-cj6b7\" (UID: \"dc69c9f8-e180-436e-9199-a740e72c8454\") " pod="kuadrant-system/authorino-76877994-cj6b7" Jun 13 03:57:11.579118 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.579062 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7440066a-4b32-4dd7-a09d-5c987bea5189-tls-cert\") pod \"authorino-5d77fdb948-6g9q7\" (UID: \"7440066a-4b32-4dd7-a09d-5c987bea5189\") " pod="kuadrant-system/authorino-5d77fdb948-6g9q7" Jun 13 03:57:11.579118 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.579080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdjmj\" (UniqueName: \"kubernetes.io/projected/7440066a-4b32-4dd7-a09d-5c987bea5189-kube-api-access-jdjmj\") pod \"authorino-5d77fdb948-6g9q7\" (UID: \"7440066a-4b32-4dd7-a09d-5c987bea5189\") " pod="kuadrant-system/authorino-5d77fdb948-6g9q7" Jun 13 03:57:11.680249 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.680230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdjmj\" (UniqueName: \"kubernetes.io/projected/7440066a-4b32-4dd7-a09d-5c987bea5189-kube-api-access-jdjmj\") pod \"authorino-5d77fdb948-6g9q7\" (UID: \"7440066a-4b32-4dd7-a09d-5c987bea5189\") " pod="kuadrant-system/authorino-5d77fdb948-6g9q7" Jun 13 03:57:11.680350 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.680273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc69c9f8-e180-436e-9199-a740e72c8454-tls-cert\") pod \"authorino-76877994-cj6b7\" (UID: \"dc69c9f8-e180-436e-9199-a740e72c8454\") " pod="kuadrant-system/authorino-76877994-cj6b7" Jun 13 03:57:11.680350 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.680317 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lsxq\" (UniqueName: \"kubernetes.io/projected/dc69c9f8-e180-436e-9199-a740e72c8454-kube-api-access-5lsxq\") pod \"authorino-76877994-cj6b7\" (UID: \"dc69c9f8-e180-436e-9199-a740e72c8454\") " pod="kuadrant-system/authorino-76877994-cj6b7" Jun 13 03:57:11.680350 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.680337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7440066a-4b32-4dd7-a09d-5c987bea5189-tls-cert\") pod \"authorino-5d77fdb948-6g9q7\" (UID: \"7440066a-4b32-4dd7-a09d-5c987bea5189\") " pod="kuadrant-system/authorino-5d77fdb948-6g9q7" Jun 13 03:57:11.682809 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.682785 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc69c9f8-e180-436e-9199-a740e72c8454-tls-cert\") pod \"authorino-76877994-cj6b7\" (UID: \"dc69c9f8-e180-436e-9199-a740e72c8454\") " pod="kuadrant-system/authorino-76877994-cj6b7" Jun 13 03:57:11.682894 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.682788 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7440066a-4b32-4dd7-a09d-5c987bea5189-tls-cert\") pod \"authorino-5d77fdb948-6g9q7\" (UID: \"7440066a-4b32-4dd7-a09d-5c987bea5189\") " pod="kuadrant-system/authorino-5d77fdb948-6g9q7" Jun 13 03:57:11.687595 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.687576 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdjmj\" (UniqueName: \"kubernetes.io/projected/7440066a-4b32-4dd7-a09d-5c987bea5189-kube-api-access-jdjmj\") pod \"authorino-5d77fdb948-6g9q7\" (UID: \"7440066a-4b32-4dd7-a09d-5c987bea5189\") " pod="kuadrant-system/authorino-5d77fdb948-6g9q7" Jun 13 03:57:11.687823 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.687802 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lsxq\" (UniqueName: \"kubernetes.io/projected/dc69c9f8-e180-436e-9199-a740e72c8454-kube-api-access-5lsxq\") pod \"authorino-76877994-cj6b7\" (UID: \"dc69c9f8-e180-436e-9199-a740e72c8454\") " pod="kuadrant-system/authorino-76877994-cj6b7" Jun 13 03:57:11.841006 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.840935 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d77fdb948-6g9q7" Jun 13 03:57:11.967136 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.967103 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d77fdb948-6g9q7"] Jun 13 03:57:11.968027 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:57:11.968002 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7440066a_4b32_4dd7_a09d_5c987bea5189.slice/crio-2936277e2404c611b7f4e81980d3b145dea434983edba2475e8e1f7a9b5db621 WatchSource:0}: Error finding container 2936277e2404c611b7f4e81980d3b145dea434983edba2475e8e1f7a9b5db621: Status 404 returned error can't find the container with id 2936277e2404c611b7f4e81980d3b145dea434983edba2475e8e1f7a9b5db621 Jun 13 03:57:11.969386 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:11.969347 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 03:57:12.389894 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.389871 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-cj6b7" Jun 13 03:57:12.390025 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.389904 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-scpgw" Jun 13 03:57:12.390025 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.389871 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d77fdb948-6g9q7" event={"ID":"7440066a-4b32-4dd7-a09d-5c987bea5189","Type":"ContainerStarted","Data":"3bd338d0311534bf528da7dc15c53b9fde616bd4aff209ad52369213d2939e21"} Jun 13 03:57:12.390025 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.389966 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d77fdb948-6g9q7" event={"ID":"7440066a-4b32-4dd7-a09d-5c987bea5189","Type":"ContainerStarted","Data":"2936277e2404c611b7f4e81980d3b145dea434983edba2475e8e1f7a9b5db621"} Jun 13 03:57:12.395862 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.395845 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-cj6b7" Jun 13 03:57:12.399696 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.399670 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-scpgw" Jun 13 03:57:12.405039 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.404996 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d77fdb948-6g9q7" podStartSLOduration=1.058972598 podStartE2EDuration="1.404982444s" totalImagesPullingTime="346.009846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:57:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:57:12.403529087 +0000 UTC m=+791.877022842" watchObservedRunningTime="2026-06-13 03:57:12.404982444 +0000 UTC m=+791.878476191" Jun 13 03:57:12.426924 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.426895 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rgc7x"] Jun 13 03:57:12.427117 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.427095 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-rgc7x" podUID="08d28844-d9c8-4c54-8a4f-c7684b3c9fb7" containerName="authorino" containerID="cri-o://740b3340174cbdce881779bd38a72c3e3e4abe81324a688d32135f9942a32908" gracePeriod=30 Jun 13 03:57:12.489030 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.488995 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lsxq\" (UniqueName: \"kubernetes.io/projected/dc69c9f8-e180-436e-9199-a740e72c8454-kube-api-access-5lsxq\") pod \"dc69c9f8-e180-436e-9199-a740e72c8454\" (UID: \"dc69c9f8-e180-436e-9199-a740e72c8454\") " Jun 13 03:57:12.489481 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.489089 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8882\" (UniqueName: \"kubernetes.io/projected/b883dfc7-7081-47de-9d41-b3cbda4a215e-kube-api-access-n8882\") pod \"b883dfc7-7081-47de-9d41-b3cbda4a215e\" (UID: \"b883dfc7-7081-47de-9d41-b3cbda4a215e\") " Jun 13 03:57:12.489481 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.489126 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc69c9f8-e180-436e-9199-a740e72c8454-tls-cert\") pod \"dc69c9f8-e180-436e-9199-a740e72c8454\" (UID: \"dc69c9f8-e180-436e-9199-a740e72c8454\") " Jun 13 03:57:12.491101 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.491077 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc69c9f8-e180-436e-9199-a740e72c8454-kube-api-access-5lsxq" (OuterVolumeSpecName: "kube-api-access-5lsxq") pod "dc69c9f8-e180-436e-9199-a740e72c8454" (UID: "dc69c9f8-e180-436e-9199-a740e72c8454"). InnerVolumeSpecName "kube-api-access-5lsxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:57:12.491513 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.491492 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc69c9f8-e180-436e-9199-a740e72c8454-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dc69c9f8-e180-436e-9199-a740e72c8454" (UID: "dc69c9f8-e180-436e-9199-a740e72c8454"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:57:12.491671 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.491650 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b883dfc7-7081-47de-9d41-b3cbda4a215e-kube-api-access-n8882" (OuterVolumeSpecName: "kube-api-access-n8882") pod "b883dfc7-7081-47de-9d41-b3cbda4a215e" (UID: "b883dfc7-7081-47de-9d41-b3cbda4a215e"). InnerVolumeSpecName "kube-api-access-n8882". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:57:12.590004 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.589975 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8882\" (UniqueName: \"kubernetes.io/projected/b883dfc7-7081-47de-9d41-b3cbda4a215e-kube-api-access-n8882\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:57:12.590004 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.590004 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc69c9f8-e180-436e-9199-a740e72c8454-tls-cert\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:57:12.590164 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.590018 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lsxq\" (UniqueName: \"kubernetes.io/projected/dc69c9f8-e180-436e-9199-a740e72c8454-kube-api-access-5lsxq\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:57:12.668451 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.668426 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rgc7x" Jun 13 03:57:12.792048 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.792022 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zjl4\" (UniqueName: \"kubernetes.io/projected/08d28844-d9c8-4c54-8a4f-c7684b3c9fb7-kube-api-access-8zjl4\") pod \"08d28844-d9c8-4c54-8a4f-c7684b3c9fb7\" (UID: \"08d28844-d9c8-4c54-8a4f-c7684b3c9fb7\") " Jun 13 03:57:12.793948 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.793916 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08d28844-d9c8-4c54-8a4f-c7684b3c9fb7-kube-api-access-8zjl4" (OuterVolumeSpecName: "kube-api-access-8zjl4") pod "08d28844-d9c8-4c54-8a4f-c7684b3c9fb7" (UID: "08d28844-d9c8-4c54-8a4f-c7684b3c9fb7"). InnerVolumeSpecName "kube-api-access-8zjl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:57:12.892956 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:12.892932 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zjl4\" (UniqueName: \"kubernetes.io/projected/08d28844-d9c8-4c54-8a4f-c7684b3c9fb7-kube-api-access-8zjl4\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:57:13.396632 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.396600 2562 generic.go:356] "Generic (PLEG): container finished" podID="08d28844-d9c8-4c54-8a4f-c7684b3c9fb7" containerID="740b3340174cbdce881779bd38a72c3e3e4abe81324a688d32135f9942a32908" exitCode=0 Jun 13 03:57:13.396784 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.396658 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rgc7x" Jun 13 03:57:13.396784 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.396677 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rgc7x" event={"ID":"08d28844-d9c8-4c54-8a4f-c7684b3c9fb7","Type":"ContainerDied","Data":"740b3340174cbdce881779bd38a72c3e3e4abe81324a688d32135f9942a32908"} Jun 13 03:57:13.396784 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.396715 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rgc7x" event={"ID":"08d28844-d9c8-4c54-8a4f-c7684b3c9fb7","Type":"ContainerDied","Data":"df095c08218cf0fc2a2f5ee26275dda600f06f8fe85205868f7943a41e247cbf"} Jun 13 03:57:13.396784 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.396731 2562 scope.go:117] "RemoveContainer" containerID="740b3340174cbdce881779bd38a72c3e3e4abe81324a688d32135f9942a32908" Jun 13 03:57:13.396784 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.396767 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-scpgw" Jun 13 03:57:13.397031 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.396998 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-cj6b7" Jun 13 03:57:13.405979 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.405962 2562 scope.go:117] "RemoveContainer" containerID="740b3340174cbdce881779bd38a72c3e3e4abe81324a688d32135f9942a32908" Jun 13 03:57:13.406232 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:57:13.406213 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"740b3340174cbdce881779bd38a72c3e3e4abe81324a688d32135f9942a32908\": container with ID starting with 740b3340174cbdce881779bd38a72c3e3e4abe81324a688d32135f9942a32908 not found: ID does not exist" containerID="740b3340174cbdce881779bd38a72c3e3e4abe81324a688d32135f9942a32908" Jun 13 03:57:13.406310 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.406236 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"740b3340174cbdce881779bd38a72c3e3e4abe81324a688d32135f9942a32908"} err="failed to get container status \"740b3340174cbdce881779bd38a72c3e3e4abe81324a688d32135f9942a32908\": rpc error: code = NotFound desc = could not find container \"740b3340174cbdce881779bd38a72c3e3e4abe81324a688d32135f9942a32908\": container with ID starting with 740b3340174cbdce881779bd38a72c3e3e4abe81324a688d32135f9942a32908 not found: ID does not exist" Jun 13 03:57:13.424192 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.424168 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-cj6b7"] Jun 13 03:57:13.427244 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.427223 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-cj6b7"] Jun 13 03:57:13.437972 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.437947 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rgc7x"] Jun 13 03:57:13.441136 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.441116 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rgc7x"] Jun 13 03:57:13.460598 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.460576 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-scpgw"] Jun 13 03:57:13.462517 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:13.462498 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-scpgw"] Jun 13 03:57:15.015753 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:15.015720 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08d28844-d9c8-4c54-8a4f-c7684b3c9fb7" path="/var/lib/kubelet/pods/08d28844-d9c8-4c54-8a4f-c7684b3c9fb7/volumes" Jun 13 03:57:15.016094 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:15.016015 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b883dfc7-7081-47de-9d41-b3cbda4a215e" path="/var/lib/kubelet/pods/b883dfc7-7081-47de-9d41-b3cbda4a215e/volumes" Jun 13 03:57:15.016224 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:15.016213 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc69c9f8-e180-436e-9199-a740e72c8454" path="/var/lib/kubelet/pods/dc69c9f8-e180-436e-9199-a740e72c8454/volumes" Jun 13 03:57:15.962119 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:15.962085 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84765b7449-twvvf"] Jun 13 03:57:15.962518 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:15.962499 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08d28844-d9c8-4c54-8a4f-c7684b3c9fb7" containerName="authorino" Jun 13 03:57:15.962518 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:15.962520 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="08d28844-d9c8-4c54-8a4f-c7684b3c9fb7" containerName="authorino" Jun 13 03:57:15.962684 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:15.962599 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="08d28844-d9c8-4c54-8a4f-c7684b3c9fb7" containerName="authorino" Jun 13 03:57:15.965078 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:15.965057 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84765b7449-twvvf" Jun 13 03:57:15.967657 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:15.967638 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lm67f\"" Jun 13 03:57:15.967657 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:15.967652 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 13 03:57:15.967835 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:15.967668 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 13 03:57:15.976845 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:15.976818 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84765b7449-twvvf"] Jun 13 03:57:16.011332 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.011312 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1330a3d5-bd8f-4919-b691-557fc6f2aeb4-webhook-cert\") pod \"maas-controller-84765b7449-twvvf\" (UID: \"1330a3d5-bd8f-4919-b691-557fc6f2aeb4\") " pod="opendatahub/maas-controller-84765b7449-twvvf" Jun 13 03:57:16.011446 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.011342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rg6j\" (UniqueName: \"kubernetes.io/projected/1330a3d5-bd8f-4919-b691-557fc6f2aeb4-kube-api-access-2rg6j\") pod \"maas-controller-84765b7449-twvvf\" (UID: \"1330a3d5-bd8f-4919-b691-557fc6f2aeb4\") " pod="opendatahub/maas-controller-84765b7449-twvvf" Jun 13 03:57:16.108738 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.108705 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8555d7d8d8-gh2tm"] Jun 13 03:57:16.110908 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.110892 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8555d7d8d8-gh2tm" Jun 13 03:57:16.112562 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.112540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1330a3d5-bd8f-4919-b691-557fc6f2aeb4-webhook-cert\") pod \"maas-controller-84765b7449-twvvf\" (UID: \"1330a3d5-bd8f-4919-b691-557fc6f2aeb4\") " pod="opendatahub/maas-controller-84765b7449-twvvf" Jun 13 03:57:16.112661 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.112575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rg6j\" (UniqueName: \"kubernetes.io/projected/1330a3d5-bd8f-4919-b691-557fc6f2aeb4-kube-api-access-2rg6j\") pod \"maas-controller-84765b7449-twvvf\" (UID: \"1330a3d5-bd8f-4919-b691-557fc6f2aeb4\") " pod="opendatahub/maas-controller-84765b7449-twvvf" Jun 13 03:57:16.115040 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.115019 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1330a3d5-bd8f-4919-b691-557fc6f2aeb4-webhook-cert\") pod \"maas-controller-84765b7449-twvvf\" (UID: \"1330a3d5-bd8f-4919-b691-557fc6f2aeb4\") " pod="opendatahub/maas-controller-84765b7449-twvvf" Jun 13 03:57:16.118797 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.118776 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8555d7d8d8-gh2tm"] Jun 13 03:57:16.121110 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.121087 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rg6j\" (UniqueName: \"kubernetes.io/projected/1330a3d5-bd8f-4919-b691-557fc6f2aeb4-kube-api-access-2rg6j\") pod \"maas-controller-84765b7449-twvvf\" (UID: \"1330a3d5-bd8f-4919-b691-557fc6f2aeb4\") " pod="opendatahub/maas-controller-84765b7449-twvvf" Jun 13 03:57:16.213831 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.213768 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5sw9\" (UniqueName: \"kubernetes.io/projected/f25b29e4-2544-4796-98be-a28a231fcb27-kube-api-access-d5sw9\") pod \"maas-controller-8555d7d8d8-gh2tm\" (UID: \"f25b29e4-2544-4796-98be-a28a231fcb27\") " pod="opendatahub/maas-controller-8555d7d8d8-gh2tm" Jun 13 03:57:16.213954 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.213877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f25b29e4-2544-4796-98be-a28a231fcb27-webhook-cert\") pod \"maas-controller-8555d7d8d8-gh2tm\" (UID: \"f25b29e4-2544-4796-98be-a28a231fcb27\") " pod="opendatahub/maas-controller-8555d7d8d8-gh2tm" Jun 13 03:57:16.277880 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.277853 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84765b7449-twvvf" Jun 13 03:57:16.315185 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.315160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f25b29e4-2544-4796-98be-a28a231fcb27-webhook-cert\") pod \"maas-controller-8555d7d8d8-gh2tm\" (UID: \"f25b29e4-2544-4796-98be-a28a231fcb27\") " pod="opendatahub/maas-controller-8555d7d8d8-gh2tm" Jun 13 03:57:16.315298 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.315200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5sw9\" (UniqueName: \"kubernetes.io/projected/f25b29e4-2544-4796-98be-a28a231fcb27-kube-api-access-d5sw9\") pod \"maas-controller-8555d7d8d8-gh2tm\" (UID: \"f25b29e4-2544-4796-98be-a28a231fcb27\") " pod="opendatahub/maas-controller-8555d7d8d8-gh2tm" Jun 13 03:57:16.318085 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.318065 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f25b29e4-2544-4796-98be-a28a231fcb27-webhook-cert\") pod \"maas-controller-8555d7d8d8-gh2tm\" (UID: \"f25b29e4-2544-4796-98be-a28a231fcb27\") " pod="opendatahub/maas-controller-8555d7d8d8-gh2tm" Jun 13 03:57:16.323089 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.323069 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5sw9\" (UniqueName: \"kubernetes.io/projected/f25b29e4-2544-4796-98be-a28a231fcb27-kube-api-access-d5sw9\") pod \"maas-controller-8555d7d8d8-gh2tm\" (UID: \"f25b29e4-2544-4796-98be-a28a231fcb27\") " pod="opendatahub/maas-controller-8555d7d8d8-gh2tm" Jun 13 03:57:16.411786 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.411756 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84765b7449-twvvf"] Jun 13 03:57:16.412687 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:57:16.412661 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1330a3d5_bd8f_4919_b691_557fc6f2aeb4.slice/crio-89b6819feb1332192e3915016b956a2203ca610f366230c9eb6868c0a992e47b WatchSource:0}: Error finding container 89b6819feb1332192e3915016b956a2203ca610f366230c9eb6868c0a992e47b: Status 404 returned error can't find the container with id 89b6819feb1332192e3915016b956a2203ca610f366230c9eb6868c0a992e47b Jun 13 03:57:16.437588 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.437565 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8555d7d8d8-gh2tm" Jun 13 03:57:16.558794 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:16.558765 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8555d7d8d8-gh2tm"] Jun 13 03:57:16.559907 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:57:16.559881 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25b29e4_2544_4796_98be_a28a231fcb27.slice/crio-9914d6520f9c7715c4109af47fd3590345b9f5db936a49adf01d91c4c6531655 WatchSource:0}: Error finding container 9914d6520f9c7715c4109af47fd3590345b9f5db936a49adf01d91c4c6531655: Status 404 returned error can't find the container with id 9914d6520f9c7715c4109af47fd3590345b9f5db936a49adf01d91c4c6531655 Jun 13 03:57:17.428239 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:17.428136 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84765b7449-twvvf" event={"ID":"1330a3d5-bd8f-4919-b691-557fc6f2aeb4","Type":"ContainerStarted","Data":"89b6819feb1332192e3915016b956a2203ca610f366230c9eb6868c0a992e47b"} Jun 13 03:57:17.430673 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:17.430601 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8555d7d8d8-gh2tm" event={"ID":"f25b29e4-2544-4796-98be-a28a231fcb27","Type":"ContainerStarted","Data":"9914d6520f9c7715c4109af47fd3590345b9f5db936a49adf01d91c4c6531655"} Jun 13 03:57:19.445869 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:19.445827 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84765b7449-twvvf" event={"ID":"1330a3d5-bd8f-4919-b691-557fc6f2aeb4","Type":"ContainerStarted","Data":"505c0a1c2b347320ed0660532d76cb382a07d35eec558bfd5f427bfe725c1cc0"} Jun 13 03:57:19.446450 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:19.446009 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84765b7449-twvvf" Jun 13 03:57:19.447552 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:19.447510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8555d7d8d8-gh2tm" event={"ID":"f25b29e4-2544-4796-98be-a28a231fcb27","Type":"ContainerStarted","Data":"e5d3781e7b77703878c8a8f5a4baa3bed46484c3f8af65f2e0031240385cb64d"} Jun 13 03:57:19.447691 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:19.447632 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8555d7d8d8-gh2tm" Jun 13 03:57:19.461152 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:19.461090 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84765b7449-twvvf" podStartSLOduration=1.770866099 podStartE2EDuration="4.461058626s" totalImagesPullingTime="2.690192527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:57:19.460178634 +0000 UTC m=+798.933672388" watchObservedRunningTime="2026-06-13 03:57:19.461058626 +0000 UTC m=+798.934552457" Jun 13 03:57:19.479986 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:19.479937 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8555d7d8d8-gh2tm" podStartSLOduration=0.932736542 podStartE2EDuration="3.479923098s" totalImagesPullingTime="2.547186556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:57:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:57:19.47872221 +0000 UTC m=+798.952215966" watchObservedRunningTime="2026-06-13 03:57:19.479923098 +0000 UTC m=+798.953416850" Jun 13 03:57:30.457331 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:30.457298 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84765b7449-twvvf" Jun 13 03:57:30.457849 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:30.457830 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8555d7d8d8-gh2tm" Jun 13 03:57:30.508837 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:30.508786 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84765b7449-twvvf"] Jun 13 03:57:30.509045 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:30.508996 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-84765b7449-twvvf" podUID="1330a3d5-bd8f-4919-b691-557fc6f2aeb4" containerName="manager" containerID="cri-o://505c0a1c2b347320ed0660532d76cb382a07d35eec558bfd5f427bfe725c1cc0" gracePeriod=30 Jun 13 03:57:30.742758 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:30.742735 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84765b7449-twvvf" Jun 13 03:57:30.832584 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:30.832559 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rg6j\" (UniqueName: \"kubernetes.io/projected/1330a3d5-bd8f-4919-b691-557fc6f2aeb4-kube-api-access-2rg6j\") pod \"1330a3d5-bd8f-4919-b691-557fc6f2aeb4\" (UID: \"1330a3d5-bd8f-4919-b691-557fc6f2aeb4\") " Jun 13 03:57:30.832698 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:30.832595 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1330a3d5-bd8f-4919-b691-557fc6f2aeb4-webhook-cert\") pod \"1330a3d5-bd8f-4919-b691-557fc6f2aeb4\" (UID: \"1330a3d5-bd8f-4919-b691-557fc6f2aeb4\") " Jun 13 03:57:30.834620 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:30.834592 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1330a3d5-bd8f-4919-b691-557fc6f2aeb4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1330a3d5-bd8f-4919-b691-557fc6f2aeb4" (UID: "1330a3d5-bd8f-4919-b691-557fc6f2aeb4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 03:57:30.834748 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:30.834726 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1330a3d5-bd8f-4919-b691-557fc6f2aeb4-kube-api-access-2rg6j" (OuterVolumeSpecName: "kube-api-access-2rg6j") pod "1330a3d5-bd8f-4919-b691-557fc6f2aeb4" (UID: "1330a3d5-bd8f-4919-b691-557fc6f2aeb4"). InnerVolumeSpecName "kube-api-access-2rg6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 03:57:30.933390 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:30.933351 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rg6j\" (UniqueName: \"kubernetes.io/projected/1330a3d5-bd8f-4919-b691-557fc6f2aeb4-kube-api-access-2rg6j\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:57:30.933390 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:30.933387 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1330a3d5-bd8f-4919-b691-557fc6f2aeb4-webhook-cert\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 03:57:31.515055 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:31.515022 2562 generic.go:356] "Generic (PLEG): container finished" podID="1330a3d5-bd8f-4919-b691-557fc6f2aeb4" containerID="505c0a1c2b347320ed0660532d76cb382a07d35eec558bfd5f427bfe725c1cc0" exitCode=0 Jun 13 03:57:31.515514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:31.515070 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84765b7449-twvvf" event={"ID":"1330a3d5-bd8f-4919-b691-557fc6f2aeb4","Type":"ContainerDied","Data":"505c0a1c2b347320ed0660532d76cb382a07d35eec558bfd5f427bfe725c1cc0"} Jun 13 03:57:31.515514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:31.515108 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84765b7449-twvvf" event={"ID":"1330a3d5-bd8f-4919-b691-557fc6f2aeb4","Type":"ContainerDied","Data":"89b6819feb1332192e3915016b956a2203ca610f366230c9eb6868c0a992e47b"} Jun 13 03:57:31.515514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:31.515128 2562 scope.go:117] "RemoveContainer" containerID="505c0a1c2b347320ed0660532d76cb382a07d35eec558bfd5f427bfe725c1cc0" Jun 13 03:57:31.515514 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:31.515071 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84765b7449-twvvf" Jun 13 03:57:31.523796 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:31.523778 2562 scope.go:117] "RemoveContainer" containerID="505c0a1c2b347320ed0660532d76cb382a07d35eec558bfd5f427bfe725c1cc0" Jun 13 03:57:31.524062 ip-10-0-142-184 kubenswrapper[2562]: E0613 03:57:31.524043 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"505c0a1c2b347320ed0660532d76cb382a07d35eec558bfd5f427bfe725c1cc0\": container with ID starting with 505c0a1c2b347320ed0660532d76cb382a07d35eec558bfd5f427bfe725c1cc0 not found: ID does not exist" containerID="505c0a1c2b347320ed0660532d76cb382a07d35eec558bfd5f427bfe725c1cc0" Jun 13 03:57:31.524110 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:31.524070 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"505c0a1c2b347320ed0660532d76cb382a07d35eec558bfd5f427bfe725c1cc0"} err="failed to get container status \"505c0a1c2b347320ed0660532d76cb382a07d35eec558bfd5f427bfe725c1cc0\": rpc error: code = NotFound desc = could not find container \"505c0a1c2b347320ed0660532d76cb382a07d35eec558bfd5f427bfe725c1cc0\": container with ID starting with 505c0a1c2b347320ed0660532d76cb382a07d35eec558bfd5f427bfe725c1cc0 not found: ID does not exist" Jun 13 03:57:31.531787 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:31.531762 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84765b7449-twvvf"] Jun 13 03:57:31.535268 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:31.535248 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84765b7449-twvvf"] Jun 13 03:57:33.022232 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:33.022197 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1330a3d5-bd8f-4919-b691-557fc6f2aeb4" path="/var/lib/kubelet/pods/1330a3d5-bd8f-4919-b691-557fc6f2aeb4/volumes" Jun 13 03:57:51.095142 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.095106 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-66c8c4f788-8hxxv"] Jun 13 03:57:51.095607 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.095438 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1330a3d5-bd8f-4919-b691-557fc6f2aeb4" containerName="manager" Jun 13 03:57:51.095607 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.095451 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1330a3d5-bd8f-4919-b691-557fc6f2aeb4" containerName="manager" Jun 13 03:57:51.095607 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.095512 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1330a3d5-bd8f-4919-b691-557fc6f2aeb4" containerName="manager" Jun 13 03:57:51.098478 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.098457 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-66c8c4f788-8hxxv" Jun 13 03:57:51.101898 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.101875 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-jdvq2\"" Jun 13 03:57:51.102144 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.102127 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 13 03:57:51.110886 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.110864 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-66c8c4f788-8hxxv"] Jun 13 03:57:51.197296 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.197264 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4hj8\" (UniqueName: \"kubernetes.io/projected/b4383798-ee81-4b18-a413-53d661e0762e-kube-api-access-r4hj8\") pod \"maas-api-66c8c4f788-8hxxv\" (UID: \"b4383798-ee81-4b18-a413-53d661e0762e\") " pod="opendatahub/maas-api-66c8c4f788-8hxxv" Jun 13 03:57:51.197430 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.197311 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4383798-ee81-4b18-a413-53d661e0762e-openshift-service-ca\") pod \"maas-api-66c8c4f788-8hxxv\" (UID: \"b4383798-ee81-4b18-a413-53d661e0762e\") " pod="opendatahub/maas-api-66c8c4f788-8hxxv" Jun 13 03:57:51.197430 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.197387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4383798-ee81-4b18-a413-53d661e0762e-maas-api-tls\") pod \"maas-api-66c8c4f788-8hxxv\" (UID: \"b4383798-ee81-4b18-a413-53d661e0762e\") " pod="opendatahub/maas-api-66c8c4f788-8hxxv" Jun 13 03:57:51.298005 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.297976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4hj8\" (UniqueName: \"kubernetes.io/projected/b4383798-ee81-4b18-a413-53d661e0762e-kube-api-access-r4hj8\") pod \"maas-api-66c8c4f788-8hxxv\" (UID: \"b4383798-ee81-4b18-a413-53d661e0762e\") " pod="opendatahub/maas-api-66c8c4f788-8hxxv" Jun 13 03:57:51.298115 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.298016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4383798-ee81-4b18-a413-53d661e0762e-openshift-service-ca\") pod \"maas-api-66c8c4f788-8hxxv\" (UID: \"b4383798-ee81-4b18-a413-53d661e0762e\") " pod="opendatahub/maas-api-66c8c4f788-8hxxv" Jun 13 03:57:51.298115 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.298038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4383798-ee81-4b18-a413-53d661e0762e-maas-api-tls\") pod \"maas-api-66c8c4f788-8hxxv\" (UID: \"b4383798-ee81-4b18-a413-53d661e0762e\") " pod="opendatahub/maas-api-66c8c4f788-8hxxv" Jun 13 03:57:51.298656 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.298637 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4383798-ee81-4b18-a413-53d661e0762e-openshift-service-ca\") pod \"maas-api-66c8c4f788-8hxxv\" (UID: \"b4383798-ee81-4b18-a413-53d661e0762e\") " pod="opendatahub/maas-api-66c8c4f788-8hxxv" Jun 13 03:57:51.300421 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.300404 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4383798-ee81-4b18-a413-53d661e0762e-maas-api-tls\") pod \"maas-api-66c8c4f788-8hxxv\" (UID: \"b4383798-ee81-4b18-a413-53d661e0762e\") " pod="opendatahub/maas-api-66c8c4f788-8hxxv" Jun 13 03:57:51.305515 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.305495 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4hj8\" (UniqueName: \"kubernetes.io/projected/b4383798-ee81-4b18-a413-53d661e0762e-kube-api-access-r4hj8\") pod \"maas-api-66c8c4f788-8hxxv\" (UID: \"b4383798-ee81-4b18-a413-53d661e0762e\") " pod="opendatahub/maas-api-66c8c4f788-8hxxv" Jun 13 03:57:51.409184 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.409157 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-66c8c4f788-8hxxv" Jun 13 03:57:51.548255 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.548226 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-66c8c4f788-8hxxv"] Jun 13 03:57:51.549619 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:57:51.549592 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4383798_ee81_4b18_a413_53d661e0762e.slice/crio-e5933379aaa878c4d0e8e604f05e1638b1cf73c796f8117b8cddc1e2159cf200 WatchSource:0}: Error finding container e5933379aaa878c4d0e8e604f05e1638b1cf73c796f8117b8cddc1e2159cf200: Status 404 returned error can't find the container with id e5933379aaa878c4d0e8e604f05e1638b1cf73c796f8117b8cddc1e2159cf200 Jun 13 03:57:51.588679 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.588651 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2gnlf"] Jun 13 03:57:51.592944 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.592924 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-2gnlf" Jun 13 03:57:51.595464 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.595442 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 13 03:57:51.595572 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.595463 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gjxww\"" Jun 13 03:57:51.600631 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.600591 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2gnlf"] Jun 13 03:57:51.626563 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.626532 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-66c8c4f788-8hxxv" event={"ID":"b4383798-ee81-4b18-a413-53d661e0762e","Type":"ContainerStarted","Data":"e5933379aaa878c4d0e8e604f05e1638b1cf73c796f8117b8cddc1e2159cf200"} Jun 13 03:57:51.701313 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.701247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdq6r\" (UniqueName: \"kubernetes.io/projected/7c0010d2-d1b1-4faa-a75e-2d1e08078c9d-kube-api-access-qdq6r\") pod \"payload-processing-699b6cd6c-2gnlf\" (UID: \"7c0010d2-d1b1-4faa-a75e-2d1e08078c9d\") " pod="openshift-ingress/payload-processing-699b6cd6c-2gnlf" Jun 13 03:57:51.802230 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.802198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdq6r\" (UniqueName: \"kubernetes.io/projected/7c0010d2-d1b1-4faa-a75e-2d1e08078c9d-kube-api-access-qdq6r\") pod \"payload-processing-699b6cd6c-2gnlf\" (UID: \"7c0010d2-d1b1-4faa-a75e-2d1e08078c9d\") " pod="openshift-ingress/payload-processing-699b6cd6c-2gnlf" Jun 13 03:57:51.809900 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.809868 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdq6r\" (UniqueName: \"kubernetes.io/projected/7c0010d2-d1b1-4faa-a75e-2d1e08078c9d-kube-api-access-qdq6r\") pod \"payload-processing-699b6cd6c-2gnlf\" (UID: \"7c0010d2-d1b1-4faa-a75e-2d1e08078c9d\") " pod="openshift-ingress/payload-processing-699b6cd6c-2gnlf" Jun 13 03:57:51.904384 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:51.904329 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-2gnlf" Jun 13 03:57:52.032797 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:52.032762 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2gnlf"] Jun 13 03:57:52.033816 ip-10-0-142-184 kubenswrapper[2562]: W0613 03:57:52.033790 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c0010d2_d1b1_4faa_a75e_2d1e08078c9d.slice/crio-c9b4708ed29c82f3801145b58c8456d8d2855c4de25fca792581ab6512f5124a WatchSource:0}: Error finding container c9b4708ed29c82f3801145b58c8456d8d2855c4de25fca792581ab6512f5124a: Status 404 returned error can't find the container with id c9b4708ed29c82f3801145b58c8456d8d2855c4de25fca792581ab6512f5124a Jun 13 03:57:52.639167 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:52.639080 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-2gnlf" event={"ID":"7c0010d2-d1b1-4faa-a75e-2d1e08078c9d","Type":"ContainerStarted","Data":"c9b4708ed29c82f3801145b58c8456d8d2855c4de25fca792581ab6512f5124a"} Jun 13 03:57:54.655198 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:54.655146 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-66c8c4f788-8hxxv" event={"ID":"b4383798-ee81-4b18-a413-53d661e0762e","Type":"ContainerStarted","Data":"f51f263790d2a957eaff50aee2c62d332b0abfb0c477fd9eac7cd52cdffa639a"} Jun 13 03:57:54.655721 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:54.655356 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-66c8c4f788-8hxxv" Jun 13 03:57:54.657013 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:54.656978 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-2gnlf" event={"ID":"7c0010d2-d1b1-4faa-a75e-2d1e08078c9d","Type":"ContainerStarted","Data":"f29f584de6e20f02f2bb5dfe0ca604ab4d273c3ae260c59b86d295e279e38012"} Jun 13 03:57:54.657163 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:54.657035 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-2gnlf" Jun 13 03:57:54.673103 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:54.673045 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-66c8c4f788-8hxxv" podStartSLOduration=0.856351359 podStartE2EDuration="3.67302784s" totalImagesPullingTime="2.816676481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:57:54.672769212 +0000 UTC m=+834.146262985" watchObservedRunningTime="2026-06-13 03:57:54.67302784 +0000 UTC m=+834.146521595" Jun 13 03:57:54.688825 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:57:54.688774 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-2gnlf" podStartSLOduration=1.307118045 podStartE2EDuration="3.688760786s" totalImagesPullingTime="2.381642741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 03:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 03:57:54.686830809 +0000 UTC m=+834.160324573" watchObservedRunningTime="2026-06-13 03:57:54.688760786 +0000 UTC m=+834.162254538" Jun 13 03:58:00.667627 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:58:00.667599 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-66c8c4f788-8hxxv" Jun 13 03:58:05.664499 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:58:05.664471 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-2gnlf" Jun 13 03:59:01.037008 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:59:01.036974 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 03:59:01.039099 ip-10-0-142-184 kubenswrapper[2562]: I0613 03:59:01.039076 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 04:00:05.148726 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:05.145445 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 04:00:05.148726 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:05.145763 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" containerID="cri-o://80a6848cdca635fd243ea04c782a502c58f6da8e52a959c84b767a83c97e7be8" gracePeriod=30 Jun 13 04:00:07.195698 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.195662 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:07.355845 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.355758 2562 generic.go:356] "Generic (PLEG): container finished" podID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerID="80a6848cdca635fd243ea04c782a502c58f6da8e52a959c84b767a83c97e7be8" exitCode=143 Jun 13 04:00:07.355845 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.355807 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:07.355845 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.355831 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f88c9dac-1813-4395-b8f2-b95a82922cdb","Type":"ContainerDied","Data":"80a6848cdca635fd243ea04c782a502c58f6da8e52a959c84b767a83c97e7be8"} Jun 13 04:00:07.356125 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.355870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f88c9dac-1813-4395-b8f2-b95a82922cdb","Type":"ContainerDied","Data":"bba8fbded2c1e830fe841da45f466a3b88646c5b529409f1b7793c169581d047"} Jun 13 04:00:07.356125 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.355890 2562 scope.go:117] "RemoveContainer" containerID="80a6848cdca635fd243ea04c782a502c58f6da8e52a959c84b767a83c97e7be8" Jun 13 04:00:07.365669 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.365646 2562 scope.go:117] "RemoveContainer" containerID="80a6848cdca635fd243ea04c782a502c58f6da8e52a959c84b767a83c97e7be8" Jun 13 04:00:07.365981 ip-10-0-142-184 kubenswrapper[2562]: E0613 04:00:07.365961 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80a6848cdca635fd243ea04c782a502c58f6da8e52a959c84b767a83c97e7be8\": container with ID starting with 80a6848cdca635fd243ea04c782a502c58f6da8e52a959c84b767a83c97e7be8 not found: ID does not exist" containerID="80a6848cdca635fd243ea04c782a502c58f6da8e52a959c84b767a83c97e7be8" Jun 13 04:00:07.366035 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.365991 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80a6848cdca635fd243ea04c782a502c58f6da8e52a959c84b767a83c97e7be8"} err="failed to get container status \"80a6848cdca635fd243ea04c782a502c58f6da8e52a959c84b767a83c97e7be8\": rpc error: code = NotFound desc = could not find container \"80a6848cdca635fd243ea04c782a502c58f6da8e52a959c84b767a83c97e7be8\": container with ID starting with 80a6848cdca635fd243ea04c782a502c58f6da8e52a959c84b767a83c97e7be8 not found: ID does not exist" Jun 13 04:00:07.367270 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.367252 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bljsq\" (UniqueName: \"kubernetes.io/projected/f88c9dac-1813-4395-b8f2-b95a82922cdb-kube-api-access-bljsq\") pod \"f88c9dac-1813-4395-b8f2-b95a82922cdb\" (UID: \"f88c9dac-1813-4395-b8f2-b95a82922cdb\") " Jun 13 04:00:07.369383 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.369344 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f88c9dac-1813-4395-b8f2-b95a82922cdb-kube-api-access-bljsq" (OuterVolumeSpecName: "kube-api-access-bljsq") pod "f88c9dac-1813-4395-b8f2-b95a82922cdb" (UID: "f88c9dac-1813-4395-b8f2-b95a82922cdb"). InnerVolumeSpecName "kube-api-access-bljsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 04:00:07.467959 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.467913 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bljsq\" (UniqueName: \"kubernetes.io/projected/f88c9dac-1813-4395-b8f2-b95a82922cdb-kube-api-access-bljsq\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 04:00:07.679266 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.679223 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 04:00:07.682792 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.682750 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 04:00:07.701610 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.701577 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 04:00:07.701933 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.701919 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" Jun 13 04:00:07.701933 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.701933 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" Jun 13 04:00:07.702044 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.701990 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" containerName="keycloak" Jun 13 04:00:07.706189 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.706164 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:07.708754 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.708721 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 04:00:07.708754 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.708749 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lhvr9\"" Jun 13 04:00:07.708981 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.708722 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 04:00:07.708981 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.708802 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 13 04:00:07.708981 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.708870 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 13 04:00:07.716511 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.716487 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 04:00:07.870772 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.870739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq4wg\" (UniqueName: \"kubernetes.io/projected/a2234b1a-689f-4a04-89eb-edb3e1490edd-kube-api-access-dq4wg\") pod \"maas-keycloak-0\" (UID: \"a2234b1a-689f-4a04-89eb-edb3e1490edd\") " pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:07.870942 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.870874 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a2234b1a-689f-4a04-89eb-edb3e1490edd-test-realms\") pod \"maas-keycloak-0\" (UID: \"a2234b1a-689f-4a04-89eb-edb3e1490edd\") " pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:07.971963 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.971861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a2234b1a-689f-4a04-89eb-edb3e1490edd-test-realms\") pod \"maas-keycloak-0\" (UID: \"a2234b1a-689f-4a04-89eb-edb3e1490edd\") " pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:07.971963 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.971906 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq4wg\" (UniqueName: \"kubernetes.io/projected/a2234b1a-689f-4a04-89eb-edb3e1490edd-kube-api-access-dq4wg\") pod \"maas-keycloak-0\" (UID: \"a2234b1a-689f-4a04-89eb-edb3e1490edd\") " pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:07.972647 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.972623 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a2234b1a-689f-4a04-89eb-edb3e1490edd-test-realms\") pod \"maas-keycloak-0\" (UID: \"a2234b1a-689f-4a04-89eb-edb3e1490edd\") " pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:07.980099 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:07.980075 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq4wg\" (UniqueName: \"kubernetes.io/projected/a2234b1a-689f-4a04-89eb-edb3e1490edd-kube-api-access-dq4wg\") pod \"maas-keycloak-0\" (UID: \"a2234b1a-689f-4a04-89eb-edb3e1490edd\") " pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:08.017086 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:08.017049 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:08.146908 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:08.146878 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 04:00:08.147910 ip-10-0-142-184 kubenswrapper[2562]: W0613 04:00:08.147880 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2234b1a_689f_4a04_89eb_edb3e1490edd.slice/crio-989445916bd9b45c4ce4ed1adab89ad0edc4773c51dbcc5a9bb1e68143232777 WatchSource:0}: Error finding container 989445916bd9b45c4ce4ed1adab89ad0edc4773c51dbcc5a9bb1e68143232777: Status 404 returned error can't find the container with id 989445916bd9b45c4ce4ed1adab89ad0edc4773c51dbcc5a9bb1e68143232777 Jun 13 04:00:08.364522 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:08.364438 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a2234b1a-689f-4a04-89eb-edb3e1490edd","Type":"ContainerStarted","Data":"989445916bd9b45c4ce4ed1adab89ad0edc4773c51dbcc5a9bb1e68143232777"} Jun 13 04:00:09.019943 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:09.019904 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f88c9dac-1813-4395-b8f2-b95a82922cdb" path="/var/lib/kubelet/pods/f88c9dac-1813-4395-b8f2-b95a82922cdb/volumes" Jun 13 04:00:09.375092 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:09.374997 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a2234b1a-689f-4a04-89eb-edb3e1490edd","Type":"ContainerStarted","Data":"eb98467b4e3592e8cc3cf6e5f87544b3a97ea7d255dc801c32f217811ef942ae"} Jun 13 04:00:09.395820 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:09.395765 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.078812623 podStartE2EDuration="2.395747858s" totalImagesPullingTime="316.935235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 04:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 04:00:09.393910634 +0000 UTC m=+968.867404413" watchObservedRunningTime="2026-06-13 04:00:09.395747858 +0000 UTC m=+968.869241611" Jun 13 04:00:10.018275 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:10.018228 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:10.020243 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:10.020193 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a2234b1a-689f-4a04-89eb-edb3e1490edd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 13 04:00:11.018250 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:11.018205 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a2234b1a-689f-4a04-89eb-edb3e1490edd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 13 04:00:12.018044 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:12.017991 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a2234b1a-689f-4a04-89eb-edb3e1490edd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 13 04:00:13.018005 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:13.017955 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a2234b1a-689f-4a04-89eb-edb3e1490edd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 13 04:00:14.018327 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:14.018279 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a2234b1a-689f-4a04-89eb-edb3e1490edd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 13 04:00:15.017990 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:15.017941 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a2234b1a-689f-4a04-89eb-edb3e1490edd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 13 04:00:16.018620 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:16.018560 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a2234b1a-689f-4a04-89eb-edb3e1490edd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 13 04:00:17.017649 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:17.017607 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a2234b1a-689f-4a04-89eb-edb3e1490edd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 13 04:00:18.017910 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:18.017810 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:18.018425 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:18.018095 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a2234b1a-689f-4a04-89eb-edb3e1490edd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 13 04:00:19.018046 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:19.017938 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a2234b1a-689f-4a04-89eb-edb3e1490edd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 13 04:00:20.017765 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:20.017718 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a2234b1a-689f-4a04-89eb-edb3e1490edd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 13 04:00:21.017764 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:21.017720 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a2234b1a-689f-4a04-89eb-edb3e1490edd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jun 13 04:00:22.149299 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:22.149254 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:22.167885 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:22.167832 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a2234b1a-689f-4a04-89eb-edb3e1490edd" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 04:00:32.155873 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:32.155840 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 13 04:00:42.850441 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:42.850407 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84c5f698bb-w8b5l"] Jun 13 04:00:42.855576 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:42.855542 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84c5f698bb-w8b5l" Jun 13 04:00:42.859270 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:42.859249 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 13 04:00:42.886097 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:42.886068 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84c5f698bb-w8b5l"] Jun 13 04:00:42.989338 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:42.989306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f29432a-46c1-4822-a19e-7b0f0a7df493-tls-cert\") pod \"authorino-84c5f698bb-w8b5l\" (UID: \"2f29432a-46c1-4822-a19e-7b0f0a7df493\") " pod="kuadrant-system/authorino-84c5f698bb-w8b5l" Jun 13 04:00:42.989338 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:42.989339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2f29432a-46c1-4822-a19e-7b0f0a7df493-oidc-ca\") pod \"authorino-84c5f698bb-w8b5l\" (UID: \"2f29432a-46c1-4822-a19e-7b0f0a7df493\") " pod="kuadrant-system/authorino-84c5f698bb-w8b5l" Jun 13 04:00:42.989546 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:42.989384 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7vsk\" (UniqueName: \"kubernetes.io/projected/2f29432a-46c1-4822-a19e-7b0f0a7df493-kube-api-access-x7vsk\") pod \"authorino-84c5f698bb-w8b5l\" (UID: \"2f29432a-46c1-4822-a19e-7b0f0a7df493\") " pod="kuadrant-system/authorino-84c5f698bb-w8b5l" Jun 13 04:00:43.090650 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:43.090617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f29432a-46c1-4822-a19e-7b0f0a7df493-tls-cert\") pod \"authorino-84c5f698bb-w8b5l\" (UID: \"2f29432a-46c1-4822-a19e-7b0f0a7df493\") " pod="kuadrant-system/authorino-84c5f698bb-w8b5l" Jun 13 04:00:43.090650 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:43.090645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2f29432a-46c1-4822-a19e-7b0f0a7df493-oidc-ca\") pod \"authorino-84c5f698bb-w8b5l\" (UID: \"2f29432a-46c1-4822-a19e-7b0f0a7df493\") " pod="kuadrant-system/authorino-84c5f698bb-w8b5l" Jun 13 04:00:43.090837 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:43.090678 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7vsk\" (UniqueName: \"kubernetes.io/projected/2f29432a-46c1-4822-a19e-7b0f0a7df493-kube-api-access-x7vsk\") pod \"authorino-84c5f698bb-w8b5l\" (UID: \"2f29432a-46c1-4822-a19e-7b0f0a7df493\") " pod="kuadrant-system/authorino-84c5f698bb-w8b5l" Jun 13 04:00:43.091281 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:43.091259 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2f29432a-46c1-4822-a19e-7b0f0a7df493-oidc-ca\") pod \"authorino-84c5f698bb-w8b5l\" (UID: \"2f29432a-46c1-4822-a19e-7b0f0a7df493\") " pod="kuadrant-system/authorino-84c5f698bb-w8b5l" Jun 13 04:00:43.093139 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:43.093119 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f29432a-46c1-4822-a19e-7b0f0a7df493-tls-cert\") pod \"authorino-84c5f698bb-w8b5l\" (UID: \"2f29432a-46c1-4822-a19e-7b0f0a7df493\") " pod="kuadrant-system/authorino-84c5f698bb-w8b5l" Jun 13 04:00:43.099171 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:43.099149 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7vsk\" (UniqueName: \"kubernetes.io/projected/2f29432a-46c1-4822-a19e-7b0f0a7df493-kube-api-access-x7vsk\") pod \"authorino-84c5f698bb-w8b5l\" (UID: \"2f29432a-46c1-4822-a19e-7b0f0a7df493\") " pod="kuadrant-system/authorino-84c5f698bb-w8b5l" Jun 13 04:00:43.165082 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:43.165061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84c5f698bb-w8b5l" Jun 13 04:00:43.294703 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:43.294670 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84c5f698bb-w8b5l"] Jun 13 04:00:43.295810 ip-10-0-142-184 kubenswrapper[2562]: W0613 04:00:43.295783 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f29432a_46c1_4822_a19e_7b0f0a7df493.slice/crio-7c9e6652cd637a091dbf23b30cf76f29eaafadde3803fbadf7f1d34e31159272 WatchSource:0}: Error finding container 7c9e6652cd637a091dbf23b30cf76f29eaafadde3803fbadf7f1d34e31159272: Status 404 returned error can't find the container with id 7c9e6652cd637a091dbf23b30cf76f29eaafadde3803fbadf7f1d34e31159272 Jun 13 04:00:43.597400 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:43.597301 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84c5f698bb-w8b5l" event={"ID":"2f29432a-46c1-4822-a19e-7b0f0a7df493","Type":"ContainerStarted","Data":"7c9e6652cd637a091dbf23b30cf76f29eaafadde3803fbadf7f1d34e31159272"} Jun 13 04:00:44.605132 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:44.605090 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84c5f698bb-w8b5l" event={"ID":"2f29432a-46c1-4822-a19e-7b0f0a7df493","Type":"ContainerStarted","Data":"16032991d63ab0cd9545653f4af9ab385b83177bd00fece78dc717f269f76d81"} Jun 13 04:00:44.620194 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:44.620146 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84c5f698bb-w8b5l" podStartSLOduration=2.280226284 podStartE2EDuration="2.620130993s" totalImagesPullingTime="339.904709ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 04:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 04:00:44.619664043 +0000 UTC m=+1004.093157808" watchObservedRunningTime="2026-06-13 04:00:44.620130993 +0000 UTC m=+1004.093624745" Jun 13 04:00:44.645579 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:44.645548 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d77fdb948-6g9q7"] Jun 13 04:00:44.645745 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:44.645724 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d77fdb948-6g9q7" podUID="7440066a-4b32-4dd7-a09d-5c987bea5189" containerName="authorino" containerID="cri-o://3bd338d0311534bf528da7dc15c53b9fde616bd4aff209ad52369213d2939e21" gracePeriod=30 Jun 13 04:00:44.895021 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:44.894995 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d77fdb948-6g9q7" Jun 13 04:00:45.006612 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.006586 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdjmj\" (UniqueName: \"kubernetes.io/projected/7440066a-4b32-4dd7-a09d-5c987bea5189-kube-api-access-jdjmj\") pod \"7440066a-4b32-4dd7-a09d-5c987bea5189\" (UID: \"7440066a-4b32-4dd7-a09d-5c987bea5189\") " Jun 13 04:00:45.006764 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.006634 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7440066a-4b32-4dd7-a09d-5c987bea5189-tls-cert\") pod \"7440066a-4b32-4dd7-a09d-5c987bea5189\" (UID: \"7440066a-4b32-4dd7-a09d-5c987bea5189\") " Jun 13 04:00:45.008642 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.008618 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7440066a-4b32-4dd7-a09d-5c987bea5189-kube-api-access-jdjmj" (OuterVolumeSpecName: "kube-api-access-jdjmj") pod "7440066a-4b32-4dd7-a09d-5c987bea5189" (UID: "7440066a-4b32-4dd7-a09d-5c987bea5189"). InnerVolumeSpecName "kube-api-access-jdjmj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 04:00:45.016760 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.016733 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7440066a-4b32-4dd7-a09d-5c987bea5189-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7440066a-4b32-4dd7-a09d-5c987bea5189" (UID: "7440066a-4b32-4dd7-a09d-5c987bea5189"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 04:00:45.107899 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.107880 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdjmj\" (UniqueName: \"kubernetes.io/projected/7440066a-4b32-4dd7-a09d-5c987bea5189-kube-api-access-jdjmj\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 04:00:45.107999 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.107901 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7440066a-4b32-4dd7-a09d-5c987bea5189-tls-cert\") on node \"ip-10-0-142-184.ec2.internal\" DevicePath \"\"" Jun 13 04:00:45.611592 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.611556 2562 generic.go:356] "Generic (PLEG): container finished" podID="7440066a-4b32-4dd7-a09d-5c987bea5189" containerID="3bd338d0311534bf528da7dc15c53b9fde616bd4aff209ad52369213d2939e21" exitCode=0 Jun 13 04:00:45.612059 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.611598 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d77fdb948-6g9q7" Jun 13 04:00:45.612059 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.611637 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d77fdb948-6g9q7" event={"ID":"7440066a-4b32-4dd7-a09d-5c987bea5189","Type":"ContainerDied","Data":"3bd338d0311534bf528da7dc15c53b9fde616bd4aff209ad52369213d2939e21"} Jun 13 04:00:45.612059 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.611683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d77fdb948-6g9q7" event={"ID":"7440066a-4b32-4dd7-a09d-5c987bea5189","Type":"ContainerDied","Data":"2936277e2404c611b7f4e81980d3b145dea434983edba2475e8e1f7a9b5db621"} Jun 13 04:00:45.612059 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.611706 2562 scope.go:117] "RemoveContainer" containerID="3bd338d0311534bf528da7dc15c53b9fde616bd4aff209ad52369213d2939e21" Jun 13 04:00:45.621558 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.621499 2562 scope.go:117] "RemoveContainer" containerID="3bd338d0311534bf528da7dc15c53b9fde616bd4aff209ad52369213d2939e21" Jun 13 04:00:45.621797 ip-10-0-142-184 kubenswrapper[2562]: E0613 04:00:45.621773 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd338d0311534bf528da7dc15c53b9fde616bd4aff209ad52369213d2939e21\": container with ID starting with 3bd338d0311534bf528da7dc15c53b9fde616bd4aff209ad52369213d2939e21 not found: ID does not exist" containerID="3bd338d0311534bf528da7dc15c53b9fde616bd4aff209ad52369213d2939e21" Jun 13 04:00:45.621837 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.621808 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd338d0311534bf528da7dc15c53b9fde616bd4aff209ad52369213d2939e21"} err="failed to get container status \"3bd338d0311534bf528da7dc15c53b9fde616bd4aff209ad52369213d2939e21\": rpc error: code = NotFound desc = could not find container \"3bd338d0311534bf528da7dc15c53b9fde616bd4aff209ad52369213d2939e21\": container with ID starting with 3bd338d0311534bf528da7dc15c53b9fde616bd4aff209ad52369213d2939e21 not found: ID does not exist" Jun 13 04:00:45.627267 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.627242 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d77fdb948-6g9q7"] Jun 13 04:00:45.631132 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:45.631111 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d77fdb948-6g9q7"] Jun 13 04:00:47.017119 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:47.017086 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7440066a-4b32-4dd7-a09d-5c987bea5189" path="/var/lib/kubelet/pods/7440066a-4b32-4dd7-a09d-5c987bea5189/volumes" Jun 13 04:00:51.596094 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.596061 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw"] Jun 13 04:00:51.596609 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.596589 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7440066a-4b32-4dd7-a09d-5c987bea5189" containerName="authorino" Jun 13 04:00:51.596685 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.596613 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7440066a-4b32-4dd7-a09d-5c987bea5189" containerName="authorino" Jun 13 04:00:51.596804 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.596704 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7440066a-4b32-4dd7-a09d-5c987bea5189" containerName="authorino" Jun 13 04:00:51.601060 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.601038 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.604755 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.604733 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 13 04:00:51.604865 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.604733 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f2g9b\"" Jun 13 04:00:51.604865 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.604733 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 13 04:00:51.604865 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.604769 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 13 04:00:51.610129 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.610093 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw"] Jun 13 04:00:51.771968 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.771934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a647637c-eb55-4767-bfa4-a857950e7e99-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.772118 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.771983 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djc7h\" (UniqueName: \"kubernetes.io/projected/a647637c-eb55-4767-bfa4-a857950e7e99-kube-api-access-djc7h\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.772118 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.772017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a647637c-eb55-4767-bfa4-a857950e7e99-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.772118 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.772067 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a647637c-eb55-4767-bfa4-a857950e7e99-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.772272 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.772124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a647637c-eb55-4767-bfa4-a857950e7e99-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.772272 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.772145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a647637c-eb55-4767-bfa4-a857950e7e99-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.872682 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.872620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a647637c-eb55-4767-bfa4-a857950e7e99-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.872682 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.872662 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djc7h\" (UniqueName: \"kubernetes.io/projected/a647637c-eb55-4767-bfa4-a857950e7e99-kube-api-access-djc7h\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.872823 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.872683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a647637c-eb55-4767-bfa4-a857950e7e99-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.872896 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.872874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a647637c-eb55-4767-bfa4-a857950e7e99-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.872954 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.872938 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a647637c-eb55-4767-bfa4-a857950e7e99-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.872996 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.872969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a647637c-eb55-4767-bfa4-a857950e7e99-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.873036 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.873021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a647637c-eb55-4767-bfa4-a857950e7e99-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.873190 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.873172 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a647637c-eb55-4767-bfa4-a857950e7e99-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.873257 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.873216 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a647637c-eb55-4767-bfa4-a857950e7e99-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.874995 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.874968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a647637c-eb55-4767-bfa4-a857950e7e99-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.875114 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.875081 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a647637c-eb55-4767-bfa4-a857950e7e99-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.879845 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.879824 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djc7h\" (UniqueName: \"kubernetes.io/projected/a647637c-eb55-4767-bfa4-a857950e7e99-kube-api-access-djc7h\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw\" (UID: \"a647637c-eb55-4767-bfa4-a857950e7e99\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:51.912662 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:51.912642 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:00:52.055302 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:52.055277 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw"] Jun 13 04:00:52.057254 ip-10-0-142-184 kubenswrapper[2562]: W0613 04:00:52.057217 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda647637c_eb55_4767_bfa4_a857950e7e99.slice/crio-7fa4d3874e960a0132eb54cbbdec77f34172eb19d3e1886a7efbe94e3d428bc5 WatchSource:0}: Error finding container 7fa4d3874e960a0132eb54cbbdec77f34172eb19d3e1886a7efbe94e3d428bc5: Status 404 returned error can't find the container with id 7fa4d3874e960a0132eb54cbbdec77f34172eb19d3e1886a7efbe94e3d428bc5 Jun 13 04:00:52.653448 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:52.653405 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" event={"ID":"a647637c-eb55-4767-bfa4-a857950e7e99","Type":"ContainerStarted","Data":"7fa4d3874e960a0132eb54cbbdec77f34172eb19d3e1886a7efbe94e3d428bc5"} Jun 13 04:00:56.680012 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:56.679968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" event={"ID":"a647637c-eb55-4767-bfa4-a857950e7e99","Type":"ContainerStarted","Data":"0724526bff50f228b80c97da3100347da252c99629ff664cb3372b58805132bd"} Jun 13 04:00:57.686422 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:57.686383 2562 generic.go:356] "Generic (PLEG): container finished" podID="a647637c-eb55-4767-bfa4-a857950e7e99" containerID="0724526bff50f228b80c97da3100347da252c99629ff664cb3372b58805132bd" exitCode=0 Jun 13 04:00:57.686791 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:00:57.686471 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" event={"ID":"a647637c-eb55-4767-bfa4-a857950e7e99","Type":"ContainerDied","Data":"0724526bff50f228b80c97da3100347da252c99629ff664cb3372b58805132bd"} Jun 13 04:01:18.805323 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:18.805281 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" event={"ID":"a647637c-eb55-4767-bfa4-a857950e7e99","Type":"ContainerStarted","Data":"19b8b884b7b2dd543c02af596d38c65db97f63ed5cc1fd880f20b4d3786641e6"} Jun 13 04:01:18.822680 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:18.822613 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" podStartSLOduration=2.6121333289999997 podStartE2EDuration="27.822597371s" totalImagesPullingTime="23.958299296s" totalInitContainerRuntime="1.252164746s" isStatefulPod=false podCreationTimestamp="2026-06-13 04:00:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 04:01:18.820175335 +0000 UTC m=+1038.293669087" watchObservedRunningTime="2026-06-13 04:01:18.822597371 +0000 UTC m=+1038.296091124" Jun 13 04:01:21.913807 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:21.913768 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:01:21.914300 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:21.913847 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:01:21.926420 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:21.926390 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:01:22.837798 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:22.837772 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw" Jun 13 04:01:44.782844 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:44.782803 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw"] Jun 13 04:01:44.786114 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:44.786090 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:44.788581 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:44.788558 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 13 04:01:44.794146 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:44.794124 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw"] Jun 13 04:01:44.901516 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:44.901484 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr8g9\" (UniqueName: \"kubernetes.io/projected/2376b453-2f5f-4a3f-b016-64253877ac83-kube-api-access-gr8g9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:44.901648 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:44.901522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2376b453-2f5f-4a3f-b016-64253877ac83-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:44.901648 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:44.901598 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2376b453-2f5f-4a3f-b016-64253877ac83-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:44.901739 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:44.901658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2376b453-2f5f-4a3f-b016-64253877ac83-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:44.901739 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:44.901678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2376b453-2f5f-4a3f-b016-64253877ac83-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:44.901739 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:44.901705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2376b453-2f5f-4a3f-b016-64253877ac83-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.002587 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.002558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2376b453-2f5f-4a3f-b016-64253877ac83-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.002712 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.002601 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2376b453-2f5f-4a3f-b016-64253877ac83-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.002712 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.002617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2376b453-2f5f-4a3f-b016-64253877ac83-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.002796 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.002733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2376b453-2f5f-4a3f-b016-64253877ac83-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.002796 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.002778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr8g9\" (UniqueName: \"kubernetes.io/projected/2376b453-2f5f-4a3f-b016-64253877ac83-kube-api-access-gr8g9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.002903 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.002816 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2376b453-2f5f-4a3f-b016-64253877ac83-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.003117 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.003088 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2376b453-2f5f-4a3f-b016-64253877ac83-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.003247 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.003104 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2376b453-2f5f-4a3f-b016-64253877ac83-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.003247 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.003186 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2376b453-2f5f-4a3f-b016-64253877ac83-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.004897 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.004876 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2376b453-2f5f-4a3f-b016-64253877ac83-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.005192 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.005172 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2376b453-2f5f-4a3f-b016-64253877ac83-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.010439 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.010413 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr8g9\" (UniqueName: \"kubernetes.io/projected/2376b453-2f5f-4a3f-b016-64253877ac83-kube-api-access-gr8g9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw\" (UID: \"2376b453-2f5f-4a3f-b016-64253877ac83\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.099616 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.099558 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" Jun 13 04:01:45.228866 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.228826 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw"] Jun 13 04:01:45.229715 ip-10-0-142-184 kubenswrapper[2562]: W0613 04:01:45.229686 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2376b453_2f5f_4a3f_b016_64253877ac83.slice/crio-2c16542099d8e07c4b2f2e5aad7c0b954464c067f824ce39976314f1b3fa8fc4 WatchSource:0}: Error finding container 2c16542099d8e07c4b2f2e5aad7c0b954464c067f824ce39976314f1b3fa8fc4: Status 404 returned error can't find the container with id 2c16542099d8e07c4b2f2e5aad7c0b954464c067f824ce39976314f1b3fa8fc4 Jun 13 04:01:45.948125 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.948082 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" event={"ID":"2376b453-2f5f-4a3f-b016-64253877ac83","Type":"ContainerStarted","Data":"5c3ef0dacc914abbb1e44f596d58b3817aebf796530ca67e901f59eafd2188bb"} Jun 13 04:01:45.948724 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:01:45.948177 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw" event={"ID":"2376b453-2f5f-4a3f-b016-64253877ac83","Type":"ContainerStarted","Data":"2c16542099d8e07c4b2f2e5aad7c0b954464c067f824ce39976314f1b3fa8fc4"} Jun 13 04:02:11.477473 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.477437 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8"] Jun 13 04:02:11.480904 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.480887 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.483076 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.483056 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 13 04:02:11.489281 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.489261 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8"] Jun 13 04:02:11.527022 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.526998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/926510ee-7e00-4e95-8dd1-49522821819c-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.527119 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.527040 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/926510ee-7e00-4e95-8dd1-49522821819c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.527119 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.527060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsjvl\" (UniqueName: \"kubernetes.io/projected/926510ee-7e00-4e95-8dd1-49522821819c-kube-api-access-xsjvl\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.527119 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.527107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/926510ee-7e00-4e95-8dd1-49522821819c-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.527226 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.527123 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/926510ee-7e00-4e95-8dd1-49522821819c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.527226 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.527141 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/926510ee-7e00-4e95-8dd1-49522821819c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.627897 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.627867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/926510ee-7e00-4e95-8dd1-49522821819c-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.628008 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.627919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/926510ee-7e00-4e95-8dd1-49522821819c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.628008 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.627950 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsjvl\" (UniqueName: \"kubernetes.io/projected/926510ee-7e00-4e95-8dd1-49522821819c-kube-api-access-xsjvl\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.628008 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.627987 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/926510ee-7e00-4e95-8dd1-49522821819c-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.628176 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.628012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/926510ee-7e00-4e95-8dd1-49522821819c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.628176 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.628036 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/926510ee-7e00-4e95-8dd1-49522821819c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.628386 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.628344 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/926510ee-7e00-4e95-8dd1-49522821819c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.628460 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.628443 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/926510ee-7e00-4e95-8dd1-49522821819c-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.628522 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.628500 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/926510ee-7e00-4e95-8dd1-49522821819c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.630236 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.630215 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/926510ee-7e00-4e95-8dd1-49522821819c-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.630450 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.630432 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/926510ee-7e00-4e95-8dd1-49522821819c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.635485 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.635466 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsjvl\" (UniqueName: \"kubernetes.io/projected/926510ee-7e00-4e95-8dd1-49522821819c-kube-api-access-xsjvl\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j86h8\" (UID: \"926510ee-7e00-4e95-8dd1-49522821819c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.791899 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.791816 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:02:11.924226 ip-10-0-142-184 kubenswrapper[2562]: W0613 04:02:11.924196 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod926510ee_7e00_4e95_8dd1_49522821819c.slice/crio-be404bcb84a429c3c451ef815ee5d020d09aedd1a97f0c6bfdff603061dfba13 WatchSource:0}: Error finding container be404bcb84a429c3c451ef815ee5d020d09aedd1a97f0c6bfdff603061dfba13: Status 404 returned error can't find the container with id be404bcb84a429c3c451ef815ee5d020d09aedd1a97f0c6bfdff603061dfba13 Jun 13 04:02:11.924442 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:11.924375 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8"] Jun 13 04:02:12.087116 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:12.087023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" event={"ID":"926510ee-7e00-4e95-8dd1-49522821819c","Type":"ContainerStarted","Data":"6d5f00d49cb18a814f96e461432282f155225093d0281b33eaa8a500cd5e3c38"} Jun 13 04:02:12.087116 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:02:12.087059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" event={"ID":"926510ee-7e00-4e95-8dd1-49522821819c","Type":"ContainerStarted","Data":"be404bcb84a429c3c451ef815ee5d020d09aedd1a97f0c6bfdff603061dfba13"} Jun 13 04:03:04.362191 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:03:04.362159 2562 generic.go:356] "Generic (PLEG): container finished" podID="926510ee-7e00-4e95-8dd1-49522821819c" containerID="6d5f00d49cb18a814f96e461432282f155225093d0281b33eaa8a500cd5e3c38" exitCode=0 Jun 13 04:03:04.362647 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:03:04.362218 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" event={"ID":"926510ee-7e00-4e95-8dd1-49522821819c","Type":"ContainerDied","Data":"6d5f00d49cb18a814f96e461432282f155225093d0281b33eaa8a500cd5e3c38"} Jun 13 04:03:04.362829 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:03:04.362812 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 04:03:05.368993 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:03:05.368961 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" event={"ID":"926510ee-7e00-4e95-8dd1-49522821819c","Type":"ContainerStarted","Data":"7e4115b06b560eac2812e6d21deda25900172449855c5b047a06ae095382f142"} Jun 13 04:03:05.387720 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:03:05.387673 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" podStartSLOduration=2.5899308960000003 podStartE2EDuration="54.387659399s" totalImagesPullingTime="173.222998ms" totalInitContainerRuntime="51.624505505s" isStatefulPod=false podCreationTimestamp="2026-06-13 04:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 04:03:05.384515615 +0000 UTC m=+1144.858009368" watchObservedRunningTime="2026-06-13 04:03:05.387659399 +0000 UTC m=+1144.861153151" Jun 13 04:03:11.792549 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:03:11.792515 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:03:11.793018 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:03:11.792894 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:03:11.804970 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:03:11.804944 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:03:12.418506 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:03:12.418474 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j86h8" Jun 13 04:04:01.076296 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:04:01.076265 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 04:04:01.077068 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:04:01.077044 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 04:05:49.410541 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:49.410508 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84c5f698bb-w8b5l_2f29432a-46c1-4822-a19e-7b0f0a7df493/authorino/0.log" Jun 13 04:05:54.236602 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:54.236567 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-66c8c4f788-8hxxv_b4383798-ee81-4b18-a413-53d661e0762e/maas-api/0.log" Jun 13 04:05:54.452782 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:54.452748 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8555d7d8d8-gh2tm_f25b29e4-2544-4796-98be-a28a231fcb27/manager/0.log" Jun 13 04:05:54.674665 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:54.674634 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-mv47x_16ec9cae-ecd4-45f9-97a0-524f68865c3f/manager/0.log" Jun 13 04:05:54.898584 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:54.898557 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8b9444ff-cht8r_ad13c115-060d-4796-82fc-946e59d782a5/copy-manifests/0.log" Jun 13 04:05:54.904719 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:54.904693 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8b9444ff-cht8r_ad13c115-060d-4796-82fc-946e59d782a5/manager/0.log" Jun 13 04:05:55.138676 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:55.138649 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-llz7t_5868b402-1afc-434b-9f67-ca18ea32a685/postgres/0.log" Jun 13 04:05:55.892264 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:55.892236 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c_9b6cbbd3-1821-40c9-a84b-01dbcc51bc71/util/0.log" Jun 13 04:05:55.898702 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:55.898658 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c_9b6cbbd3-1821-40c9-a84b-01dbcc51bc71/pull/0.log" Jun 13 04:05:55.904660 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:55.904643 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c_9b6cbbd3-1821-40c9-a84b-01dbcc51bc71/extract/0.log" Jun 13 04:05:56.013221 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:56.013197 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp_237b6016-529d-4b28-93ac-005706b854f5/pull/0.log" Jun 13 04:05:56.018889 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:56.018853 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp_237b6016-529d-4b28-93ac-005706b854f5/extract/0.log" Jun 13 04:05:56.024331 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:56.024313 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp_237b6016-529d-4b28-93ac-005706b854f5/util/0.log" Jun 13 04:05:56.128083 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:56.128061 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc_137f46fb-1026-497c-9ac6-773d19e4d26e/util/0.log" Jun 13 04:05:56.134276 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:56.134257 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc_137f46fb-1026-497c-9ac6-773d19e4d26e/pull/0.log" Jun 13 04:05:56.139867 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:56.139850 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc_137f46fb-1026-497c-9ac6-773d19e4d26e/extract/0.log" Jun 13 04:05:56.247578 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:56.247527 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r_8c88e1fa-6c0d-4542-b754-a1139ed7cd59/util/0.log" Jun 13 04:05:56.255722 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:56.255693 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r_8c88e1fa-6c0d-4542-b754-a1139ed7cd59/pull/0.log" Jun 13 04:05:56.261685 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:56.261649 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r_8c88e1fa-6c0d-4542-b754-a1139ed7cd59/extract/0.log" Jun 13 04:05:56.372337 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:56.372296 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84c5f698bb-w8b5l_2f29432a-46c1-4822-a19e-7b0f0a7df493/authorino/0.log" Jun 13 04:05:56.695105 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:56.695079 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ccftp_63dc59be-d5f5-481d-8879-0120948f421a/kuadrant-console-plugin/0.log" Jun 13 04:05:57.799553 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:57.799503 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75bd78495b-wmlzk_74b28d1f-7b4a-44a3-a341-a8917beaebbf/kube-auth-proxy/0.log" Jun 13 04:05:58.118391 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:58.118301 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2gnlf_7c0010d2-d1b1-4faa-a75e-2d1e08078c9d/payload-processing/0.log" Jun 13 04:05:58.225959 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:58.225934 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c4d6ff5b6-pptlr_59846397-d812-442b-a8f6-40f0f5d01cf5/router/0.log" Jun 13 04:05:58.569542 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:58.569514 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw_a647637c-eb55-4767-bfa4-a857950e7e99/main/0.log" Jun 13 04:05:58.576338 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:58.576305 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-hnmvw_a647637c-eb55-4767-bfa4-a857950e7e99/storage-initializer/0.log" Jun 13 04:05:58.919502 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:58.919475 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cn9zlw_2376b453-2f5f-4a3f-b016-64253877ac83/storage-initializer/0.log" Jun 13 04:05:59.147192 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:59.147149 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-j86h8_926510ee-7e00-4e95-8dd1-49522821819c/storage-initializer/0.log" Jun 13 04:05:59.154370 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:05:59.154336 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-j86h8_926510ee-7e00-4e95-8dd1-49522821819c/main/0.log" Jun 13 04:06:05.999258 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:05.999219 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qkfvr_9f285c10-8c5a-4b17-a928-14070376cf58/global-pull-secret-syncer/0.log" Jun 13 04:06:06.102401 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:06.102356 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tttnq_6d920e6a-30a7-42f0-b28e-7047b0d9f779/konnectivity-agent/0.log" Jun 13 04:06:06.185988 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:06.185958 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-184.ec2.internal_1bd90cee16398774209d73ccb0625fec/haproxy/0.log" Jun 13 04:06:10.836653 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:10.836621 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c_9b6cbbd3-1821-40c9-a84b-01dbcc51bc71/extract/0.log" Jun 13 04:06:10.859117 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:10.859094 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c_9b6cbbd3-1821-40c9-a84b-01dbcc51bc71/util/0.log" Jun 13 04:06:10.881860 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:10.881838 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9d8c_9b6cbbd3-1821-40c9-a84b-01dbcc51bc71/pull/0.log" Jun 13 04:06:10.910392 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:10.910311 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp_237b6016-529d-4b28-93ac-005706b854f5/extract/0.log" Jun 13 04:06:10.934135 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:10.934118 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp_237b6016-529d-4b28-93ac-005706b854f5/util/0.log" Jun 13 04:06:10.954812 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:10.954792 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e057plp_237b6016-529d-4b28-93ac-005706b854f5/pull/0.log" Jun 13 04:06:10.987541 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:10.987518 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc_137f46fb-1026-497c-9ac6-773d19e4d26e/extract/0.log" Jun 13 04:06:11.009952 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:11.009931 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc_137f46fb-1026-497c-9ac6-773d19e4d26e/util/0.log" Jun 13 04:06:11.030448 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:11.030429 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736xvgc_137f46fb-1026-497c-9ac6-773d19e4d26e/pull/0.log" Jun 13 04:06:11.056545 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:11.056525 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r_8c88e1fa-6c0d-4542-b754-a1139ed7cd59/extract/0.log" Jun 13 04:06:11.077222 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:11.077201 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r_8c88e1fa-6c0d-4542-b754-a1139ed7cd59/util/0.log" Jun 13 04:06:11.103688 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:11.103673 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164r5r_8c88e1fa-6c0d-4542-b754-a1139ed7cd59/pull/0.log" Jun 13 04:06:11.140996 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:11.140978 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84c5f698bb-w8b5l_2f29432a-46c1-4822-a19e-7b0f0a7df493/authorino/0.log" Jun 13 04:06:11.233234 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:11.233182 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ccftp_63dc59be-d5f5-481d-8879-0120948f421a/kuadrant-console-plugin/0.log" Jun 13 04:06:13.208016 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:13.207986 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-q7t5r_9252b71e-443e-4ff4-a6ea-6b46dbb948af/cluster-monitoring-operator/0.log" Jun 13 04:06:13.374041 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:13.374016 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-gn4bj_539644f6-8272-40bc-bae1-deb259490985/monitoring-plugin/0.log" Jun 13 04:06:13.410623 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:13.410597 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jwwp_c513ac26-f582-4b70-9770-7fbe8ab17742/node-exporter/0.log" Jun 13 04:06:13.437947 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:13.437922 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jwwp_c513ac26-f582-4b70-9770-7fbe8ab17742/kube-rbac-proxy/0.log" Jun 13 04:06:13.454261 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:13.454239 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jwwp_c513ac26-f582-4b70-9770-7fbe8ab17742/init-textfile/0.log" Jun 13 04:06:13.957552 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:13.957524 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-dfmng_05decfcf-3583-4a7f-bc0e-30c7fd6eb459/prometheus-operator/0.log" Jun 13 04:06:13.977077 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:13.977053 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-dfmng_05decfcf-3583-4a7f-bc0e-30c7fd6eb459/kube-rbac-proxy/0.log" Jun 13 04:06:16.857934 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:16.857901 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc"] Jun 13 04:06:16.861831 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:16.861810 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:16.864496 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:16.864468 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s47zn\"/\"openshift-service-ca.crt\"" Jun 13 04:06:16.864618 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:16.864499 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s47zn\"/\"kube-root-ca.crt\"" Jun 13 04:06:16.864618 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:16.864571 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s47zn\"/\"default-dockercfg-b27ql\"" Jun 13 04:06:16.872252 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:16.872212 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc"] Jun 13 04:06:17.027625 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.027593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kc8b\" (UniqueName: \"kubernetes.io/projected/c3195c73-7513-4ca1-b9eb-cdda814aaf13-kube-api-access-5kc8b\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.027625 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.027629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3195c73-7513-4ca1-b9eb-cdda814aaf13-proc\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.027851 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.027651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3195c73-7513-4ca1-b9eb-cdda814aaf13-lib-modules\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.027851 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.027671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3195c73-7513-4ca1-b9eb-cdda814aaf13-sys\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.027851 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.027799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3195c73-7513-4ca1-b9eb-cdda814aaf13-podres\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.128651 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.128627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3195c73-7513-4ca1-b9eb-cdda814aaf13-podres\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.128798 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.128683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kc8b\" (UniqueName: \"kubernetes.io/projected/c3195c73-7513-4ca1-b9eb-cdda814aaf13-kube-api-access-5kc8b\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.128798 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.128716 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3195c73-7513-4ca1-b9eb-cdda814aaf13-proc\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.128798 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.128780 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3195c73-7513-4ca1-b9eb-cdda814aaf13-proc\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.128961 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.128796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3195c73-7513-4ca1-b9eb-cdda814aaf13-podres\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.128961 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.128828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3195c73-7513-4ca1-b9eb-cdda814aaf13-lib-modules\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.128961 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.128867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3195c73-7513-4ca1-b9eb-cdda814aaf13-sys\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.128961 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.128935 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3195c73-7513-4ca1-b9eb-cdda814aaf13-lib-modules\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.129140 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.128982 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3195c73-7513-4ca1-b9eb-cdda814aaf13-sys\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.136181 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.136161 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kc8b\" (UniqueName: \"kubernetes.io/projected/c3195c73-7513-4ca1-b9eb-cdda814aaf13-kube-api-access-5kc8b\") pod \"perf-node-gather-daemonset-q2cbc\" (UID: \"c3195c73-7513-4ca1-b9eb-cdda814aaf13\") " pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.173238 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.173215 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:17.306239 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.306213 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc"] Jun 13 04:06:17.307325 ip-10-0-142-184 kubenswrapper[2562]: W0613 04:06:17.307297 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc3195c73_7513_4ca1_b9eb_cdda814aaf13.slice/crio-d56c6907ba2380c453af956c7dd4ad57146b6c5ea4d279710542748b7e443d2e WatchSource:0}: Error finding container d56c6907ba2380c453af956c7dd4ad57146b6c5ea4d279710542748b7e443d2e: Status 404 returned error can't find the container with id d56c6907ba2380c453af956c7dd4ad57146b6c5ea4d279710542748b7e443d2e Jun 13 04:06:17.405891 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:17.405788 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" event={"ID":"c3195c73-7513-4ca1-b9eb-cdda814aaf13","Type":"ContainerStarted","Data":"d56c6907ba2380c453af956c7dd4ad57146b6c5ea4d279710542748b7e443d2e"} Jun 13 04:06:18.413114 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:18.413075 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" event={"ID":"c3195c73-7513-4ca1-b9eb-cdda814aaf13","Type":"ContainerStarted","Data":"70ce97e2866a13ea7c6d20353bd304303aa37ceb5d76f48468bd807e9c0e65bf"} Jun 13 04:06:18.413528 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:18.413145 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:18.430388 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:18.430328 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" podStartSLOduration=2.430310536 podStartE2EDuration="2.430310536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 04:06:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 04:06:18.428463142 +0000 UTC m=+1337.901956897" watchObservedRunningTime="2026-06-13 04:06:18.430310536 +0000 UTC m=+1337.903804331" Jun 13 04:06:18.766832 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:18.766755 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hg4s_25d12dad-debe-46e1-9e8a-5bc09754f000/dns/0.log" Jun 13 04:06:18.787699 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:18.787675 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hg4s_25d12dad-debe-46e1-9e8a-5bc09754f000/kube-rbac-proxy/0.log" Jun 13 04:06:18.953120 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:18.953086 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6sff_af08c78b-69e1-421a-8df3-73fa59c36e18/dns-node-resolver/0.log" Jun 13 04:06:19.525665 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:19.525630 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gzqcn_9b69f037-b1a8-47bf-b468-b48b84405b26/node-ca/0.log" Jun 13 04:06:20.569560 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:20.569525 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75bd78495b-wmlzk_74b28d1f-7b4a-44a3-a341-a8917beaebbf/kube-auth-proxy/0.log" Jun 13 04:06:20.643488 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:20.643460 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2gnlf_7c0010d2-d1b1-4faa-a75e-2d1e08078c9d/payload-processing/0.log" Jun 13 04:06:20.671045 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:20.671016 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c4d6ff5b6-pptlr_59846397-d812-442b-a8f6-40f0f5d01cf5/router/0.log" Jun 13 04:06:21.276844 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:21.276802 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5sz5d_071690c8-fde4-4021-9197-658b91d47206/serve-healthcheck-canary/0.log" Jun 13 04:06:21.839913 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:21.839881 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-ptfx4_382e45c6-a956-438f-b519-9e378ff06578/insights-operator/0.log" Jun 13 04:06:21.841484 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:21.841465 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-ptfx4_382e45c6-a956-438f-b519-9e378ff06578/insights-operator/1.log" Jun 13 04:06:22.003763 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:22.003733 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x9rh8_8954b42f-92cf-4205-99c7-c437ed73656e/kube-rbac-proxy/0.log" Jun 13 04:06:22.025241 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:22.025219 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x9rh8_8954b42f-92cf-4205-99c7-c437ed73656e/exporter/0.log" Jun 13 04:06:22.046703 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:22.046683 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x9rh8_8954b42f-92cf-4205-99c7-c437ed73656e/extractor/0.log" Jun 13 04:06:24.395016 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:24.394988 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-66c8c4f788-8hxxv_b4383798-ee81-4b18-a413-53d661e0762e/maas-api/0.log" Jun 13 04:06:24.428324 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:24.428303 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s47zn/perf-node-gather-daemonset-q2cbc" Jun 13 04:06:24.446697 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:24.446671 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8555d7d8d8-gh2tm_f25b29e4-2544-4796-98be-a28a231fcb27/manager/0.log" Jun 13 04:06:24.507089 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:24.507069 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-mv47x_16ec9cae-ecd4-45f9-97a0-524f68865c3f/manager/0.log" Jun 13 04:06:24.578483 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:24.578461 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8b9444ff-cht8r_ad13c115-060d-4796-82fc-946e59d782a5/manager/0.log" Jun 13 04:06:24.599189 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:24.599164 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8b9444ff-cht8r_ad13c115-060d-4796-82fc-946e59d782a5/copy-manifests/0.log" Jun 13 04:06:24.692207 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:24.692149 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-llz7t_5868b402-1afc-434b-9f67-ca18ea32a685/postgres/0.log" Jun 13 04:06:26.164980 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:26.164952 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-755dd474c5-gxn2g_4e4dda2b-69d9-4c16-afa2-10a9cd997788/manager/0.log" Jun 13 04:06:30.985723 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:30.985695 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75bd78495b-wmlzk_74b28d1f-7b4a-44a3-a341-a8917beaebbf/kube-auth-proxy/0.log" Jun 13 04:06:31.032631 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:31.032606 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2gnlf_7c0010d2-d1b1-4faa-a75e-2d1e08078c9d/payload-processing/0.log" Jun 13 04:06:31.058019 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:31.057999 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c4d6ff5b6-pptlr_59846397-d812-442b-a8f6-40f0f5d01cf5/router/0.log" Jun 13 04:06:31.670014 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:31.669987 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-b2swr_94e935bc-381c-4ccf-ba98-d71827db00d5/migrator/0.log" Jun 13 04:06:31.695604 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:31.695574 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-b2swr_94e935bc-381c-4ccf-ba98-d71827db00d5/graceful-termination/0.log" Jun 13 04:06:32.116244 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:32.116140 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-5p4vh_64784d09-dfc8-4eb6-9c95-467ba97ef359/kube-storage-version-migrator-operator/1.log" Jun 13 04:06:32.116909 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:32.116885 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-5p4vh_64784d09-dfc8-4eb6-9c95-467ba97ef359/kube-storage-version-migrator-operator/0.log" Jun 13 04:06:32.282589 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:32.282559 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75bd78495b-wmlzk_74b28d1f-7b4a-44a3-a341-a8917beaebbf/kube-auth-proxy/0.log" Jun 13 04:06:32.348889 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:32.348863 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2gnlf_7c0010d2-d1b1-4faa-a75e-2d1e08078c9d/payload-processing/0.log" Jun 13 04:06:32.367511 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:32.367449 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c4d6ff5b6-pptlr_59846397-d812-442b-a8f6-40f0f5d01cf5/router/0.log" Jun 13 04:06:33.410517 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:33.410489 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ntktp_f039be5b-cbfe-4023-bb27-d76a5061dca5/kube-multus-additional-cni-plugins/0.log" Jun 13 04:06:33.431842 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:33.431819 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ntktp_f039be5b-cbfe-4023-bb27-d76a5061dca5/egress-router-binary-copy/0.log" Jun 13 04:06:33.454069 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:33.454053 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ntktp_f039be5b-cbfe-4023-bb27-d76a5061dca5/cni-plugins/0.log" Jun 13 04:06:33.475660 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:33.475640 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ntktp_f039be5b-cbfe-4023-bb27-d76a5061dca5/bond-cni-plugin/0.log" Jun 13 04:06:33.497305 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:33.497287 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ntktp_f039be5b-cbfe-4023-bb27-d76a5061dca5/routeoverride-cni/0.log" Jun 13 04:06:33.528783 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:33.528763 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ntktp_f039be5b-cbfe-4023-bb27-d76a5061dca5/whereabouts-cni-bincopy/0.log" Jun 13 04:06:33.552476 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:33.552457 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ntktp_f039be5b-cbfe-4023-bb27-d76a5061dca5/whereabouts-cni/0.log" Jun 13 04:06:33.808574 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:33.808546 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qj8qf_21cdf5eb-ffb9-49bb-8b6e-9096b17cf055/kube-multus/0.log" Jun 13 04:06:33.831690 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:33.831667 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5gtcb_0b2f1c7f-0403-4a8d-b546-53e9a0cde19a/network-metrics-daemon/0.log" Jun 13 04:06:33.851954 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:33.851932 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5gtcb_0b2f1c7f-0403-4a8d-b546-53e9a0cde19a/kube-rbac-proxy/0.log" Jun 13 04:06:34.075042 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:34.074972 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75bd78495b-wmlzk_74b28d1f-7b4a-44a3-a341-a8917beaebbf/kube-auth-proxy/0.log" Jun 13 04:06:34.129801 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:34.129778 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2gnlf_7c0010d2-d1b1-4faa-a75e-2d1e08078c9d/payload-processing/0.log" Jun 13 04:06:34.148668 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:34.148650 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c4d6ff5b6-pptlr_59846397-d812-442b-a8f6-40f0f5d01cf5/router/0.log" Jun 13 04:06:35.308484 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:35.308449 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-controller/0.log" Jun 13 04:06:35.327233 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:35.327212 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/1.log" Jun 13 04:06:35.327379 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:35.327220 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovn-acl-logging/0.log" Jun 13 04:06:35.348485 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:35.348466 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/kube-rbac-proxy-node/0.log" Jun 13 04:06:35.370351 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:35.370333 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/kube-rbac-proxy-ovn-metrics/0.log" Jun 13 04:06:35.390594 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:35.390574 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/northd/0.log" Jun 13 04:06:35.413074 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:35.413051 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/nbdb/0.log" Jun 13 04:06:35.435870 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:35.435854 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/sbdb/0.log" Jun 13 04:06:35.480155 ip-10-0-142-184 kubenswrapper[2562]: I0613 04:06:35.480132 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5r49_1d288ee1-9260-49b3-a28d-f87148a63eed/ovnkube-controller/0.log"