Jun 05 12:58:20.905363 ip-10-0-129-41 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 05 12:58:20.905374 ip-10-0-129-41 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 05 12:58:20.905381 ip-10-0-129-41 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 05 12:58:20.905546 ip-10-0-129-41 systemd[1]: Failed to start Kubernetes Kubelet. Jun 05 12:58:31.089671 ip-10-0-129-41 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 05 12:58:31.089688 ip-10-0-129-41 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6b017b425b284713a0638aa50720501f -- Jun 05 13:01:00.780634 ip-10-0-129-41 systemd[1]: Starting Kubernetes Kubelet... Jun 05 13:01:01.227170 ip-10-0-129-41 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:01:01.227170 ip-10-0-129-41 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 13:01:01.227170 ip-10-0-129-41 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:01:01.227170 ip-10-0-129-41 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 13:01:01.227170 ip-10-0-129-41 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:01:01.228860 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.228718 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 13:01:01.235562 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235547 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:01:01.235562 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235561 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235566 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235569 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235572 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235575 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235579 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235582 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235585 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235587 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235590 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235593 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235596 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235598 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235602 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235604 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235607 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235610 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235613 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235615 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:01:01.235633 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235618 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235621 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235623 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235626 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235636 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235640 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235643 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235646 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235648 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235651 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235653 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235657 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235661 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235663 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235667 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235671 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235673 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235677 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235680 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:01:01.236075 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235683 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235686 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235688 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235691 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235693 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235696 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235699 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235701 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235704 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235706 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235708 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235711 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235714 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235716 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235718 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235722 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235725 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235728 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235730 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235734 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:01:01.236553 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235737 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235740 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235742 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235745 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235747 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235750 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235754 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235756 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235759 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235762 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235765 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235767 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235770 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235773 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235775 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235777 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235780 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235782 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235785 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235787 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:01:01.237045 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235790 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235793 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235795 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235797 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235800 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235803 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235806 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235810 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235813 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235816 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235819 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235822 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235824 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235827 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235829 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235832 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235834 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235836 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235839 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:01:01.237551 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.235841 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236573 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236582 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236585 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236588 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236591 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236595 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236598 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236601 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236604 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236606 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236611 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236614 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236618 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236620 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236624 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236627 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236629 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236632 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:01:01.238071 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236635 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236638 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236641 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236644 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236646 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236649 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236651 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236655 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236658 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236660 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236663 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236666 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236669 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236671 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236674 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236676 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236679 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236681 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236684 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236687 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:01:01.238558 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236689 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236692 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236694 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236696 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236699 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236702 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236705 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236708 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236710 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236713 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236716 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236718 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236721 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236724 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236728 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236732 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236735 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236739 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236742 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:01:01.239043 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236745 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236747 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236750 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236752 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236755 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236757 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236760 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236762 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236764 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236767 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236770 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236772 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236775 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236777 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236780 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236783 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236785 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236788 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236790 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236793 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:01:01.239534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236795 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236798 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236800 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236804 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236806 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236809 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236812 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236815 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236817 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236820 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236822 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236825 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236828 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236830 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236833 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236835 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236838 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236840 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236843 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236845 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:01:01.240029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236848 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.236850 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237226 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237230 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237233 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237236 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237238 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237241 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237244 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237247 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237250 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237252 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237255 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237258 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237261 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237264 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237267 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237270 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237272 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237275 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:01:01.240530 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237278 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237281 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237283 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237286 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237290 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237308 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237311 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237314 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237317 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237320 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237323 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237325 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237328 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237331 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237333 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237336 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237338 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237341 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237344 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:01:01.241018 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237346 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237349 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237351 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237354 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237357 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237359 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237362 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237364 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237367 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237370 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237373 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237376 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237378 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237381 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237384 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237386 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237389 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237391 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237394 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237396 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:01:01.241485 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237400 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237402 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237405 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237407 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237410 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237413 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237415 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237418 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237421 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237424 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237427 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237430 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237432 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237435 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237437 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237440 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237442 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237445 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237447 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237450 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:01:01.242001 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237454 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237456 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237459 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237464 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237467 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237470 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237473 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237475 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237478 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237481 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237483 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237486 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237488 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237491 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237493 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237495 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237498 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237500 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237503 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:01:01.242518 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237506 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237508 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.237510 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237585 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237592 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237602 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237607 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237611 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237615 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237619 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237623 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237626 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237629 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237633 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237636 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237639 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237643 2567 flags.go:64] FLAG: --cgroup-root="" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237646 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237649 2567 flags.go:64] FLAG: --client-ca-file="" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237652 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237655 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237659 2567 flags.go:64] FLAG: --cluster-domain="" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237662 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 13:01:01.242988 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237665 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237668 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237671 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237675 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237677 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237680 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237683 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237686 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237689 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237692 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237695 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237698 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237702 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237705 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237708 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237711 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237714 2567 flags.go:64] FLAG: --enable-server="true" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237717 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237722 2567 flags.go:64] FLAG: --event-burst="100" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237725 2567 flags.go:64] FLAG: --event-qps="50" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237728 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237731 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237733 2567 flags.go:64] FLAG: --eviction-hard="" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237737 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 13:01:01.243553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237740 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237743 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237747 2567 flags.go:64] FLAG: --eviction-soft="" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237750 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237753 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237757 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237759 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237762 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237765 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237768 2567 flags.go:64] FLAG: --feature-gates="" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237771 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237774 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237777 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237781 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237784 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237787 2567 flags.go:64] FLAG: --help="false" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237790 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237793 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237796 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237799 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237802 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237805 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237810 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 13:01:01.244162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237812 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237815 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237818 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237821 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237824 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237827 2567 flags.go:64] FLAG: --kube-reserved="" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237829 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237832 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237835 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237838 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237841 2567 flags.go:64] FLAG: --lock-file="" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237844 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237847 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237851 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237856 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237859 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237862 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237865 2567 flags.go:64] FLAG: --logging-format="text" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237868 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237871 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237873 2567 flags.go:64] FLAG: --manifest-url="" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237876 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237880 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237883 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237887 2567 flags.go:64] FLAG: --max-pods="110" Jun 05 13:01:01.244788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237890 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237893 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237896 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237899 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237902 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237905 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237909 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237917 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237920 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237923 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237926 2567 flags.go:64] FLAG: --pod-cidr="" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237928 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237934 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237937 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237940 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237943 2567 flags.go:64] FLAG: --port="10250" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237946 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237949 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07d670a6bcb21c4a5" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237952 2567 flags.go:64] FLAG: --qos-reserved="" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237955 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237962 2567 flags.go:64] FLAG: --register-node="true" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237965 2567 flags.go:64] FLAG: --register-with-taints="" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237969 2567 flags.go:64] FLAG: --registry-burst="10" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237972 2567 flags.go:64] FLAG: --registry-qps="5" Jun 05 13:01:01.245419 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237974 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237977 2567 flags.go:64] FLAG: --reserved-memory="" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237981 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237984 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237986 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237989 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237992 2567 flags.go:64] FLAG: --runonce="false" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237995 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.237998 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238000 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238003 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238006 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238009 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238012 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238016 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238019 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238025 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238028 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238031 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238034 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238037 2567 flags.go:64] FLAG: --system-cgroups="" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238039 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238045 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238048 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238050 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 13:01:01.246076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238054 2567 flags.go:64] FLAG: --tls-min-version="" Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238057 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238060 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238063 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238066 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238069 2567 flags.go:64] FLAG: --v="2" Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238073 2567 flags.go:64] FLAG: --version="false" Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238077 2567 flags.go:64] FLAG: --vmodule="" Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238081 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.238084 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238200 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238204 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238207 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238210 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238212 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238215 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238217 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238220 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238223 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238225 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238228 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238232 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:01:01.246695 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238235 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238238 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238241 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238244 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238246 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238249 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238251 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238254 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238257 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238259 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238262 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238264 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238267 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238269 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238272 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238275 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238278 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238280 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238283 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238286 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:01:01.247261 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238289 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238308 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238312 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238315 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238317 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238320 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238322 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238325 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238328 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238330 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238333 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238337 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238340 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238345 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238348 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238351 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238354 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238357 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238360 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:01:01.247789 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238363 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238366 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238369 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238371 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238374 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238377 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238380 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238383 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238385 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238388 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238391 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238395 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238398 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238401 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238404 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238407 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238409 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238413 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238415 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:01:01.248266 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238418 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238420 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238423 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238425 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238428 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238431 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238434 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238438 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238441 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238443 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238446 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238448 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238451 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238453 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238456 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238458 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238461 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238464 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238466 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238469 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:01:01.248833 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238471 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238474 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238476 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238479 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238482 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238484 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238487 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238489 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.238492 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.239142 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.245530 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.245545 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.245562 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.245571 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245626 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:01:01.249331 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245631 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245634 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245637 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245640 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245643 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245646 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245649 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245652 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245654 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245657 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245659 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245662 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245665 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245667 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245670 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245673 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245675 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245678 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245680 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245683 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:01:01.249713 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245686 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245688 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245691 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245694 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245696 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245699 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245701 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245704 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245708 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245711 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245714 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245716 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245719 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245722 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245724 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245727 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245729 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245731 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245734 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245737 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:01:01.250188 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245740 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245742 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245745 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245748 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245750 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245753 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245755 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245758 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245760 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245763 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245765 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245768 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245771 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245773 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245776 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245780 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245784 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245786 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245789 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:01:01.250755 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245792 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245795 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245799 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245803 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245806 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245810 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245812 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245815 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245818 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245822 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245824 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245827 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245830 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245834 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245837 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245840 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245842 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245845 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245848 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:01:01.251206 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245851 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245855 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245857 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245860 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245863 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245865 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245868 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245871 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245873 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245876 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245878 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245881 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245883 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245886 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245889 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245891 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245894 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245897 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245899 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:01:01.251691 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.245902 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.245907 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246017 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246022 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246025 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246028 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246031 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246034 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246037 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246039 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246042 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246045 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246048 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246050 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246053 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:01:01.252158 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246055 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246058 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246062 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246065 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246068 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246071 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246074 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246076 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246079 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246082 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246086 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246089 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246092 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246095 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246098 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246100 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246103 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246105 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246108 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:01:01.252545 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246111 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246113 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246116 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246118 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246121 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246123 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246126 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246128 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246130 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246133 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246136 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246139 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246141 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246144 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246146 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246149 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246151 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246154 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246156 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246159 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:01:01.253029 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246162 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246165 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246169 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246171 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246174 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246177 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246180 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246182 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246185 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246189 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246191 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246194 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246196 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246199 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246202 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246204 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246207 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246209 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246212 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:01:01.253534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246214 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246216 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246219 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246221 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246224 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246226 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246229 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246231 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246234 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246237 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246239 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246242 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246244 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246246 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246249 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246251 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246254 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246256 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246259 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246261 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:01:01.254003 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246264 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:01:01.254505 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246267 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:01:01.254505 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246269 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:01:01.254505 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246272 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:01:01.254505 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246275 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:01:01.254505 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246277 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:01:01.254505 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246279 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:01:01.254505 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:01.246282 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:01:01.254505 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.246287 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:01:01.254505 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.246402 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 13:01:01.254505 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.248475 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 13:01:01.254505 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.250645 2567 server.go:1019] "Starting client certificate rotation" Jun 05 13:01:01.254505 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.250740 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 13:01:01.254505 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.250772 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 13:01:01.254853 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.253676 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 13:01:01.254853 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.254811 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 13:01:01.264585 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.264565 2567 log.go:25] "Validated CRI v1 runtime API" Jun 05 13:01:01.267252 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.267238 2567 log.go:25] "Validated CRI v1 image API" Jun 05 13:01:01.268005 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.267987 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 13:01:01.271886 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.271867 2567 fs.go:135] Filesystem UUIDs: map[11356b46-32fa-43dc-99e1-a33260e1930a:/dev/nvme0n1p3 39b4b94e-b713-4ebb-8689-800e5d966c62:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 05 13:01:01.271957 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.271885 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 13:01:01.278030 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.277922 2567 manager.go:216] Machine: {Timestamp:2026-06-05 13:01:01.27655797 +0000 UTC m=+0.372467351 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110067 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ca96db5b73d9c499d5d50c876cc12 SystemUUID:ec2ca96d-b5b7-3d9c-499d-5d50c876cc12 BootID:6b017b42-5b28-4713-a063-8aa50720501f Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:70:ab:29:18:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:70:ab:29:18:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:e6:c7:f8:c1:c6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 13:01:01.278030 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.278023 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 13:01:01.278183 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.278115 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 13:01:01.281756 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.281734 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 13:01:01.281881 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.281760 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 13:01:01.282809 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.282798 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 13:01:01.282846 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.282811 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 13:01:01.282846 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.282819 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 13:01:01.284494 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.284481 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 13:01:01.285425 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.285415 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 13:01:01.287288 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.287274 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 13:01:01.288557 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.288545 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 05 13:01:01.288665 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.288656 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 13:01:01.288697 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.288689 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 05 13:01:01.288725 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.288705 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 13:01:01.288725 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.288722 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 13:01:01.288782 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.288731 2567 kubelet.go:398] "Adding apiserver pod source" Jun 05 13:01:01.288782 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.288740 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 13:01:01.289069 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.289058 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 13:01:01.289110 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.289076 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 13:01:01.291565 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.291549 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 13:01:01.293007 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.292993 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 13:01:01.293060 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.293024 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 13:01:01.294289 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.294278 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 13:01:01.294345 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.294307 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 13:01:01.294345 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.294317 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 13:01:01.294345 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.294324 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 13:01:01.294345 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.294335 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 13:01:01.294345 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.294340 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 13:01:01.294488 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.294349 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 13:01:01.294488 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.294355 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 13:01:01.294488 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.294361 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 13:01:01.294488 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.294374 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 13:01:01.294488 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.294391 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 13:01:01.294488 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.294396 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 13:01:01.295155 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.295143 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 13:01:01.295213 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.295156 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 13:01:01.297273 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.297253 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 13:01:01.297273 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.297258 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-41.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:01:01.297397 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.297255 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 13:01:01.298375 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.298362 2567 server.go:1268] "Started kubelet" Jun 05 13:01:01.298466 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.298422 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 13:01:01.298466 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.298447 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 13:01:01.298552 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.298524 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 13:01:01.299310 ip-10-0-129-41 systemd[1]: Started Kubernetes Kubelet. Jun 05 13:01:01.304090 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.303855 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 13:01:01.307105 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.307091 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 05 13:01:01.307401 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.307381 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 13:01:01.309556 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.309533 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7nz46" Jun 05 13:01:01.312377 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.312359 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 13:01:01.312454 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.312381 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 13:01:01.312584 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.312548 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-41.ec2.internal\" not found" Jun 05 13:01:01.313926 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.313875 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 13:01:01.314019 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.313926 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 13:01:01.314019 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.313939 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 13:01:01.314123 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.314033 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 05 13:01:01.314123 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.314040 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 05 13:01:01.315414 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.315397 2567 factory.go:55] Registering systemd factory Jun 05 13:01:01.315414 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.315416 2567 factory.go:223] Registration of the systemd container factory successfully Jun 05 13:01:01.315696 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.315677 2567 factory.go:153] Registering CRI-O factory Jun 05 13:01:01.315696 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.315694 2567 factory.go:223] Registration of the crio container factory successfully Jun 05 13:01:01.315825 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.315760 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 13:01:01.315825 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.315783 2567 factory.go:103] Registering Raw factory Jun 05 13:01:01.315825 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.315797 2567 manager.go:1196] Started watching for new ooms in manager Jun 05 13:01:01.316393 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.316379 2567 manager.go:349] Starting recovery of all containers Jun 05 13:01:01.318205 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.318117 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7nz46" Jun 05 13:01:01.318478 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.318453 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 13:01:01.318573 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.318556 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 13:01:01.319657 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.318704 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-41.ec2.internal.18b630e4a7d98b8a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-41.ec2.internal,UID:ip-10-0-129-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-41.ec2.internal,},FirstTimestamp:2026-06-05 13:01:01.298338698 +0000 UTC m=+0.394248077,LastTimestamp:2026-06-05 13:01:01.298338698 +0000 UTC m=+0.394248077,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-41.ec2.internal,}" Jun 05 13:01:01.326001 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.325902 2567 manager.go:354] Recovery completed Jun 05 13:01:01.329587 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.329572 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:01.331438 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.331421 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:01.331517 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.331451 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:01.331517 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.331461 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:01.331959 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.331945 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:01.332021 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.331948 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 13:01:01.332021 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.332010 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 13:01:01.332087 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.332030 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 05 13:01:01.332532 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.332515 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:01.332592 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.332543 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:01.332592 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.332553 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:01.333226 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.333171 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-41.ec2.internal.18b630e4a9d298cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-41.ec2.internal,UID:ip-10-0-129-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-41.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-41.ec2.internal,},FirstTimestamp:2026-06-05 13:01:01.331437772 +0000 UTC m=+0.427347364,LastTimestamp:2026-06-05 13:01:01.331437772 +0000 UTC m=+0.427347364,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-41.ec2.internal,}" Jun 05 13:01:01.333625 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.333613 2567 policy_none.go:49] "None policy: Start" Jun 05 13:01:01.333667 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.333629 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 13:01:01.333667 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.333639 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 13:01:01.334831 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.334822 2567 policy_none.go:47] "Start" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.367572 2567 manager.go:337] "Starting Device Plugin manager" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.367599 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.367609 2567 server.go:87] "Starting device plugin registration server" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.367842 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.367853 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.367945 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.368058 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.368070 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.368747 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.368796 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-41.ec2.internal\" not found" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.373316 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.374379 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.374412 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.374432 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.374463 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 13:01:01.388057 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.376464 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:01:01.468418 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.468393 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:01.469361 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.469338 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:01.469460 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.469370 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:01.469460 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.469387 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:01.469460 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.469415 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.475267 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.475250 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-41.ec2.internal"] Jun 05 13:01:01.475342 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.475326 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:01.476044 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.476021 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:01.476114 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.476050 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:01.476114 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.476063 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:01.477461 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.477428 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:01.477548 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.477537 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.477582 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.477573 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:01.479699 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.479687 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.479745 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.479705 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-41.ec2.internal\": node \"ip-10-0-129-41.ec2.internal\" not found" Jun 05 13:01:01.481124 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.481110 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:01.481124 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.481120 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:01.481212 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.481138 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:01.481212 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.481155 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:01.481212 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.481142 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:01.481212 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.481210 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:01.482497 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.482484 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.482545 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.482508 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:01:01.483134 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.483118 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:01:01.483201 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.483149 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:01:01.483201 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.483164 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:01:01.502637 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.502619 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-41.ec2.internal\" not found" Jun 05 13:01:01.512862 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.512846 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-41.ec2.internal\" not found" node="ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.517308 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.517284 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-41.ec2.internal\" not found" node="ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.602762 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.602731 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-41.ec2.internal\" not found" Jun 05 13:01:01.615775 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.615719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cbc49bd359e481edd83d964f89d1efa9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal\" (UID: \"cbc49bd359e481edd83d964f89d1efa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.615897 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.615787 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbc49bd359e481edd83d964f89d1efa9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal\" (UID: \"cbc49bd359e481edd83d964f89d1efa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.615897 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.615811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/28389313146ae7cbd001561ce72544af-config\") pod \"kube-apiserver-proxy-ip-10-0-129-41.ec2.internal\" (UID: \"28389313146ae7cbd001561ce72544af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.703395 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.703363 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-41.ec2.internal\" not found" Jun 05 13:01:01.716822 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.716793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cbc49bd359e481edd83d964f89d1efa9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal\" (UID: \"cbc49bd359e481edd83d964f89d1efa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.716947 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.716826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbc49bd359e481edd83d964f89d1efa9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal\" (UID: \"cbc49bd359e481edd83d964f89d1efa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.716947 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.716846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/28389313146ae7cbd001561ce72544af-config\") pod \"kube-apiserver-proxy-ip-10-0-129-41.ec2.internal\" (UID: \"28389313146ae7cbd001561ce72544af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.716947 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.716897 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cbc49bd359e481edd83d964f89d1efa9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal\" (UID: \"cbc49bd359e481edd83d964f89d1efa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.717073 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.716980 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/28389313146ae7cbd001561ce72544af-config\") pod \"kube-apiserver-proxy-ip-10-0-129-41.ec2.internal\" (UID: \"28389313146ae7cbd001561ce72544af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.717073 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.717027 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbc49bd359e481edd83d964f89d1efa9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal\" (UID: \"cbc49bd359e481edd83d964f89d1efa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.804322 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.804213 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-41.ec2.internal\" not found" Jun 05 13:01:01.816613 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.816593 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.823267 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:01.823246 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-41.ec2.internal" Jun 05 13:01:01.904710 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:01.904679 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-41.ec2.internal\" not found" Jun 05 13:01:02.005308 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.005266 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-41.ec2.internal\" not found" Jun 05 13:01:02.105898 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.105824 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-41.ec2.internal\" not found" Jun 05 13:01:02.121546 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.121526 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:01:02.213523 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.213499 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal" Jun 05 13:01:02.228765 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.228741 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 13:01:02.230891 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.230871 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-41.ec2.internal" Jun 05 13:01:02.238572 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.238551 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 13:01:02.249674 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.249656 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 13:01:02.249801 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.249781 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 13:01:02.249840 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.249779 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 13:01:02.288955 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.288931 2567 apiserver.go:52] "Watching apiserver" Jun 05 13:01:02.301308 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:02.301268 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc49bd359e481edd83d964f89d1efa9.slice/crio-96c7cb9e1b17e69403f0945809f185d82741256197c0d5e9d28b98083f124842 WatchSource:0}: Error finding container 96c7cb9e1b17e69403f0945809f185d82741256197c0d5e9d28b98083f124842: Status 404 returned error can't find the container with id 96c7cb9e1b17e69403f0945809f185d82741256197c0d5e9d28b98083f124842 Jun 05 13:01:02.301520 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:02.301507 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28389313146ae7cbd001561ce72544af.slice/crio-94d3ed5100fdc1ee7db45c66bbd16ba81e46e4f486cb9e40dd2eb9fc0320234a WatchSource:0}: Error finding container 94d3ed5100fdc1ee7db45c66bbd16ba81e46e4f486cb9e40dd2eb9fc0320234a: Status 404 returned error can't find the container with id 94d3ed5100fdc1ee7db45c66bbd16ba81e46e4f486cb9e40dd2eb9fc0320234a Jun 05 13:01:02.304789 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.304768 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 13:01:02.306440 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.306420 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-cg6vj","kube-system/konnectivity-agent-n2zjb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd","openshift-cluster-node-tuning-operator/tuned-tvx8s","openshift-image-registry/node-ca-clw7t","openshift-multus/multus-rsfkm","openshift-ovn-kubernetes/ovnkube-node-57l6g","kube-system/global-pull-secret-syncer-jkcwh","kube-system/kube-apiserver-proxy-ip-10-0-129-41.ec2.internal","openshift-dns/node-resolver-xppfg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal","openshift-multus/multus-additional-cni-plugins-j9pl7","openshift-multus/network-metrics-daemon-d8pvr","openshift-network-diagnostics/network-check-target-fzzzn"] Jun 05 13:01:02.307684 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.307665 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:01:02.308767 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.308749 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.309982 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.309896 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:02.310317 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.310210 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:02.312458 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.312442 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 13:01:02.312591 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.312573 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.313164 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.313147 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 13:01:02.313955 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.313934 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.315269 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.315242 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-clw7t" Jun 05 13:01:02.315383 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.315291 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 13:01:02.315383 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.315321 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 13:01:02.315383 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.315356 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-znxj5\"" Jun 05 13:01:02.315556 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.315389 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 13:01:02.315713 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.315693 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 13:01:02.315874 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.315833 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 13:01:02.316264 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.316250 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 13:01:02.316264 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.316259 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 13:01:02.316421 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.316276 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 13:01:02.316530 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.316492 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b6gkj\"" Jun 05 13:01:02.316605 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.316502 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:01:02.316689 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.316672 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vr8lw\"" Jun 05 13:01:02.317052 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.316784 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 13:01:02.317052 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.316792 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.318211 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.318193 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:02.318317 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.318260 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:02.319546 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319527 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cg6vj" Jun 05 13:01:02.319638 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-sys-fs\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.319638 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319568 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-sys\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.319638 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319583 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-host\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.319638 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319599 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-cni-netd\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.319638 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-socket-dir\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.319888 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319641 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-run\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.319888 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319663 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-systemd-units\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.319888 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319686 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.319888 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319709 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d5bf6331-1821-4fe3-b7ea-65575785f4ec-ovnkube-config\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.319888 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d5bf6331-1821-4fe3-b7ea-65575785f4ec-ovnkube-script-lib\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.319888 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319760 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-registration-dir\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.319888 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319781 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21a97422-63c7-4f86-8a0f-5b26c892c724-host\") pod \"node-ca-clw7t\" (UID: \"21a97422-63c7-4f86-8a0f-5b26c892c724\") " pod="openshift-image-registry/node-ca-clw7t" Jun 05 13:01:02.319888 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-slash\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.319888 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-run-netns\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.319888 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-run-ovn\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.319888 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319944 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319959 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-device-dir\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.319990 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72nd5\" (UniqueName: \"kubernetes.io/projected/c22c1419-9f45-467a-a056-416544120f8c-kube-api-access-72nd5\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320021 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-modprobe-d\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320045 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-lib-modules\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320067 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-var-lib-kubelet\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320089 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-tmp\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320112 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-cni-bin\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320172 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320203 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-systemd\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-etc-openvswitch\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320279 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-log-socket\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320354 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-sysctl-conf\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.320408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320387 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-tuned\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320440 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-552mk\" (UniqueName: \"kubernetes.io/projected/21a97422-63c7-4f86-8a0f-5b26c892c724-kube-api-access-552mk\") pod \"node-ca-clw7t\" (UID: \"21a97422-63c7-4f86-8a0f-5b26c892c724\") " pod="openshift-image-registry/node-ca-clw7t" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320477 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-var-lib-openvswitch\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320468 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 12:56:01 +0000 UTC" deadline="2028-02-15 14:57:07.30114994 +0000 UTC" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320537 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14881h56m4.98061667s" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320515 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5bf6331-1821-4fe3-b7ea-65575785f4ec-ovn-node-metrics-cert\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320550 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320571 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s5rn\" (UniqueName: \"kubernetes.io/projected/d5bf6331-1821-4fe3-b7ea-65575785f4ec-kube-api-access-6s5rn\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320593 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg8jg\" (UniqueName: \"kubernetes.io/projected/38a40729-4f6c-462e-a7a2-476b713066c6-kube-api-access-qg8jg\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320616 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-kubernetes\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320641 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99jbn\" (UniqueName: \"kubernetes.io/projected/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-kube-api-access-99jbn\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21a97422-63c7-4f86-8a0f-5b26c892c724-serviceca\") pod \"node-ca-clw7t\" (UID: \"21a97422-63c7-4f86-8a0f-5b26c892c724\") " pod="openshift-image-registry/node-ca-clw7t" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-run-systemd\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320707 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d5bf6331-1821-4fe3-b7ea-65575785f4ec-env-overrides\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320728 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n2zjb" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320728 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-etc-selinux\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320800 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-sysconfig\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320824 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-sysctl-d\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.321043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-kubelet\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.321958 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320871 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-run-openvswitch\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.321958 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320893 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-node-log\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.321958 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.320997 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 13:01:02.321958 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.321088 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 13:01:02.321958 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.321283 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 13:01:02.321958 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.321660 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 13:01:02.321958 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.321673 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 13:01:02.321958 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.321680 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 13:01:02.321958 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.321893 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rw8mm\"" Jun 05 13:01:02.322394 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.322022 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 13:01:02.322394 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.322045 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xppfg" Jun 05 13:01:02.322606 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.322590 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d58tq\"" Jun 05 13:01:02.322675 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.322591 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:01:02.322675 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.322644 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 13:01:02.322916 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.322900 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hw27b\"" Jun 05 13:01:02.323375 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.323362 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:02.323437 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.323407 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:02.324009 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.323976 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 13:01:02.324312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.324277 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-24q2x\"" Jun 05 13:01:02.324312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.324285 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 13:01:02.324579 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.324564 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 13:01:02.324579 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.324573 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.324706 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.324615 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 13:01:02.324706 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.324690 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5nmj\"" Jun 05 13:01:02.326772 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.326756 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 13:01:02.327492 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.327475 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 13:01:02.327930 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.327917 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xxpx7\"" Jun 05 13:01:02.328238 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.328225 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 13:01:02.350509 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.350485 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfk54" Jun 05 13:01:02.357916 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.357901 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfk54" Jun 05 13:01:02.377353 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.377312 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal" event={"ID":"cbc49bd359e481edd83d964f89d1efa9","Type":"ContainerStarted","Data":"96c7cb9e1b17e69403f0945809f185d82741256197c0d5e9d28b98083f124842"} Jun 05 13:01:02.378231 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.378214 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-41.ec2.internal" event={"ID":"28389313146ae7cbd001561ce72544af","Type":"ContainerStarted","Data":"94d3ed5100fdc1ee7db45c66bbd16ba81e46e4f486cb9e40dd2eb9fc0320234a"} Jun 05 13:01:02.415114 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.415088 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 13:01:02.421461 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421444 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-slash\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.421519 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421469 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-run-netns\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.421519 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421489 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.421519 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421505 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-device-dir\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.421645 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421528 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72nd5\" (UniqueName: \"kubernetes.io/projected/c22c1419-9f45-467a-a056-416544120f8c-kube-api-access-72nd5\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.421645 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421555 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-system-cni-dir\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.421645 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421569 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.421645 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421578 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-multus-cni-dir\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.421645 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421556 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-slash\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.421645 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421591 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-device-dir\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.421645 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421595 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-run-netns\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.421645 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421600 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-cnibin\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.421645 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421645 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-modprobe-d\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b4qv\" (UniqueName: \"kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv\") pod \"network-check-target-fzzzn\" (UID: \"10040f93-33d5-4334-87f2-eac44ad53e20\") " pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ac4dfe8d-bf55-4914-a0d8-e1488fb959fe-agent-certs\") pod \"konnectivity-agent-n2zjb\" (UID: \"ac4dfe8d-bf55-4914-a0d8-e1488fb959fe\") " pod="kube-system/konnectivity-agent-n2zjb" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36ce25a6-fa50-41db-b03f-f156bba97276-tmp-dir\") pod \"node-resolver-xppfg\" (UID: \"36ce25a6-fa50-41db-b03f-f156bba97276\") " pod="openshift-dns/node-resolver-xppfg" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421736 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-modprobe-d\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ba01329-9a7f-41c0-bdd0-2e0877800815-kubelet-config\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421778 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5d903f3-d5c8-4043-95cb-3fc20b829340-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421795 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-systemd\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421810 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-log-socket\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-etc-kubernetes\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421866 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-log-socket\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421867 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7f98cdc-be82-4e15-9361-277e2a2b6833-iptables-alerter-script\") pod \"iptables-alerter-cg6vj\" (UID: \"a7f98cdc-be82-4e15-9361-277e2a2b6833\") " pod="openshift-network-operator/iptables-alerter-cg6vj" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421871 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-systemd\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421892 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5ckg\" (UniqueName: \"kubernetes.io/projected/36ce25a6-fa50-41db-b03f-f156bba97276-kube-api-access-h5ckg\") pod \"node-resolver-xppfg\" (UID: \"36ce25a6-fa50-41db-b03f-f156bba97276\") " pod="openshift-dns/node-resolver-xppfg" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421914 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-tuned\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.421931 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421929 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5bf6331-1821-4fe3-b7ea-65575785f4ec-ovn-node-metrics-cert\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s5rn\" (UniqueName: \"kubernetes.io/projected/d5bf6331-1821-4fe3-b7ea-65575785f4ec-kube-api-access-6s5rn\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-multus-socket-dir-parent\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.421989 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-var-lib-cni-multus\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422015 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d903f3-d5c8-4043-95cb-3fc20b829340-system-cni-dir\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422038 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-kubernetes\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422060 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-run-systemd\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422094 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-cni-binary-copy\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-multus-conf-dir\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422128 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-kubernetes\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422153 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36ce25a6-fa50-41db-b03f-f156bba97276-hosts-file\") pod \"node-resolver-xppfg\" (UID: \"36ce25a6-fa50-41db-b03f-f156bba97276\") " pod="openshift-dns/node-resolver-xppfg" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422176 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-run-systemd\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422208 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422235 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5d903f3-d5c8-4043-95cb-3fc20b829340-cni-binary-copy\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422240 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422258 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-sysconfig\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-run-openvswitch\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.422534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5d903f3-d5c8-4043-95cb-3fc20b829340-os-release\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422335 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-host\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422347 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-run-openvswitch\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-systemd-units\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422384 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422352 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-sysconfig\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422380 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-systemd-units\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422410 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-registration-dir\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422413 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-host\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422468 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-registration-dir\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422499 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5d903f3-d5c8-4043-95cb-3fc20b829340-cnibin\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422528 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21a97422-63c7-4f86-8a0f-5b26c892c724-host\") pod \"node-ca-clw7t\" (UID: \"21a97422-63c7-4f86-8a0f-5b26c892c724\") " pod="openshift-image-registry/node-ca-clw7t" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422551 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-run-ovn\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422606 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k476g\" (UniqueName: \"kubernetes.io/projected/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-kube-api-access-k476g\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422617 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21a97422-63c7-4f86-8a0f-5b26c892c724-host\") pod \"node-ca-clw7t\" (UID: \"21a97422-63c7-4f86-8a0f-5b26c892c724\") " pod="openshift-image-registry/node-ca-clw7t" Jun 05 13:01:02.423332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422616 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-run-ovn\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422632 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-lib-modules\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422620 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422674 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-var-lib-kubelet\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422699 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-tmp\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422715 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-var-lib-kubelet\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422718 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-cni-bin\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422744 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-cni-bin\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422750 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-lib-modules\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422751 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422782 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-var-lib-kubelet\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-etc-openvswitch\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.422828 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-run-k8s-cni-cncf-io\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7f98cdc-be82-4e15-9361-277e2a2b6833-host-slash\") pod \"iptables-alerter-cg6vj\" (UID: \"a7f98cdc-be82-4e15-9361-277e2a2b6833\") " pod="openshift-network-operator/iptables-alerter-cg6vj" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ac4dfe8d-bf55-4914-a0d8-e1488fb959fe-konnectivity-ca\") pod \"konnectivity-agent-n2zjb\" (UID: \"ac4dfe8d-bf55-4914-a0d8-e1488fb959fe\") " pod="kube-system/konnectivity-agent-n2zjb" Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.422896 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs podName:38a40729-4f6c-462e-a7a2-476b713066c6 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:02.922876093 +0000 UTC m=+2.018785459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs") pod "network-metrics-daemon-d8pvr" (UID: "38a40729-4f6c-462e-a7a2-476b713066c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:02.424128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422885 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-etc-openvswitch\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ba01329-9a7f-41c0-bdd0-2e0877800815-dbus\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.422959 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-sysctl-conf\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423002 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-552mk\" (UniqueName: \"kubernetes.io/projected/21a97422-63c7-4f86-8a0f-5b26c892c724-kube-api-access-552mk\") pod \"node-ca-clw7t\" (UID: \"21a97422-63c7-4f86-8a0f-5b26c892c724\") " pod="openshift-image-registry/node-ca-clw7t" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423037 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-var-lib-openvswitch\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423076 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-sysctl-conf\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423156 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg8jg\" (UniqueName: \"kubernetes.io/projected/38a40729-4f6c-462e-a7a2-476b713066c6-kube-api-access-qg8jg\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423190 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-var-lib-openvswitch\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423229 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-etc-selinux\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423330 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-multus-daemon-config\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423372 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99jbn\" (UniqueName: \"kubernetes.io/projected/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-kube-api-access-99jbn\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423387 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-etc-selinux\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21a97422-63c7-4f86-8a0f-5b26c892c724-serviceca\") pod \"node-ca-clw7t\" (UID: \"21a97422-63c7-4f86-8a0f-5b26c892c724\") " pod="openshift-image-registry/node-ca-clw7t" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423449 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d5bf6331-1821-4fe3-b7ea-65575785f4ec-env-overrides\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423474 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-var-lib-cni-bin\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423500 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-sysctl-d\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423525 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-kubelet\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.424688 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423547 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-node-log\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423569 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-sys-fs\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-os-release\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-run-netns\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423646 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-run-multus-certs\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-sysctl-d\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423669 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v687c\" (UniqueName: \"kubernetes.io/projected/d5d903f3-d5c8-4043-95cb-3fc20b829340-kube-api-access-v687c\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423695 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-sys\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423716 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-sys-fs\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423719 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-cni-netd\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423755 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-socket-dir\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423759 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-cni-netd\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423783 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs67d\" (UniqueName: \"kubernetes.io/projected/a7f98cdc-be82-4e15-9361-277e2a2b6833-kube-api-access-cs67d\") pod \"iptables-alerter-cg6vj\" (UID: \"a7f98cdc-be82-4e15-9361-277e2a2b6833\") " pod="openshift-network-operator/iptables-alerter-cg6vj" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-run\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423844 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-sys\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423871 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d5bf6331-1821-4fe3-b7ea-65575785f4ec-ovnkube-config\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423887 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21a97422-63c7-4f86-8a0f-5b26c892c724-serviceca\") pod \"node-ca-clw7t\" (UID: \"21a97422-63c7-4f86-8a0f-5b26c892c724\") " pod="openshift-image-registry/node-ca-clw7t" Jun 05 13:01:02.425196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d5bf6331-1821-4fe3-b7ea-65575785f4ec-ovnkube-script-lib\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.425810 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423909 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-host-kubelet\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.425810 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-hostroot\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.425810 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.423967 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-run\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.425810 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.424017 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5d903f3-d5c8-4043-95cb-3fc20b829340-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.425810 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.424041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5d903f3-d5c8-4043-95cb-3fc20b829340-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.425810 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.424059 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d5bf6331-1821-4fe3-b7ea-65575785f4ec-env-overrides\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.425810 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.424079 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d5bf6331-1821-4fe3-b7ea-65575785f4ec-node-log\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.425810 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.424029 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c22c1419-9f45-467a-a056-416544120f8c-socket-dir\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.425810 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.424385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d5bf6331-1821-4fe3-b7ea-65575785f4ec-ovnkube-config\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.425810 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.424581 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d5bf6331-1821-4fe3-b7ea-65575785f4ec-ovnkube-script-lib\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.425810 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.425337 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-tmp\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.425810 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.425363 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-etc-tuned\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.425810 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.425475 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5bf6331-1821-4fe3-b7ea-65575785f4ec-ovn-node-metrics-cert\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.433971 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.433952 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99jbn\" (UniqueName: \"kubernetes.io/projected/fdabbe37-c0ca-422d-8b60-7fd6b90a402c-kube-api-access-99jbn\") pod \"tuned-tvx8s\" (UID: \"fdabbe37-c0ca-422d-8b60-7fd6b90a402c\") " pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.434058 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.433984 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72nd5\" (UniqueName: \"kubernetes.io/projected/c22c1419-9f45-467a-a056-416544120f8c-kube-api-access-72nd5\") pod \"aws-ebs-csi-driver-node-xtjwd\" (UID: \"c22c1419-9f45-467a-a056-416544120f8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.434455 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.434437 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg8jg\" (UniqueName: \"kubernetes.io/projected/38a40729-4f6c-462e-a7a2-476b713066c6-kube-api-access-qg8jg\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:02.434528 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.434437 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-552mk\" (UniqueName: \"kubernetes.io/projected/21a97422-63c7-4f86-8a0f-5b26c892c724-kube-api-access-552mk\") pod \"node-ca-clw7t\" (UID: \"21a97422-63c7-4f86-8a0f-5b26c892c724\") " pod="openshift-image-registry/node-ca-clw7t" Jun 05 13:01:02.434582 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.434556 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s5rn\" (UniqueName: \"kubernetes.io/projected/d5bf6331-1821-4fe3-b7ea-65575785f4ec-kube-api-access-6s5rn\") pod \"ovnkube-node-57l6g\" (UID: \"d5bf6331-1821-4fe3-b7ea-65575785f4ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.525163 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-etc-kubernetes\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.525163 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7f98cdc-be82-4e15-9361-277e2a2b6833-iptables-alerter-script\") pod \"iptables-alerter-cg6vj\" (UID: \"a7f98cdc-be82-4e15-9361-277e2a2b6833\") " pod="openshift-network-operator/iptables-alerter-cg6vj" Jun 05 13:01:02.525358 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525184 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5ckg\" (UniqueName: \"kubernetes.io/projected/36ce25a6-fa50-41db-b03f-f156bba97276-kube-api-access-h5ckg\") pod \"node-resolver-xppfg\" (UID: \"36ce25a6-fa50-41db-b03f-f156bba97276\") " pod="openshift-dns/node-resolver-xppfg" Jun 05 13:01:02.525358 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525233 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-etc-kubernetes\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.525358 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525267 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-multus-socket-dir-parent\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.525358 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525291 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-var-lib-cni-multus\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.525358 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525334 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d903f3-d5c8-4043-95cb-3fc20b829340-system-cni-dir\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.525548 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525392 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-multus-socket-dir-parent\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.525548 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525390 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d903f3-d5c8-4043-95cb-3fc20b829340-system-cni-dir\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.525548 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525429 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-var-lib-cni-multus\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.525548 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525399 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-cni-binary-copy\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.525548 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525491 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-multus-conf-dir\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.525548 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525505 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36ce25a6-fa50-41db-b03f-f156bba97276-hosts-file\") pod \"node-resolver-xppfg\" (UID: \"36ce25a6-fa50-41db-b03f-f156bba97276\") " pod="openshift-dns/node-resolver-xppfg" Jun 05 13:01:02.525548 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525520 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525562 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5d903f3-d5c8-4043-95cb-3fc20b829340-cni-binary-copy\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5d903f3-d5c8-4043-95cb-3fc20b829340-os-release\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525596 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-multus-conf-dir\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525611 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5d903f3-d5c8-4043-95cb-3fc20b829340-cnibin\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525626 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36ce25a6-fa50-41db-b03f-f156bba97276-hosts-file\") pod \"node-resolver-xppfg\" (UID: \"36ce25a6-fa50-41db-b03f-f156bba97276\") " pod="openshift-dns/node-resolver-xppfg" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.525651 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525669 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5d903f3-d5c8-4043-95cb-3fc20b829340-os-release\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k476g\" (UniqueName: \"kubernetes.io/projected/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-kube-api-access-k476g\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525687 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5d903f3-d5c8-4043-95cb-3fc20b829340-cnibin\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525690 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7f98cdc-be82-4e15-9361-277e2a2b6833-iptables-alerter-script\") pod \"iptables-alerter-cg6vj\" (UID: \"a7f98cdc-be82-4e15-9361-277e2a2b6833\") " pod="openshift-network-operator/iptables-alerter-cg6vj" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.525702 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret podName:9ba01329-9a7f-41c0-bdd0-2e0877800815 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:03.025685197 +0000 UTC m=+2.121594567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret") pod "global-pull-secret-syncer-jkcwh" (UID: "9ba01329-9a7f-41c0-bdd0-2e0877800815") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525746 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-var-lib-kubelet\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-run-k8s-cni-cncf-io\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7f98cdc-be82-4e15-9361-277e2a2b6833-host-slash\") pod \"iptables-alerter-cg6vj\" (UID: \"a7f98cdc-be82-4e15-9361-277e2a2b6833\") " pod="openshift-network-operator/iptables-alerter-cg6vj" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525791 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-var-lib-kubelet\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525831 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ac4dfe8d-bf55-4914-a0d8-e1488fb959fe-konnectivity-ca\") pod \"konnectivity-agent-n2zjb\" (UID: \"ac4dfe8d-bf55-4914-a0d8-e1488fb959fe\") " pod="kube-system/konnectivity-agent-n2zjb" Jun 05 13:01:02.525890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525855 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ba01329-9a7f-41c0-bdd0-2e0877800815-dbus\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525834 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7f98cdc-be82-4e15-9361-277e2a2b6833-host-slash\") pod \"iptables-alerter-cg6vj\" (UID: \"a7f98cdc-be82-4e15-9361-277e2a2b6833\") " pod="openshift-network-operator/iptables-alerter-cg6vj" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-multus-daemon-config\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525915 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-var-lib-cni-bin\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525822 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-run-k8s-cni-cncf-io\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525933 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-cni-binary-copy\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525942 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-os-release\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525961 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ba01329-9a7f-41c0-bdd0-2e0877800815-dbus\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525974 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-var-lib-cni-bin\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.525967 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-run-netns\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526000 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-run-netns\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526007 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-os-release\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-run-multus-certs\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526036 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-host-run-multus-certs\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526049 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v687c\" (UniqueName: \"kubernetes.io/projected/d5d903f3-d5c8-4043-95cb-3fc20b829340-kube-api-access-v687c\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526079 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs67d\" (UniqueName: \"kubernetes.io/projected/a7f98cdc-be82-4e15-9361-277e2a2b6833-kube-api-access-cs67d\") pod \"iptables-alerter-cg6vj\" (UID: \"a7f98cdc-be82-4e15-9361-277e2a2b6833\") " pod="openshift-network-operator/iptables-alerter-cg6vj" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526105 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-hostroot\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526130 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5d903f3-d5c8-4043-95cb-3fc20b829340-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.526651 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526129 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5d903f3-d5c8-4043-95cb-3fc20b829340-cni-binary-copy\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526178 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-hostroot\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5d903f3-d5c8-4043-95cb-3fc20b829340-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526258 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-system-cni-dir\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-multus-cni-dir\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526315 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-cnibin\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526342 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b4qv\" (UniqueName: \"kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv\") pod \"network-check-target-fzzzn\" (UID: \"10040f93-33d5-4334-87f2-eac44ad53e20\") " pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526347 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ac4dfe8d-bf55-4914-a0d8-e1488fb959fe-konnectivity-ca\") pod \"konnectivity-agent-n2zjb\" (UID: \"ac4dfe8d-bf55-4914-a0d8-e1488fb959fe\") " pod="kube-system/konnectivity-agent-n2zjb" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526354 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-multus-daemon-config\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526355 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-system-cni-dir\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526367 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-multus-cni-dir\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526349 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5d903f3-d5c8-4043-95cb-3fc20b829340-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526390 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-cnibin\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526411 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ac4dfe8d-bf55-4914-a0d8-e1488fb959fe-agent-certs\") pod \"konnectivity-agent-n2zjb\" (UID: \"ac4dfe8d-bf55-4914-a0d8-e1488fb959fe\") " pod="kube-system/konnectivity-agent-n2zjb" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36ce25a6-fa50-41db-b03f-f156bba97276-tmp-dir\") pod \"node-resolver-xppfg\" (UID: \"36ce25a6-fa50-41db-b03f-f156bba97276\") " pod="openshift-dns/node-resolver-xppfg" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526456 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ba01329-9a7f-41c0-bdd0-2e0877800815-kubelet-config\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526480 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5d903f3-d5c8-4043-95cb-3fc20b829340-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526521 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ba01329-9a7f-41c0-bdd0-2e0877800815-kubelet-config\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:02.527312 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526716 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36ce25a6-fa50-41db-b03f-f156bba97276-tmp-dir\") pod \"node-resolver-xppfg\" (UID: \"36ce25a6-fa50-41db-b03f-f156bba97276\") " pod="openshift-dns/node-resolver-xppfg" Jun 05 13:01:02.527847 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526834 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5d903f3-d5c8-4043-95cb-3fc20b829340-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.527847 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.526880 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5d903f3-d5c8-4043-95cb-3fc20b829340-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.529071 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.529052 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ac4dfe8d-bf55-4914-a0d8-e1488fb959fe-agent-certs\") pod \"konnectivity-agent-n2zjb\" (UID: \"ac4dfe8d-bf55-4914-a0d8-e1488fb959fe\") " pod="kube-system/konnectivity-agent-n2zjb" Jun 05 13:01:02.533161 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.533143 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:02.533161 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.533163 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:02.533357 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.533174 2567 projected.go:196] Error preparing data for projected volume kube-api-access-4b4qv for pod openshift-network-diagnostics/network-check-target-fzzzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:02.533357 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.533232 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv podName:10040f93-33d5-4334-87f2-eac44ad53e20 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:03.033218595 +0000 UTC m=+2.129127965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4b4qv" (UniqueName: "kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv") pod "network-check-target-fzzzn" (UID: "10040f93-33d5-4334-87f2-eac44ad53e20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:02.533575 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.533555 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v687c\" (UniqueName: \"kubernetes.io/projected/d5d903f3-d5c8-4043-95cb-3fc20b829340-kube-api-access-v687c\") pod \"multus-additional-cni-plugins-j9pl7\" (UID: \"d5d903f3-d5c8-4043-95cb-3fc20b829340\") " pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.533653 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.533638 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5ckg\" (UniqueName: \"kubernetes.io/projected/36ce25a6-fa50-41db-b03f-f156bba97276-kube-api-access-h5ckg\") pod \"node-resolver-xppfg\" (UID: \"36ce25a6-fa50-41db-b03f-f156bba97276\") " pod="openshift-dns/node-resolver-xppfg" Jun 05 13:01:02.533686 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.533674 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k476g\" (UniqueName: \"kubernetes.io/projected/5cb26d4a-8613-47ab-a0cb-dc10d4969bc0-kube-api-access-k476g\") pod \"multus-rsfkm\" (UID: \"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0\") " pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.535382 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.535365 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs67d\" (UniqueName: \"kubernetes.io/projected/a7f98cdc-be82-4e15-9361-277e2a2b6833-kube-api-access-cs67d\") pod \"iptables-alerter-cg6vj\" (UID: \"a7f98cdc-be82-4e15-9361-277e2a2b6833\") " pod="openshift-network-operator/iptables-alerter-cg6vj" Jun 05 13:01:02.620593 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.620527 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:02.626898 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.626782 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" Jun 05 13:01:02.629491 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:02.629467 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bf6331_1821_4fe3_b7ea_65575785f4ec.slice/crio-d3d80c6c9f1255cc02b344563d043bf6ba1ff7354b82e2c03758c66783dfffe7 WatchSource:0}: Error finding container d3d80c6c9f1255cc02b344563d043bf6ba1ff7354b82e2c03758c66783dfffe7: Status 404 returned error can't find the container with id d3d80c6c9f1255cc02b344563d043bf6ba1ff7354b82e2c03758c66783dfffe7 Jun 05 13:01:02.634423 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.634272 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n2zjb" Jun 05 13:01:02.634699 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:02.634679 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22c1419_9f45_467a_a056_416544120f8c.slice/crio-fcf737b4be46289935aa0ceda8344ffaf53a83ca5129e6c0b794425dbbf48e0a WatchSource:0}: Error finding container fcf737b4be46289935aa0ceda8344ffaf53a83ca5129e6c0b794425dbbf48e0a: Status 404 returned error can't find the container with id fcf737b4be46289935aa0ceda8344ffaf53a83ca5129e6c0b794425dbbf48e0a Jun 05 13:01:02.638095 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.638078 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" Jun 05 13:01:02.644066 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.644044 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-clw7t" Jun 05 13:01:02.644366 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:02.644344 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4dfe8d_bf55_4914_a0d8_e1488fb959fe.slice/crio-4555ef2a5a6739475751aa3686ee70eb267982bbc88a3618f5135477c7f09419 WatchSource:0}: Error finding container 4555ef2a5a6739475751aa3686ee70eb267982bbc88a3618f5135477c7f09419: Status 404 returned error can't find the container with id 4555ef2a5a6739475751aa3686ee70eb267982bbc88a3618f5135477c7f09419 Jun 05 13:01:02.647853 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:02.647822 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdabbe37_c0ca_422d_8b60_7fd6b90a402c.slice/crio-d656f93ef181476312095ee92f32d328d7f54d59f38217017e313d2a9b414fc2 WatchSource:0}: Error finding container d656f93ef181476312095ee92f32d328d7f54d59f38217017e313d2a9b414fc2: Status 404 returned error can't find the container with id d656f93ef181476312095ee92f32d328d7f54d59f38217017e313d2a9b414fc2 Jun 05 13:01:02.648569 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.648551 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rsfkm" Jun 05 13:01:02.653631 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:02.653600 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a97422_63c7_4f86_8a0f_5b26c892c724.slice/crio-9179a1dd2f5f53405127419c2afd716215247a89c07ed8d47cd40b44e88c5a11 WatchSource:0}: Error finding container 9179a1dd2f5f53405127419c2afd716215247a89c07ed8d47cd40b44e88c5a11: Status 404 returned error can't find the container with id 9179a1dd2f5f53405127419c2afd716215247a89c07ed8d47cd40b44e88c5a11 Jun 05 13:01:02.656458 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.655255 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cg6vj" Jun 05 13:01:02.660016 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:02.659992 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb26d4a_8613_47ab_a0cb_dc10d4969bc0.slice/crio-dfeeea2791b2f4006ea499191961bc3f39eae814ac02f04f9e31837c32363f21 WatchSource:0}: Error finding container dfeeea2791b2f4006ea499191961bc3f39eae814ac02f04f9e31837c32363f21: Status 404 returned error can't find the container with id dfeeea2791b2f4006ea499191961bc3f39eae814ac02f04f9e31837c32363f21 Jun 05 13:01:02.660862 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.660847 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xppfg" Jun 05 13:01:02.664273 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.664257 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j9pl7" Jun 05 13:01:02.664522 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:02.664504 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f98cdc_be82_4e15_9361_277e2a2b6833.slice/crio-b29d6efa6650eb7f982f6c6d8143e2d68b75ae2bbe0a3545beee834e8c2190d1 WatchSource:0}: Error finding container b29d6efa6650eb7f982f6c6d8143e2d68b75ae2bbe0a3545beee834e8c2190d1: Status 404 returned error can't find the container with id b29d6efa6650eb7f982f6c6d8143e2d68b75ae2bbe0a3545beee834e8c2190d1 Jun 05 13:01:02.670379 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:02.670245 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36ce25a6_fa50_41db_b03f_f156bba97276.slice/crio-d61c6f1ebf3faa051c3e294d5da6618d7c4a6661dba922ef57a605be175f16fb WatchSource:0}: Error finding container d61c6f1ebf3faa051c3e294d5da6618d7c4a6661dba922ef57a605be175f16fb: Status 404 returned error can't find the container with id d61c6f1ebf3faa051c3e294d5da6618d7c4a6661dba922ef57a605be175f16fb Jun 05 13:01:02.673249 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:02.673225 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d903f3_d5c8_4043_95cb_3fc20b829340.slice/crio-c6b2832b05070c2dafd99c64c35e1b4141d656582a58616aaa573f7daf460492 WatchSource:0}: Error finding container c6b2832b05070c2dafd99c64c35e1b4141d656582a58616aaa573f7daf460492: Status 404 returned error can't find the container with id c6b2832b05070c2dafd99c64c35e1b4141d656582a58616aaa573f7daf460492 Jun 05 13:01:02.830307 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.830263 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:01:02.871906 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.871823 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:01:02.930097 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:02.929579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:02.930097 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.929701 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:02.930097 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:02.929773 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs podName:38a40729-4f6c-462e-a7a2-476b713066c6 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:03.929752359 +0000 UTC m=+3.025661728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs") pod "network-metrics-daemon-d8pvr" (UID: "38a40729-4f6c-462e-a7a2-476b713066c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:03.030155 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.030123 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:03.030335 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:03.030286 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:03.030404 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:03.030370 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret podName:9ba01329-9a7f-41c0-bdd0-2e0877800815 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:04.030351717 +0000 UTC m=+3.126261084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret") pod "global-pull-secret-syncer-jkcwh" (UID: "9ba01329-9a7f-41c0-bdd0-2e0877800815") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:03.131412 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.131326 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b4qv\" (UniqueName: \"kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv\") pod \"network-check-target-fzzzn\" (UID: \"10040f93-33d5-4334-87f2-eac44ad53e20\") " pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:03.132007 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:03.131675 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:03.132007 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:03.131700 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:03.132007 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:03.131713 2567 projected.go:196] Error preparing data for projected volume kube-api-access-4b4qv for pod openshift-network-diagnostics/network-check-target-fzzzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:03.132007 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:03.131774 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv podName:10040f93-33d5-4334-87f2-eac44ad53e20 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:04.13175495 +0000 UTC m=+3.227664319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b4qv" (UniqueName: "kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv") pod "network-check-target-fzzzn" (UID: "10040f93-33d5-4334-87f2-eac44ad53e20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:03.290318 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.290276 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:01:03.360023 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.359976 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 12:56:02 +0000 UTC" deadline="2027-12-07 02:48:30.173738107 +0000 UTC" Jun 05 13:01:03.360023 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.360020 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13189h47m26.813722798s" Jun 05 13:01:03.375856 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.375829 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:03.376010 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:03.375983 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:03.389683 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.389608 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-clw7t" event={"ID":"21a97422-63c7-4f86-8a0f-5b26c892c724","Type":"ContainerStarted","Data":"9179a1dd2f5f53405127419c2afd716215247a89c07ed8d47cd40b44e88c5a11"} Jun 05 13:01:03.394910 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.394883 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" event={"ID":"c22c1419-9f45-467a-a056-416544120f8c","Type":"ContainerStarted","Data":"fcf737b4be46289935aa0ceda8344ffaf53a83ca5129e6c0b794425dbbf48e0a"} Jun 05 13:01:03.398392 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.398366 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" event={"ID":"d5bf6331-1821-4fe3-b7ea-65575785f4ec","Type":"ContainerStarted","Data":"d3d80c6c9f1255cc02b344563d043bf6ba1ff7354b82e2c03758c66783dfffe7"} Jun 05 13:01:03.403710 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.403682 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xppfg" event={"ID":"36ce25a6-fa50-41db-b03f-f156bba97276","Type":"ContainerStarted","Data":"d61c6f1ebf3faa051c3e294d5da6618d7c4a6661dba922ef57a605be175f16fb"} Jun 05 13:01:03.408287 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.408244 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cg6vj" event={"ID":"a7f98cdc-be82-4e15-9361-277e2a2b6833","Type":"ContainerStarted","Data":"b29d6efa6650eb7f982f6c6d8143e2d68b75ae2bbe0a3545beee834e8c2190d1"} Jun 05 13:01:03.410172 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.410148 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" event={"ID":"fdabbe37-c0ca-422d-8b60-7fd6b90a402c","Type":"ContainerStarted","Data":"d656f93ef181476312095ee92f32d328d7f54d59f38217017e313d2a9b414fc2"} Jun 05 13:01:03.413573 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.413552 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n2zjb" event={"ID":"ac4dfe8d-bf55-4914-a0d8-e1488fb959fe","Type":"ContainerStarted","Data":"4555ef2a5a6739475751aa3686ee70eb267982bbc88a3618f5135477c7f09419"} Jun 05 13:01:03.416188 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.416165 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9pl7" event={"ID":"d5d903f3-d5c8-4043-95cb-3fc20b829340","Type":"ContainerStarted","Data":"c6b2832b05070c2dafd99c64c35e1b4141d656582a58616aaa573f7daf460492"} Jun 05 13:01:03.424368 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.424345 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rsfkm" event={"ID":"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0","Type":"ContainerStarted","Data":"dfeeea2791b2f4006ea499191961bc3f39eae814ac02f04f9e31837c32363f21"} Jun 05 13:01:03.938267 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:03.938227 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:03.938481 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:03.938460 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:03.938545 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:03.938536 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs podName:38a40729-4f6c-462e-a7a2-476b713066c6 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:05.938516837 +0000 UTC m=+5.034426214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs") pod "network-metrics-daemon-d8pvr" (UID: "38a40729-4f6c-462e-a7a2-476b713066c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:04.038961 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:04.038848 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:04.039137 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:04.038994 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:04.039137 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:04.039052 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret podName:9ba01329-9a7f-41c0-bdd0-2e0877800815 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:06.039033889 +0000 UTC m=+5.134943262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret") pod "global-pull-secret-syncer-jkcwh" (UID: "9ba01329-9a7f-41c0-bdd0-2e0877800815") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:04.139781 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:04.139742 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b4qv\" (UniqueName: \"kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv\") pod \"network-check-target-fzzzn\" (UID: \"10040f93-33d5-4334-87f2-eac44ad53e20\") " pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:04.139959 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:04.139944 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:04.140019 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:04.139962 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:04.140019 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:04.139976 2567 projected.go:196] Error preparing data for projected volume kube-api-access-4b4qv for pod openshift-network-diagnostics/network-check-target-fzzzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:04.140128 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:04.140033 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv podName:10040f93-33d5-4334-87f2-eac44ad53e20 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:06.140015021 +0000 UTC m=+5.235924392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b4qv" (UniqueName: "kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv") pod "network-check-target-fzzzn" (UID: "10040f93-33d5-4334-87f2-eac44ad53e20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:04.227907 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:04.227658 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:01:04.360726 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:04.360614 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 12:56:02 +0000 UTC" deadline="2027-12-07 00:19:46.510831025 +0000 UTC" Jun 05 13:01:04.360726 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:04.360674 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13187h18m42.150160478s" Jun 05 13:01:04.375497 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:04.374861 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:04.375497 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:04.374994 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:04.375497 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:04.375387 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:04.375997 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:04.375937 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:05.378444 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:05.377944 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:05.378444 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:05.378059 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:05.954143 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:05.954106 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:05.954356 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:05.954323 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:05.954476 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:05.954425 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs podName:38a40729-4f6c-462e-a7a2-476b713066c6 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:09.954380637 +0000 UTC m=+9.050290020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs") pod "network-metrics-daemon-d8pvr" (UID: "38a40729-4f6c-462e-a7a2-476b713066c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:06.056226 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:06.055471 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:06.056226 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:06.055644 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:06.056226 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:06.055707 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret podName:9ba01329-9a7f-41c0-bdd0-2e0877800815 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:10.055689418 +0000 UTC m=+9.151598789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret") pod "global-pull-secret-syncer-jkcwh" (UID: "9ba01329-9a7f-41c0-bdd0-2e0877800815") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:06.156567 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:06.156529 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b4qv\" (UniqueName: \"kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv\") pod \"network-check-target-fzzzn\" (UID: \"10040f93-33d5-4334-87f2-eac44ad53e20\") " pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:06.156784 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:06.156770 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:06.156845 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:06.156790 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:06.156845 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:06.156802 2567 projected.go:196] Error preparing data for projected volume kube-api-access-4b4qv for pod openshift-network-diagnostics/network-check-target-fzzzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:06.156978 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:06.156857 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv podName:10040f93-33d5-4334-87f2-eac44ad53e20 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:10.156839787 +0000 UTC m=+9.252749161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b4qv" (UniqueName: "kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv") pod "network-check-target-fzzzn" (UID: "10040f93-33d5-4334-87f2-eac44ad53e20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:06.375677 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:06.375555 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:06.375834 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:06.375697 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:06.376054 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:06.376038 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:06.376148 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:06.376128 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:07.375339 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:07.375286 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:07.375786 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:07.375437 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:08.374921 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:08.374882 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:08.375109 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:08.375037 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:08.375538 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:08.375518 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:08.375901 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:08.375621 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:09.375483 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:09.375445 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:09.375644 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:09.375588 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:09.988442 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:09.988405 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:09.988675 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:09.988561 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:09.988675 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:09.988630 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs podName:38a40729-4f6c-462e-a7a2-476b713066c6 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:17.988610852 +0000 UTC m=+17.084520221 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs") pod "network-metrics-daemon-d8pvr" (UID: "38a40729-4f6c-462e-a7a2-476b713066c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:10.090388 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:10.089830 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:10.090388 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:10.089967 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:10.090388 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:10.090027 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret podName:9ba01329-9a7f-41c0-bdd0-2e0877800815 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:18.09000956 +0000 UTC m=+17.185918945 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret") pod "global-pull-secret-syncer-jkcwh" (UID: "9ba01329-9a7f-41c0-bdd0-2e0877800815") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:10.190783 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:10.190748 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b4qv\" (UniqueName: \"kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv\") pod \"network-check-target-fzzzn\" (UID: \"10040f93-33d5-4334-87f2-eac44ad53e20\") " pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:10.190942 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:10.190909 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:10.190942 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:10.190926 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:10.190942 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:10.190938 2567 projected.go:196] Error preparing data for projected volume kube-api-access-4b4qv for pod openshift-network-diagnostics/network-check-target-fzzzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:10.191119 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:10.191008 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv podName:10040f93-33d5-4334-87f2-eac44ad53e20 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:18.190990721 +0000 UTC m=+17.286900094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b4qv" (UniqueName: "kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv") pod "network-check-target-fzzzn" (UID: "10040f93-33d5-4334-87f2-eac44ad53e20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:10.374883 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:10.374807 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:10.375019 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:10.374939 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:10.375019 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:10.374978 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:10.375103 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:10.375062 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:11.375215 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:11.375184 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:11.375694 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:11.375272 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:12.375446 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:12.375411 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:12.375886 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:12.375422 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:12.375886 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:12.375547 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:12.375886 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:12.375650 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:13.375482 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:13.375444 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:13.375938 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:13.375575 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:14.374900 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:14.374608 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:14.375084 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:14.375018 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:14.375084 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:14.374666 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:14.375180 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:14.375119 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:15.374960 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:15.374928 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:15.375452 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:15.375055 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:16.375622 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:16.375586 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:16.376080 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:16.375720 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:16.376080 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:16.375781 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:16.376080 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:16.375900 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:17.375122 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:17.375078 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:17.375334 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:17.375206 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:18.051115 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:18.051020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:18.051549 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:18.051174 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:18.051549 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:18.051243 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs podName:38a40729-4f6c-462e-a7a2-476b713066c6 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:34.051221606 +0000 UTC m=+33.147130978 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs") pod "network-metrics-daemon-d8pvr" (UID: "38a40729-4f6c-462e-a7a2-476b713066c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:18.152156 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:18.152121 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:18.152361 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:18.152240 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:18.152361 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:18.152313 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret podName:9ba01329-9a7f-41c0-bdd0-2e0877800815 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:34.152282375 +0000 UTC m=+33.248191795 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret") pod "global-pull-secret-syncer-jkcwh" (UID: "9ba01329-9a7f-41c0-bdd0-2e0877800815") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:18.252532 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:18.252489 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b4qv\" (UniqueName: \"kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv\") pod \"network-check-target-fzzzn\" (UID: \"10040f93-33d5-4334-87f2-eac44ad53e20\") " pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:18.252691 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:18.252670 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:18.252768 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:18.252702 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:18.252768 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:18.252717 2567 projected.go:196] Error preparing data for projected volume kube-api-access-4b4qv for pod openshift-network-diagnostics/network-check-target-fzzzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:18.252858 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:18.252783 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv podName:10040f93-33d5-4334-87f2-eac44ad53e20 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:34.252763531 +0000 UTC m=+33.348672918 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b4qv" (UniqueName: "kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv") pod "network-check-target-fzzzn" (UID: "10040f93-33d5-4334-87f2-eac44ad53e20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:18.375154 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:18.375042 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:18.375320 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:18.375191 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:18.375320 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:18.375229 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:18.375422 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:18.375353 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:19.375411 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:19.375373 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:19.375830 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:19.375513 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:20.375534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:20.375491 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:20.375921 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:20.375539 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:20.375921 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:20.375644 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:20.375921 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:20.375761 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:21.375341 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:21.375291 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:21.375521 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:21.375404 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:22.375657 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:22.375599 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:22.375949 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:22.375721 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:22.375949 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:22.375767 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:22.375949 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:22.375857 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:22.469654 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:22.469623 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" event={"ID":"d5bf6331-1821-4fe3-b7ea-65575785f4ec","Type":"ContainerStarted","Data":"2c11c995f515221b62258a29d79ca646cd8f9751b7806c43489e8f58e7982c68"} Jun 05 13:01:22.471022 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:22.470997 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-41.ec2.internal" event={"ID":"28389313146ae7cbd001561ce72544af","Type":"ContainerStarted","Data":"959d98c21ec1caf501dcafe5446f95933a1bd9fd6ae057a356fdec7f986b893c"} Jun 05 13:01:22.474146 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:22.474120 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" event={"ID":"fdabbe37-c0ca-422d-8b60-7fd6b90a402c","Type":"ContainerStarted","Data":"b5367d35c56473cb26f0745ab8f1c6fb5bb229f2c7c4d50b2dffb538ea1f504c"} Jun 05 13:01:22.484479 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:22.484434 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-41.ec2.internal" podStartSLOduration=20.484420508 podStartE2EDuration="20.484420508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:22.484151794 +0000 UTC m=+21.580061184" watchObservedRunningTime="2026-06-05 13:01:22.484420508 +0000 UTC m=+21.580329897" Jun 05 13:01:22.498272 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:22.498226 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tvx8s" podStartSLOduration=2.130321822 podStartE2EDuration="21.498210299s" totalImagesPullingTime="19.367888477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:22.498116437 +0000 UTC m=+21.594025829" watchObservedRunningTime="2026-06-05 13:01:22.498210299 +0000 UTC m=+21.594119687" Jun 05 13:01:23.375861 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.375605 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:23.376704 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:23.375872 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:23.478470 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.478428 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-clw7t" event={"ID":"21a97422-63c7-4f86-8a0f-5b26c892c724","Type":"ContainerStarted","Data":"1bc4d95fd41d1dd35b245e8ed2b85e843c2137bc940f6c228ce699ef6f1e8ada"} Jun 05 13:01:23.480085 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.480048 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" event={"ID":"c22c1419-9f45-467a-a056-416544120f8c","Type":"ContainerStarted","Data":"31d536854500be9cc80d18322898e3dfd1df2f233238f436e0bbbe9db39dcbe0"} Jun 05 13:01:23.482987 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.482966 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-57l6g_d5bf6331-1821-4fe3-b7ea-65575785f4ec/ovn-acl-logging/0.log" Jun 05 13:01:23.483372 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.483346 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5bf6331-1821-4fe3-b7ea-65575785f4ec" containerID="9a24f67cb8324bf24130ecf6836c9d3ee221f52692e046cf0ed8ae086d169b15" exitCode=1 Jun 05 13:01:23.483467 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.483421 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" event={"ID":"d5bf6331-1821-4fe3-b7ea-65575785f4ec","Type":"ContainerStarted","Data":"d3b6ac17a1f8f9591bdbed9caf19a324e37bc864ed32abb3a54862de7c1dcb50"} Jun 05 13:01:23.483516 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.483497 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" event={"ID":"d5bf6331-1821-4fe3-b7ea-65575785f4ec","Type":"ContainerStarted","Data":"4672205cee0222bd1fdee832e8c914da0302646087cf02db2e46839fd103c9fe"} Jun 05 13:01:23.483633 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.483546 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" event={"ID":"d5bf6331-1821-4fe3-b7ea-65575785f4ec","Type":"ContainerStarted","Data":"d9e5c5d0826ffd848e6bde679274e91b572dc536781f581798a64afb69c6ed59"} Jun 05 13:01:23.483633 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.483596 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" event={"ID":"d5bf6331-1821-4fe3-b7ea-65575785f4ec","Type":"ContainerStarted","Data":"1cc3dec3a09fb13a33691e87fa7541f74dc2c28be58b3026affb1708a69b8b60"} Jun 05 13:01:23.483742 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.483642 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" event={"ID":"d5bf6331-1821-4fe3-b7ea-65575785f4ec","Type":"ContainerDied","Data":"9a24f67cb8324bf24130ecf6836c9d3ee221f52692e046cf0ed8ae086d169b15"} Jun 05 13:01:23.484995 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.484976 2567 generic.go:356] "Generic (PLEG): container finished" podID="cbc49bd359e481edd83d964f89d1efa9" containerID="cc6d1243c080de4e02d727f8d35336b58062b4f342f23401c2f4b49b8a3c3be1" exitCode=0 Jun 05 13:01:23.485091 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.485001 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal" event={"ID":"cbc49bd359e481edd83d964f89d1efa9","Type":"ContainerDied","Data":"cc6d1243c080de4e02d727f8d35336b58062b4f342f23401c2f4b49b8a3c3be1"} Jun 05 13:01:23.486758 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.486731 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xppfg" event={"ID":"36ce25a6-fa50-41db-b03f-f156bba97276","Type":"ContainerStarted","Data":"98f4225f80fbf59913c02c41fb2757678f8364143d000d1090c54bba0d53d075"} Jun 05 13:01:23.488152 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.488132 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cg6vj" event={"ID":"a7f98cdc-be82-4e15-9361-277e2a2b6833","Type":"ContainerStarted","Data":"b8ebc94fe9be956c5c8d70e92dde235a313156a6c8230322ebb2709dd983d516"} Jun 05 13:01:23.489714 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.489696 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n2zjb" event={"ID":"ac4dfe8d-bf55-4914-a0d8-e1488fb959fe","Type":"ContainerStarted","Data":"24522bea900e3097bcc77c4c1220d603885160571a42f48c5a7b347b481aef75"} Jun 05 13:01:23.491160 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.491142 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5d903f3-d5c8-4043-95cb-3fc20b829340" containerID="64849e70f4ab042db2c69b1db2c64eb996ef93e1d716dd86410aa12f24cfb7da" exitCode=0 Jun 05 13:01:23.491260 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.491208 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9pl7" event={"ID":"d5d903f3-d5c8-4043-95cb-3fc20b829340","Type":"ContainerDied","Data":"64849e70f4ab042db2c69b1db2c64eb996ef93e1d716dd86410aa12f24cfb7da"} Jun 05 13:01:23.493273 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.493250 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rsfkm" event={"ID":"5cb26d4a-8613-47ab-a0cb-dc10d4969bc0","Type":"ContainerStarted","Data":"f2a9c6bfac5eaa1625162205727c416075e31e93ef3ade1eed4d02615d059e6f"} Jun 05 13:01:23.493433 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.493389 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-clw7t" podStartSLOduration=3.139294458 podStartE2EDuration="22.493373502s" totalImagesPullingTime="19.354079044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:23.492834483 +0000 UTC m=+22.588743884" watchObservedRunningTime="2026-06-05 13:01:23.493373502 +0000 UTC m=+22.589282892" Jun 05 13:01:23.505555 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.505520 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cg6vj" podStartSLOduration=3.162250659 podStartE2EDuration="22.505508319s" totalImagesPullingTime="19.34325766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:23.505008849 +0000 UTC m=+22.600918241" watchObservedRunningTime="2026-06-05 13:01:23.505508319 +0000 UTC m=+22.601417708" Jun 05 13:01:23.518745 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.518709 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n2zjb" podStartSLOduration=3.155615177 podStartE2EDuration="22.5186924s" totalImagesPullingTime="19.363077223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:23.518102671 +0000 UTC m=+22.614012059" watchObservedRunningTime="2026-06-05 13:01:23.5186924 +0000 UTC m=+22.614601791" Jun 05 13:01:23.531007 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.530960 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xppfg" podStartSLOduration=3.192683696 podStartE2EDuration="22.530946773s" totalImagesPullingTime="19.338263077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:23.530817635 +0000 UTC m=+22.626727027" watchObservedRunningTime="2026-06-05 13:01:23.530946773 +0000 UTC m=+22.626856162" Jun 05 13:01:23.583675 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:23.583629 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rsfkm" podStartSLOduration=2.633235986 podStartE2EDuration="22.583614094s" totalImagesPullingTime="19.950378108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:23.583446654 +0000 UTC m=+22.679356043" watchObservedRunningTime="2026-06-05 13:01:23.583614094 +0000 UTC m=+22.679523483" Jun 05 13:01:24.019574 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:24.019515 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 13:01:24.375535 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:24.375455 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:24.375535 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:24.375501 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:24.375790 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:24.375605 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:24.375790 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:24.375735 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:24.376040 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:24.375956 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T13:01:24.01954072Z","UUID":"246ea65d-1ecf-4c61-9d15-b63935a1879a","Handler":null,"Name":"","Endpoint":""} Jun 05 13:01:24.377719 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:24.377700 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 13:01:24.377824 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:24.377740 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 13:01:24.497947 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:24.497872 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" event={"ID":"c22c1419-9f45-467a-a056-416544120f8c","Type":"ContainerStarted","Data":"89d15cd9a0695e0a03498031911cfb8fdf6d2c4b50f98e625bb621c7e7ea9606"} Jun 05 13:01:24.500081 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:24.500029 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal" event={"ID":"cbc49bd359e481edd83d964f89d1efa9","Type":"ContainerStarted","Data":"c77b5bbc52bfe175a8849f9aeb6996221777b96f86f861fa3999ee3a7edb6c4b"} Jun 05 13:01:24.516314 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:24.516242 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-41.ec2.internal" podStartSLOduration=22.516222515 podStartE2EDuration="22.516222515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:24.516165779 +0000 UTC m=+23.612075169" watchObservedRunningTime="2026-06-05 13:01:24.516222515 +0000 UTC m=+23.612131906" Jun 05 13:01:25.374911 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:25.374876 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:25.375105 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:25.375007 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:25.505330 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:25.505228 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" event={"ID":"c22c1419-9f45-467a-a056-416544120f8c","Type":"ContainerStarted","Data":"aeea3a205bca614efd2626b776f3186a8629eea24b60aef6e1c86d98a8024db6"} Jun 05 13:01:25.508965 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:25.508934 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-57l6g_d5bf6331-1821-4fe3-b7ea-65575785f4ec/ovn-acl-logging/0.log" Jun 05 13:01:25.509347 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:25.509324 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" event={"ID":"d5bf6331-1821-4fe3-b7ea-65575785f4ec","Type":"ContainerStarted","Data":"7b15aeab021e7bba9dbbc56b758662f23cb61cce0100ad8aec1f6c80372f046d"} Jun 05 13:01:25.521498 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:25.521457 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xtjwd" podStartSLOduration=3.063954858 podStartE2EDuration="24.521443504s" totalImagesPullingTime="21.457488646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:25.521361485 +0000 UTC m=+24.617270875" watchObservedRunningTime="2026-06-05 13:01:25.521443504 +0000 UTC m=+24.617352894" Jun 05 13:01:26.375482 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:26.375447 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:26.375672 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:26.375573 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:26.375672 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:26.375618 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:26.375782 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:26.375694 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:27.374794 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:27.374759 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:27.375221 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:27.374878 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:28.374905 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:28.374699 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:28.375727 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:28.374741 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:28.375727 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:28.375008 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:28.375727 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:28.375044 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:28.454209 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:28.454122 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n2zjb" Jun 05 13:01:28.454821 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:28.454807 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n2zjb" Jun 05 13:01:28.517589 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:28.517549 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5d903f3-d5c8-4043-95cb-3fc20b829340" containerID="7179a0f83c7b4ff83788c94f915f46f144b98a53f5efd81113076338406187bf" exitCode=0 Jun 05 13:01:28.517736 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:28.517615 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9pl7" event={"ID":"d5d903f3-d5c8-4043-95cb-3fc20b829340","Type":"ContainerDied","Data":"7179a0f83c7b4ff83788c94f915f46f144b98a53f5efd81113076338406187bf"} Jun 05 13:01:28.521226 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:28.521209 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-57l6g_d5bf6331-1821-4fe3-b7ea-65575785f4ec/ovn-acl-logging/0.log" Jun 05 13:01:28.521607 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:28.521582 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" event={"ID":"d5bf6331-1821-4fe3-b7ea-65575785f4ec","Type":"ContainerStarted","Data":"9bfc0e855656edbd1a332c5d399776d0e27887a81cc2758c59633dba34f68d85"} Jun 05 13:01:28.521830 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:28.521810 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n2zjb" Jun 05 13:01:28.522071 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:28.522049 2567 scope.go:117] "RemoveContainer" containerID="9a24f67cb8324bf24130ecf6836c9d3ee221f52692e046cf0ed8ae086d169b15" Jun 05 13:01:28.522191 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:28.522178 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n2zjb" Jun 05 13:01:29.375172 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.375142 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:29.375647 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:29.375276 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:29.527818 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.527646 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-57l6g_d5bf6331-1821-4fe3-b7ea-65575785f4ec/ovn-acl-logging/0.log" Jun 05 13:01:29.528243 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.528206 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" event={"ID":"d5bf6331-1821-4fe3-b7ea-65575785f4ec","Type":"ContainerStarted","Data":"637a9c656519455b1fa600c7cff4bc7dabcdea66cc28ca9d7fea435f8d5ca601"} Jun 05 13:01:29.528606 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.528506 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:29.528606 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.528582 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:29.528744 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.528622 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:29.544261 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.544236 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:29.544396 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.544382 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:01:29.557918 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.557870 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" podStartSLOduration=8.873823884 podStartE2EDuration="28.55785497s" totalImagesPullingTime="19.684031086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:29.557617178 +0000 UTC m=+28.653526568" watchObservedRunningTime="2026-06-05 13:01:29.55785497 +0000 UTC m=+28.653764359" Jun 05 13:01:29.804859 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.804830 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fzzzn"] Jun 05 13:01:29.804981 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.804968 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:29.805081 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:29.805062 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:29.807879 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.807850 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jkcwh"] Jun 05 13:01:29.808114 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.807955 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:29.808114 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:29.808058 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:29.808465 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.808437 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d8pvr"] Jun 05 13:01:29.808580 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:29.808545 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:29.808668 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:29.808649 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:30.532185 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:30.532155 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5d903f3-d5c8-4043-95cb-3fc20b829340" containerID="ba996762eca03dd5795c78ed97e6b1ccd738b36006086852032dfff5a5a857e4" exitCode=0 Jun 05 13:01:30.532583 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:30.532233 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9pl7" event={"ID":"d5d903f3-d5c8-4043-95cb-3fc20b829340","Type":"ContainerDied","Data":"ba996762eca03dd5795c78ed97e6b1ccd738b36006086852032dfff5a5a857e4"} Jun 05 13:01:31.375568 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:31.375542 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:31.375720 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:31.375631 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:31.375720 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:31.375640 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:31.375839 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:31.375727 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:31.375839 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:31.375750 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:31.375839 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:31.375792 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:32.538412 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:32.538374 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5d903f3-d5c8-4043-95cb-3fc20b829340" containerID="eca1f365d814203db1ce5534ebadf1765988f57f3bed361b2585e4f8242ecca7" exitCode=0 Jun 05 13:01:32.538790 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:32.538445 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9pl7" event={"ID":"d5d903f3-d5c8-4043-95cb-3fc20b829340","Type":"ContainerDied","Data":"eca1f365d814203db1ce5534ebadf1765988f57f3bed361b2585e4f8242ecca7"} Jun 05 13:01:33.375219 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:33.375179 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:33.375413 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:33.375222 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:33.375413 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:33.375177 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:33.375413 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:33.375320 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:33.375572 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:33.375419 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:33.375572 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:33.375528 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:34.066027 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:34.065986 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:34.066481 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:34.066154 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:34.066481 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:34.066228 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs podName:38a40729-4f6c-462e-a7a2-476b713066c6 nodeName:}" failed. No retries permitted until 2026-06-05 13:02:06.066207646 +0000 UTC m=+65.162117026 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs") pod "network-metrics-daemon-d8pvr" (UID: "38a40729-4f6c-462e-a7a2-476b713066c6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:01:34.166927 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:34.166899 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:34.167105 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:34.167023 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:34.167105 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:34.167075 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret podName:9ba01329-9a7f-41c0-bdd0-2e0877800815 nodeName:}" failed. No retries permitted until 2026-06-05 13:02:06.167061344 +0000 UTC m=+65.262970711 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret") pod "global-pull-secret-syncer-jkcwh" (UID: "9ba01329-9a7f-41c0-bdd0-2e0877800815") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:01:34.267712 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:34.267674 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b4qv\" (UniqueName: \"kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv\") pod \"network-check-target-fzzzn\" (UID: \"10040f93-33d5-4334-87f2-eac44ad53e20\") " pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:34.267882 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:34.267816 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:01:34.267882 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:34.267843 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:01:34.267882 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:34.267857 2567 projected.go:196] Error preparing data for projected volume kube-api-access-4b4qv for pod openshift-network-diagnostics/network-check-target-fzzzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:34.268026 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:34.267919 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv podName:10040f93-33d5-4334-87f2-eac44ad53e20 nodeName:}" failed. No retries permitted until 2026-06-05 13:02:06.267900568 +0000 UTC m=+65.363809948 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b4qv" (UniqueName: "kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv") pod "network-check-target-fzzzn" (UID: "10040f93-33d5-4334-87f2-eac44ad53e20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:01:35.375026 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:35.374821 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:35.375513 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:35.374826 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:35.375513 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:35.375116 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzzzn" podUID="10040f93-33d5-4334-87f2-eac44ad53e20" Jun 05 13:01:35.375513 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:35.375224 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:01:35.375513 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:35.374855 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:35.375513 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:35.375349 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jkcwh" podUID="9ba01329-9a7f-41c0-bdd0-2e0877800815" Jun 05 13:01:36.272497 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.272467 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-41.ec2.internal" event="NodeReady" Jun 05 13:01:36.272679 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.272625 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 13:01:36.315864 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.315779 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gjjrg"] Jun 05 13:01:36.320789 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.320757 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:36.321210 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.321187 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sdcfn"] Jun 05 13:01:36.323051 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.323029 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 13:01:36.323155 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.323097 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 13:01:36.323409 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.323374 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ncksb\"" Jun 05 13:01:36.324069 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.324049 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sdcfn" Jun 05 13:01:36.326150 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.326116 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 13:01:36.326251 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.326118 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 13:01:36.326251 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.326155 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 13:01:36.326251 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.326203 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rrg9b\"" Jun 05 13:01:36.332542 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.332512 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gjjrg"] Jun 05 13:01:36.334202 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.334171 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sdcfn"] Jun 05 13:01:36.383407 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.383341 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:36.383407 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.383391 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66185e84-4ad4-4cc9-ba1f-7aeee8766740-tmp-dir\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:36.383869 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.383421 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfdmx\" (UniqueName: \"kubernetes.io/projected/66185e84-4ad4-4cc9-ba1f-7aeee8766740-kube-api-access-tfdmx\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:36.383869 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.383476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66185e84-4ad4-4cc9-ba1f-7aeee8766740-config-volume\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:36.484143 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.484105 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:36.484335 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.484153 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66185e84-4ad4-4cc9-ba1f-7aeee8766740-tmp-dir\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:36.484335 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.484181 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfdmx\" (UniqueName: \"kubernetes.io/projected/66185e84-4ad4-4cc9-ba1f-7aeee8766740-kube-api-access-tfdmx\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:36.484335 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:36.484267 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:01:36.484335 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.484307 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65c18ec1-2a1a-4848-873f-cc54c505901e-cert\") pod \"ingress-canary-sdcfn\" (UID: \"65c18ec1-2a1a-4848-873f-cc54c505901e\") " pod="openshift-ingress-canary/ingress-canary-sdcfn" Jun 05 13:01:36.484555 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:36.484349 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls podName:66185e84-4ad4-4cc9-ba1f-7aeee8766740 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:36.984327526 +0000 UTC m=+36.080236892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls") pod "dns-default-gjjrg" (UID: "66185e84-4ad4-4cc9-ba1f-7aeee8766740") : secret "dns-default-metrics-tls" not found Jun 05 13:01:36.484555 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.484443 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p47xn\" (UniqueName: \"kubernetes.io/projected/65c18ec1-2a1a-4848-873f-cc54c505901e-kube-api-access-p47xn\") pod \"ingress-canary-sdcfn\" (UID: \"65c18ec1-2a1a-4848-873f-cc54c505901e\") " pod="openshift-ingress-canary/ingress-canary-sdcfn" Jun 05 13:01:36.484555 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.484481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66185e84-4ad4-4cc9-ba1f-7aeee8766740-config-volume\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:36.484677 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.484580 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66185e84-4ad4-4cc9-ba1f-7aeee8766740-tmp-dir\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:36.484972 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.484953 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66185e84-4ad4-4cc9-ba1f-7aeee8766740-config-volume\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:36.495318 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.495267 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfdmx\" (UniqueName: \"kubernetes.io/projected/66185e84-4ad4-4cc9-ba1f-7aeee8766740-kube-api-access-tfdmx\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:36.584893 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.584803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65c18ec1-2a1a-4848-873f-cc54c505901e-cert\") pod \"ingress-canary-sdcfn\" (UID: \"65c18ec1-2a1a-4848-873f-cc54c505901e\") " pod="openshift-ingress-canary/ingress-canary-sdcfn" Jun 05 13:01:36.584893 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.584874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p47xn\" (UniqueName: \"kubernetes.io/projected/65c18ec1-2a1a-4848-873f-cc54c505901e-kube-api-access-p47xn\") pod \"ingress-canary-sdcfn\" (UID: \"65c18ec1-2a1a-4848-873f-cc54c505901e\") " pod="openshift-ingress-canary/ingress-canary-sdcfn" Jun 05 13:01:36.587744 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.587717 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65c18ec1-2a1a-4848-873f-cc54c505901e-cert\") pod \"ingress-canary-sdcfn\" (UID: \"65c18ec1-2a1a-4848-873f-cc54c505901e\") " pod="openshift-ingress-canary/ingress-canary-sdcfn" Jun 05 13:01:36.593333 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.593306 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p47xn\" (UniqueName: \"kubernetes.io/projected/65c18ec1-2a1a-4848-873f-cc54c505901e-kube-api-access-p47xn\") pod \"ingress-canary-sdcfn\" (UID: \"65c18ec1-2a1a-4848-873f-cc54c505901e\") " pod="openshift-ingress-canary/ingress-canary-sdcfn" Jun 05 13:01:36.641897 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.641862 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sdcfn" Jun 05 13:01:36.815975 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.815948 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sdcfn"] Jun 05 13:01:36.819828 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:36.819799 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c18ec1_2a1a_4848_873f_cc54c505901e.slice/crio-57d51a9f7723fa20a2567a408d71dfee35bfc019d574bab5fc724089515ed92b WatchSource:0}: Error finding container 57d51a9f7723fa20a2567a408d71dfee35bfc019d574bab5fc724089515ed92b: Status 404 returned error can't find the container with id 57d51a9f7723fa20a2567a408d71dfee35bfc019d574bab5fc724089515ed92b Jun 05 13:01:36.988561 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:36.988367 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:36.988681 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:36.988517 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:01:36.988681 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:36.988671 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls podName:66185e84-4ad4-4cc9-ba1f-7aeee8766740 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:37.988657578 +0000 UTC m=+37.084566945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls") pod "dns-default-gjjrg" (UID: "66185e84-4ad4-4cc9-ba1f-7aeee8766740") : secret "dns-default-metrics-tls" not found Jun 05 13:01:37.375202 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:37.375164 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:01:37.375410 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:37.375164 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:01:37.375481 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:37.375176 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:01:37.377881 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:37.377860 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 13:01:37.378011 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:37.377932 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 13:01:37.378011 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:37.377932 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 13:01:37.378654 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:37.378637 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v8nr\"" Jun 05 13:01:37.378727 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:37.378672 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 13:01:37.378807 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:37.378791 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gqt82\"" Jun 05 13:01:37.551575 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:37.551540 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sdcfn" event={"ID":"65c18ec1-2a1a-4848-873f-cc54c505901e","Type":"ContainerStarted","Data":"57d51a9f7723fa20a2567a408d71dfee35bfc019d574bab5fc724089515ed92b"} Jun 05 13:01:37.554582 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:37.554560 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5d903f3-d5c8-4043-95cb-3fc20b829340" containerID="f3b1292fcc8d66bb27ff6b13c6b3613f63ef58d1034719e2deeace090abc8cef" exitCode=0 Jun 05 13:01:37.554710 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:37.554595 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9pl7" event={"ID":"d5d903f3-d5c8-4043-95cb-3fc20b829340","Type":"ContainerDied","Data":"f3b1292fcc8d66bb27ff6b13c6b3613f63ef58d1034719e2deeace090abc8cef"} Jun 05 13:01:37.996990 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:37.996911 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:37.997162 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:37.997096 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:01:37.997229 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:37.997164 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls podName:66185e84-4ad4-4cc9-ba1f-7aeee8766740 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:39.997146544 +0000 UTC m=+39.093055913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls") pod "dns-default-gjjrg" (UID: "66185e84-4ad4-4cc9-ba1f-7aeee8766740") : secret "dns-default-metrics-tls" not found Jun 05 13:01:38.560139 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:38.560102 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5d903f3-d5c8-4043-95cb-3fc20b829340" containerID="59ac993eaeff0c07dcc63105805168082ae2ecc522c93d122ec0e0d80bd4b397" exitCode=0 Jun 05 13:01:38.560139 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:38.560142 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9pl7" event={"ID":"d5d903f3-d5c8-4043-95cb-3fc20b829340","Type":"ContainerDied","Data":"59ac993eaeff0c07dcc63105805168082ae2ecc522c93d122ec0e0d80bd4b397"} Jun 05 13:01:39.565799 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:39.565763 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j9pl7" event={"ID":"d5d903f3-d5c8-4043-95cb-3fc20b829340","Type":"ContainerStarted","Data":"17f5205278bf0593487c25352ef77737c615ba3532c1d40eaac3ad74eef66153"} Jun 05 13:01:39.588973 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:39.588637 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j9pl7" podStartSLOduration=8.295882546 podStartE2EDuration="38.588613297s" totalImagesPullingTime="30.292730751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:39.586811841 +0000 UTC m=+38.682721230" watchObservedRunningTime="2026-06-05 13:01:39.588613297 +0000 UTC m=+38.684522687" Jun 05 13:01:40.013489 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:40.013452 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:40.013653 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:40.013614 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:01:40.013710 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:40.013683 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls podName:66185e84-4ad4-4cc9-ba1f-7aeee8766740 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:44.013667866 +0000 UTC m=+43.109577232 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls") pod "dns-default-gjjrg" (UID: "66185e84-4ad4-4cc9-ba1f-7aeee8766740") : secret "dns-default-metrics-tls" not found Jun 05 13:01:40.569667 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:40.569631 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sdcfn" event={"ID":"65c18ec1-2a1a-4848-873f-cc54c505901e","Type":"ContainerStarted","Data":"2d6616b0860dfef8f47a3c62e7faa128f83f928956a1969d5a372d5ca0ea88f1"} Jun 05 13:01:40.585985 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:40.585941 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sdcfn" podStartSLOduration=1.7929556469999999 podStartE2EDuration="4.585926184s" totalImagesPullingTime="2.792970537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:01:40.585502152 +0000 UTC m=+39.681411541" watchObservedRunningTime="2026-06-05 13:01:40.585926184 +0000 UTC m=+39.681835573" Jun 05 13:01:44.038417 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:44.038370 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:44.038908 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:44.038510 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:01:44.038908 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:44.038584 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls podName:66185e84-4ad4-4cc9-ba1f-7aeee8766740 nodeName:}" failed. No retries permitted until 2026-06-05 13:01:52.038563231 +0000 UTC m=+51.134472607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls") pod "dns-default-gjjrg" (UID: "66185e84-4ad4-4cc9-ba1f-7aeee8766740") : secret "dns-default-metrics-tls" not found Jun 05 13:01:52.094382 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:52.094338 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:01:52.095037 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:52.094494 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:01:52.095037 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:01:52.094589 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls podName:66185e84-4ad4-4cc9-ba1f-7aeee8766740 nodeName:}" failed. No retries permitted until 2026-06-05 13:02:08.094567767 +0000 UTC m=+67.190477137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls") pod "dns-default-gjjrg" (UID: "66185e84-4ad4-4cc9-ba1f-7aeee8766740") : secret "dns-default-metrics-tls" not found Jun 05 13:01:56.298332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.298282 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9"] Jun 05 13:01:56.301030 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.301013 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" Jun 05 13:01:56.303537 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.303514 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 05 13:01:56.303634 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.303554 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8smcm\"" Jun 05 13:01:56.304396 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.304376 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 05 13:01:56.304483 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.304432 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 05 13:01:56.304633 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.304618 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 05 13:01:56.308644 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.308625 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9"] Jun 05 13:01:56.319008 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.318987 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk"] Jun 05 13:01:56.321227 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.321213 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.323565 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.323545 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 05 13:01:56.323649 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.323634 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 05 13:01:56.323696 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.323669 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 05 13:01:56.323743 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.323693 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 05 13:01:56.332240 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.332223 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk"] Jun 05 13:01:56.427059 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.427026 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/696566cb-f851-4f93-95c4-0d2d187392d6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.427059 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.427058 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcqrs\" (UniqueName: \"kubernetes.io/projected/696566cb-f851-4f93-95c4-0d2d187392d6-kube-api-access-hcqrs\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.427353 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.427099 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/696566cb-f851-4f93-95c4-0d2d187392d6-ca\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.427353 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.427118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/696566cb-f851-4f93-95c4-0d2d187392d6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.427353 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.427157 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/696566cb-f851-4f93-95c4-0d2d187392d6-hub\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.427353 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.427226 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b61e481f-a940-4be0-92d2-b9a923337f36-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66858d6b4b-c8bw9\" (UID: \"b61e481f-a940-4be0-92d2-b9a923337f36\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" Jun 05 13:01:56.427353 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.427250 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpb7w\" (UniqueName: \"kubernetes.io/projected/b61e481f-a940-4be0-92d2-b9a923337f36-kube-api-access-qpb7w\") pod \"managed-serviceaccount-addon-agent-66858d6b4b-c8bw9\" (UID: \"b61e481f-a940-4be0-92d2-b9a923337f36\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" Jun 05 13:01:56.427353 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.427275 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/696566cb-f851-4f93-95c4-0d2d187392d6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.528572 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.528539 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/696566cb-f851-4f93-95c4-0d2d187392d6-ca\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.528572 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.528574 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/696566cb-f851-4f93-95c4-0d2d187392d6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.528776 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.528594 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/696566cb-f851-4f93-95c4-0d2d187392d6-hub\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.528776 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.528652 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b61e481f-a940-4be0-92d2-b9a923337f36-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66858d6b4b-c8bw9\" (UID: \"b61e481f-a940-4be0-92d2-b9a923337f36\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" Jun 05 13:01:56.528776 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.528677 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpb7w\" (UniqueName: \"kubernetes.io/projected/b61e481f-a940-4be0-92d2-b9a923337f36-kube-api-access-qpb7w\") pod \"managed-serviceaccount-addon-agent-66858d6b4b-c8bw9\" (UID: \"b61e481f-a940-4be0-92d2-b9a923337f36\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" Jun 05 13:01:56.528776 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.528704 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/696566cb-f851-4f93-95c4-0d2d187392d6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.528776 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.528753 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/696566cb-f851-4f93-95c4-0d2d187392d6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.528776 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.528776 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcqrs\" (UniqueName: \"kubernetes.io/projected/696566cb-f851-4f93-95c4-0d2d187392d6-kube-api-access-hcqrs\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.529594 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.529546 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/696566cb-f851-4f93-95c4-0d2d187392d6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.532373 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.532348 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/696566cb-f851-4f93-95c4-0d2d187392d6-ca\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.532501 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.532479 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/696566cb-f851-4f93-95c4-0d2d187392d6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.532543 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.532499 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/696566cb-f851-4f93-95c4-0d2d187392d6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.532543 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.532490 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/696566cb-f851-4f93-95c4-0d2d187392d6-hub\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.532543 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.532519 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b61e481f-a940-4be0-92d2-b9a923337f36-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66858d6b4b-c8bw9\" (UID: \"b61e481f-a940-4be0-92d2-b9a923337f36\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" Jun 05 13:01:56.536994 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.536971 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcqrs\" (UniqueName: \"kubernetes.io/projected/696566cb-f851-4f93-95c4-0d2d187392d6-kube-api-access-hcqrs\") pod \"cluster-proxy-proxy-agent-bd44cd74-vlzpk\" (UID: \"696566cb-f851-4f93-95c4-0d2d187392d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.537111 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.537093 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpb7w\" (UniqueName: \"kubernetes.io/projected/b61e481f-a940-4be0-92d2-b9a923337f36-kube-api-access-qpb7w\") pod \"managed-serviceaccount-addon-agent-66858d6b4b-c8bw9\" (UID: \"b61e481f-a940-4be0-92d2-b9a923337f36\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" Jun 05 13:01:56.627077 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.627053 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" Jun 05 13:01:56.634385 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.634361 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:01:56.785274 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.785207 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9"] Jun 05 13:01:56.788617 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:56.788588 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk"] Jun 05 13:01:56.789865 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:01:56.789840 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb61e481f_a940_4be0_92d2_b9a923337f36.slice/crio-030cf7689f32feca984b6444d5f63c0f4c05d2350bec07dae5c6d1bffff83711 WatchSource:0}: Error finding container 030cf7689f32feca984b6444d5f63c0f4c05d2350bec07dae5c6d1bffff83711: Status 404 returned error can't find the container with id 030cf7689f32feca984b6444d5f63c0f4c05d2350bec07dae5c6d1bffff83711 Jun 05 13:01:57.609552 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:57.609469 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" event={"ID":"696566cb-f851-4f93-95c4-0d2d187392d6","Type":"ContainerStarted","Data":"ab25df4e4a8e209816e5a681cf1a4cd79dc50a965965471891faae1c9474feb8"} Jun 05 13:01:57.612103 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:01:57.612074 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" event={"ID":"b61e481f-a940-4be0-92d2-b9a923337f36","Type":"ContainerStarted","Data":"030cf7689f32feca984b6444d5f63c0f4c05d2350bec07dae5c6d1bffff83711"} Jun 05 13:02:01.548197 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:01.548171 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-57l6g" Jun 05 13:02:01.624717 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:01.624644 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" event={"ID":"b61e481f-a940-4be0-92d2-b9a923337f36","Type":"ContainerStarted","Data":"495d6929c8a4057a7f8babc2ba41ccd020a767b963a5602889a04e3bc3889f2c"} Jun 05 13:02:01.639960 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:01.639899 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" podStartSLOduration=1.060483818 podStartE2EDuration="5.639880554s" totalImagesPullingTime="4.579396736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:02:01.639747276 +0000 UTC m=+60.735656666" watchObservedRunningTime="2026-06-05 13:02:01.639880554 +0000 UTC m=+60.735789944" Jun 05 13:02:02.629360 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:02.629323 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" event={"ID":"696566cb-f851-4f93-95c4-0d2d187392d6","Type":"ContainerStarted","Data":"2ad7f766b7175b35a513526f0309bef1e8991d054f141bae181957db28bd4c43"} Jun 05 13:02:02.629730 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:02.629369 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" event={"ID":"696566cb-f851-4f93-95c4-0d2d187392d6","Type":"ContainerStarted","Data":"654249b8a5e4ce49d24fc87ef6723cd0d84031403de04c8be4ad69cb05b2d0bd"} Jun 05 13:02:02.629730 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:02.629382 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" event={"ID":"696566cb-f851-4f93-95c4-0d2d187392d6","Type":"ContainerStarted","Data":"80844c3615e4c0f2132fe3a4ded655825e6812df36128705ef28c73febabdc62"} Jun 05 13:02:02.647941 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:02.647882 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" podStartSLOduration=1.708180195 podStartE2EDuration="6.647867802s" totalImagesPullingTime="4.939687607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:02:02.646346426 +0000 UTC m=+61.742255814" watchObservedRunningTime="2026-06-05 13:02:02.647867802 +0000 UTC m=+61.743777190" Jun 05 13:02:06.106341 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.106274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:02:06.108915 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.108897 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 13:02:06.116792 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:02:06.116762 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 13:02:06.116855 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:02:06.116836 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs podName:38a40729-4f6c-462e-a7a2-476b713066c6 nodeName:}" failed. No retries permitted until 2026-06-05 13:03:10.11681738 +0000 UTC m=+129.212726746 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs") pod "network-metrics-daemon-d8pvr" (UID: "38a40729-4f6c-462e-a7a2-476b713066c6") : secret "metrics-daemon-secret" not found Jun 05 13:02:06.206818 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.206788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:02:06.209150 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.209132 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 13:02:06.220019 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.219993 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba01329-9a7f-41c0-bdd0-2e0877800815-original-pull-secret\") pod \"global-pull-secret-syncer-jkcwh\" (UID: \"9ba01329-9a7f-41c0-bdd0-2e0877800815\") " pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:02:06.307622 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.307587 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b4qv\" (UniqueName: \"kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv\") pod \"network-check-target-fzzzn\" (UID: \"10040f93-33d5-4334-87f2-eac44ad53e20\") " pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:02:06.310123 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.310104 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 13:02:06.320621 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.320599 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 13:02:06.332089 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.332059 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b4qv\" (UniqueName: \"kubernetes.io/projected/10040f93-33d5-4334-87f2-eac44ad53e20-kube-api-access-4b4qv\") pod \"network-check-target-fzzzn\" (UID: \"10040f93-33d5-4334-87f2-eac44ad53e20\") " pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:02:06.487534 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.487501 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gqt82\"" Jun 05 13:02:06.489903 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.489889 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jkcwh" Jun 05 13:02:06.495310 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.495283 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:02:06.612887 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.612861 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jkcwh"] Jun 05 13:02:06.616220 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:02:06.616192 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba01329_9a7f_41c0_bdd0_2e0877800815.slice/crio-64055440320fc5c34083861f994eef03803ba0531b41b6e74baaccca3cfb9f71 WatchSource:0}: Error finding container 64055440320fc5c34083861f994eef03803ba0531b41b6e74baaccca3cfb9f71: Status 404 returned error can't find the container with id 64055440320fc5c34083861f994eef03803ba0531b41b6e74baaccca3cfb9f71 Jun 05 13:02:06.632427 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.632402 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fzzzn"] Jun 05 13:02:06.635477 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:02:06.635444 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10040f93_33d5_4334_87f2_eac44ad53e20.slice/crio-f29c8a8d76d701faaee3842e7b3e77efb0efb3dabf34604b5de7a01202c8d453 WatchSource:0}: Error finding container f29c8a8d76d701faaee3842e7b3e77efb0efb3dabf34604b5de7a01202c8d453: Status 404 returned error can't find the container with id f29c8a8d76d701faaee3842e7b3e77efb0efb3dabf34604b5de7a01202c8d453 Jun 05 13:02:06.639361 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.639331 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jkcwh" event={"ID":"9ba01329-9a7f-41c0-bdd0-2e0877800815","Type":"ContainerStarted","Data":"64055440320fc5c34083861f994eef03803ba0531b41b6e74baaccca3cfb9f71"} Jun 05 13:02:06.640350 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:06.640328 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fzzzn" event={"ID":"10040f93-33d5-4334-87f2-eac44ad53e20","Type":"ContainerStarted","Data":"f29c8a8d76d701faaee3842e7b3e77efb0efb3dabf34604b5de7a01202c8d453"} Jun 05 13:02:08.119717 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:08.119419 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:02:08.119717 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:02:08.119558 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:02:08.119717 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:02:08.119625 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls podName:66185e84-4ad4-4cc9-ba1f-7aeee8766740 nodeName:}" failed. No retries permitted until 2026-06-05 13:02:40.119606502 +0000 UTC m=+99.215515907 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls") pod "dns-default-gjjrg" (UID: "66185e84-4ad4-4cc9-ba1f-7aeee8766740") : secret "dns-default-metrics-tls" not found Jun 05 13:02:11.656982 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:11.656947 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fzzzn" event={"ID":"10040f93-33d5-4334-87f2-eac44ad53e20","Type":"ContainerStarted","Data":"7a3fb5758b2ebd9ad972976c2479ba7058f2ac18e010c666e40ce55a9f4dcedc"} Jun 05 13:02:11.657447 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:11.657026 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:02:11.658330 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:11.658288 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jkcwh" event={"ID":"9ba01329-9a7f-41c0-bdd0-2e0877800815","Type":"ContainerStarted","Data":"3a44ddc4213659532f23734c739ba7bcd64eeb287aec53b344e2057c247b0acd"} Jun 05 13:02:11.673495 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:11.673445 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fzzzn" podStartSLOduration=66.225424458 podStartE2EDuration="1m10.673428698s" totalImagesPullingTime="4.44800424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:02:11.672722699 +0000 UTC m=+70.768632089" watchObservedRunningTime="2026-06-05 13:02:11.673428698 +0000 UTC m=+70.769338096" Jun 05 13:02:40.137874 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:40.137838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:02:40.138367 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:02:40.137948 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:02:40.138367 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:02:40.138000 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls podName:66185e84-4ad4-4cc9-ba1f-7aeee8766740 nodeName:}" failed. No retries permitted until 2026-06-05 13:03:44.137986928 +0000 UTC m=+163.233896296 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls") pod "dns-default-gjjrg" (UID: "66185e84-4ad4-4cc9-ba1f-7aeee8766740") : secret "dns-default-metrics-tls" not found Jun 05 13:02:42.663404 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:42.663374 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fzzzn" Jun 05 13:02:42.678807 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:02:42.678767 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jkcwh" podStartSLOduration=97.208428393 podStartE2EDuration="1m41.678754183s" totalImagesPullingTime="4.47032579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:02:11.687912651 +0000 UTC m=+70.783822040" watchObservedRunningTime="2026-06-05 13:02:42.678754183 +0000 UTC m=+101.774663566" Jun 05 13:03:10.142859 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:03:10.142824 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:03:10.143373 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:03:10.142936 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 13:03:10.143373 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:03:10.143001 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs podName:38a40729-4f6c-462e-a7a2-476b713066c6 nodeName:}" failed. No retries permitted until 2026-06-05 13:05:12.14298628 +0000 UTC m=+251.238895648 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs") pod "network-metrics-daemon-d8pvr" (UID: "38a40729-4f6c-462e-a7a2-476b713066c6") : secret "metrics-daemon-secret" not found Jun 05 13:03:39.335380 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:03:39.335320 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gjjrg" podUID="66185e84-4ad4-4cc9-ba1f-7aeee8766740" Jun 05 13:03:39.903420 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:03:39.903391 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gjjrg" Jun 05 13:03:40.394203 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:03:40.394168 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-d8pvr" podUID="38a40729-4f6c-462e-a7a2-476b713066c6" Jun 05 13:03:44.174922 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:03:44.174881 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:03:44.175331 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:03:44.175000 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:03:44.175331 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:03:44.175066 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls podName:66185e84-4ad4-4cc9-ba1f-7aeee8766740 nodeName:}" failed. No retries permitted until 2026-06-05 13:05:46.175049632 +0000 UTC m=+285.270959016 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls") pod "dns-default-gjjrg" (UID: "66185e84-4ad4-4cc9-ba1f-7aeee8766740") : secret "dns-default-metrics-tls" not found Jun 05 13:03:53.375281 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:03:53.375191 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:04:01.968537 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:01.968503 2567 generic.go:356] "Generic (PLEG): container finished" podID="b61e481f-a940-4be0-92d2-b9a923337f36" containerID="495d6929c8a4057a7f8babc2ba41ccd020a767b963a5602889a04e3bc3889f2c" exitCode=255 Jun 05 13:04:01.968906 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:01.968550 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" event={"ID":"b61e481f-a940-4be0-92d2-b9a923337f36","Type":"ContainerDied","Data":"495d6929c8a4057a7f8babc2ba41ccd020a767b963a5602889a04e3bc3889f2c"} Jun 05 13:04:01.968906 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:01.968802 2567 scope.go:117] "RemoveContainer" containerID="495d6929c8a4057a7f8babc2ba41ccd020a767b963a5602889a04e3bc3889f2c" Jun 05 13:04:02.972970 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:02.972937 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" event={"ID":"b61e481f-a940-4be0-92d2-b9a923337f36","Type":"ContainerStarted","Data":"fe27f6326d540c8ae2f4c02a99726a1cb37a0669b4ed99637e63a4d89f2c6a92"} Jun 05 13:04:39.616630 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.616595 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cvkkw"] Jun 05 13:04:39.618608 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.618593 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.621719 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.621684 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 13:04:39.621719 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.621697 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lwxx2\"" Jun 05 13:04:39.621719 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.621709 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 13:04:39.621930 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.621697 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 13:04:39.621930 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.621699 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 13:04:39.632106 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.632079 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cvkkw"] Jun 05 13:04:39.761123 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.761035 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84f4d4da-a915-48ba-9c70-0a6acf5b010e-crio-socket\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.761123 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.761076 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2d4x\" (UniqueName: \"kubernetes.io/projected/84f4d4da-a915-48ba-9c70-0a6acf5b010e-kube-api-access-x2d4x\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.761123 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.761125 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84f4d4da-a915-48ba-9c70-0a6acf5b010e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.761377 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.761152 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84f4d4da-a915-48ba-9c70-0a6acf5b010e-data-volume\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.761377 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.761174 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.861518 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.861465 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84f4d4da-a915-48ba-9c70-0a6acf5b010e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.861518 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.861533 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84f4d4da-a915-48ba-9c70-0a6acf5b010e-data-volume\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.861771 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.861556 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.861771 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.861583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84f4d4da-a915-48ba-9c70-0a6acf5b010e-crio-socket\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.861771 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.861609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2d4x\" (UniqueName: \"kubernetes.io/projected/84f4d4da-a915-48ba-9c70-0a6acf5b010e-kube-api-access-x2d4x\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.861771 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:04:39.861687 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 05 13:04:39.861771 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.861697 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84f4d4da-a915-48ba-9c70-0a6acf5b010e-crio-socket\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.861771 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:04:39.861747 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls podName:84f4d4da-a915-48ba-9c70-0a6acf5b010e nodeName:}" failed. No retries permitted until 2026-06-05 13:04:40.361731724 +0000 UTC m=+219.457641091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cvkkw" (UID: "84f4d4da-a915-48ba-9c70-0a6acf5b010e") : secret "insights-runtime-extractor-tls" not found Jun 05 13:04:39.862123 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.861947 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84f4d4da-a915-48ba-9c70-0a6acf5b010e-data-volume\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.862194 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.862171 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84f4d4da-a915-48ba-9c70-0a6acf5b010e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:39.869497 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:39.869475 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2d4x\" (UniqueName: \"kubernetes.io/projected/84f4d4da-a915-48ba-9c70-0a6acf5b010e-kube-api-access-x2d4x\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:40.365649 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:40.365603 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:40.365836 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:04:40.365755 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 05 13:04:40.365836 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:04:40.365829 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls podName:84f4d4da-a915-48ba-9c70-0a6acf5b010e nodeName:}" failed. No retries permitted until 2026-06-05 13:04:41.365811184 +0000 UTC m=+220.461720556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cvkkw" (UID: "84f4d4da-a915-48ba-9c70-0a6acf5b010e") : secret "insights-runtime-extractor-tls" not found Jun 05 13:04:40.522193 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:40.522167 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xppfg_36ce25a6-fa50-41db-b03f-f156bba97276/dns-node-resolver/0.log" Jun 05 13:04:41.320457 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:41.320435 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-clw7t_21a97422-63c7-4f86-8a0f-5b26c892c724/node-ca/0.log" Jun 05 13:04:41.372827 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:41.372794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:41.372962 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:04:41.372945 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 05 13:04:41.373020 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:04:41.373009 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls podName:84f4d4da-a915-48ba-9c70-0a6acf5b010e nodeName:}" failed. No retries permitted until 2026-06-05 13:04:43.372991263 +0000 UTC m=+222.468900630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cvkkw" (UID: "84f4d4da-a915-48ba-9c70-0a6acf5b010e") : secret "insights-runtime-extractor-tls" not found Jun 05 13:04:42.321655 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:42.321627 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sdcfn_65c18ec1-2a1a-4848-873f-cc54c505901e/serve-healthcheck-canary/0.log" Jun 05 13:04:43.389710 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:43.389676 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:43.390168 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:04:43.389814 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 05 13:04:43.390168 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:04:43.389890 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls podName:84f4d4da-a915-48ba-9c70-0a6acf5b010e nodeName:}" failed. No retries permitted until 2026-06-05 13:04:47.3898704 +0000 UTC m=+226.485779771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cvkkw" (UID: "84f4d4da-a915-48ba-9c70-0a6acf5b010e") : secret "insights-runtime-extractor-tls" not found Jun 05 13:04:47.421916 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:47.421868 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:47.422323 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:04:47.422014 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 05 13:04:47.422323 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:04:47.422075 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls podName:84f4d4da-a915-48ba-9c70-0a6acf5b010e nodeName:}" failed. No retries permitted until 2026-06-05 13:04:55.422059784 +0000 UTC m=+234.517969152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cvkkw" (UID: "84f4d4da-a915-48ba-9c70-0a6acf5b010e") : secret "insights-runtime-extractor-tls" not found Jun 05 13:04:55.481173 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:55.481125 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:55.483503 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:55.483478 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84f4d4da-a915-48ba-9c70-0a6acf5b010e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cvkkw\" (UID: \"84f4d4da-a915-48ba-9c70-0a6acf5b010e\") " pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:55.527866 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:55.527816 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cvkkw" Jun 05 13:04:55.655533 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:55.655499 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cvkkw"] Jun 05 13:04:55.659113 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:04:55.659082 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f4d4da_a915_48ba_9c70_0a6acf5b010e.slice/crio-6d8246e2b525835a8e5cb952f2d8e8a584cb9a9663bef6e3e59ff84407fe1cbb WatchSource:0}: Error finding container 6d8246e2b525835a8e5cb952f2d8e8a584cb9a9663bef6e3e59ff84407fe1cbb: Status 404 returned error can't find the container with id 6d8246e2b525835a8e5cb952f2d8e8a584cb9a9663bef6e3e59ff84407fe1cbb Jun 05 13:04:56.120489 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:56.120451 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cvkkw" event={"ID":"84f4d4da-a915-48ba-9c70-0a6acf5b010e","Type":"ContainerStarted","Data":"1212244fc5dda1a60d56a73a8f38020f31093c7f854a9a8964be1c65523b6cf1"} Jun 05 13:04:56.120657 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:56.120508 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cvkkw" event={"ID":"84f4d4da-a915-48ba-9c70-0a6acf5b010e","Type":"ContainerStarted","Data":"6d8246e2b525835a8e5cb952f2d8e8a584cb9a9663bef6e3e59ff84407fe1cbb"} Jun 05 13:04:56.636069 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:56.636028 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" podUID="696566cb-f851-4f93-95c4-0d2d187392d6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 13:04:57.126290 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:57.126154 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cvkkw" event={"ID":"84f4d4da-a915-48ba-9c70-0a6acf5b010e","Type":"ContainerStarted","Data":"824974a5378efbea24a3f72273f2ba436b4a83555496856e502b292dbcbcd0a0"} Jun 05 13:04:58.133610 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:58.133575 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cvkkw" event={"ID":"84f4d4da-a915-48ba-9c70-0a6acf5b010e","Type":"ContainerStarted","Data":"4246ba3bbb3ca6a50c247c5af020081ee94ed4c49c1b913acafe47a0bc411205"} Jun 05 13:04:58.152078 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:04:58.152026 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cvkkw" podStartSLOduration=17.16393016 podStartE2EDuration="19.152011393s" totalImagesPullingTime="1.988081233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:04:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:04:58.150525191 +0000 UTC m=+237.246434619" watchObservedRunningTime="2026-06-05 13:04:58.152011393 +0000 UTC m=+237.247920783" Jun 05 13:05:02.772775 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.772740 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-588cb6756-kfj87"] Jun 05 13:05:02.775026 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.775008 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:02.777369 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.777346 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 13:05:02.777485 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.777393 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 13:05:02.777675 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.777659 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 13:05:02.777743 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.777729 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-47p46\"" Jun 05 13:05:02.786355 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.786326 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 13:05:02.788529 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.788504 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-588cb6756-kfj87"] Jun 05 13:05:02.936872 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.936827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-479zk\" (UniqueName: \"kubernetes.io/projected/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-kube-api-access-479zk\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:02.936872 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.936875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-image-registry-private-configuration\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:02.937106 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.936950 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-trusted-ca\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:02.937106 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.936986 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-installation-pull-secrets\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:02.937106 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.937012 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-registry-tls\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:02.937106 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.937042 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-registry-certificates\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:02.937238 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.937106 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-ca-trust-extracted\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:02.937238 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:02.937125 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-bound-sa-token\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.038171 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.038084 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-registry-tls\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.038171 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.038121 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-registry-certificates\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.038171 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.038143 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-ca-trust-extracted\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.038171 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.038158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-bound-sa-token\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.038498 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.038219 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-479zk\" (UniqueName: \"kubernetes.io/projected/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-kube-api-access-479zk\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.038498 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.038235 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-image-registry-private-configuration\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.038498 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.038260 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-trusted-ca\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.038498 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.038356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-installation-pull-secrets\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.038689 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.038615 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-ca-trust-extracted\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.039140 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.039110 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-registry-certificates\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.039260 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.039155 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-trusted-ca\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.040770 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.040749 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-registry-tls\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.040870 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.040774 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-installation-pull-secrets\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.040909 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.040874 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-image-registry-private-configuration\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.045825 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.045803 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-bound-sa-token\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.045926 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.045806 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-479zk\" (UniqueName: \"kubernetes.io/projected/122a57d4-1c1b-4c5f-91f5-b945bb8e5f51-kube-api-access-479zk\") pod \"image-registry-588cb6756-kfj87\" (UID: \"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51\") " pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.084472 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.084441 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:03.209098 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:03.209068 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-588cb6756-kfj87"] Jun 05 13:05:03.212391 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:05:03.212364 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122a57d4_1c1b_4c5f_91f5_b945bb8e5f51.slice/crio-b51346f413d3f2b6967454b1e4c59c700e48caa020456f1ffe6c620c9ccd4b23 WatchSource:0}: Error finding container b51346f413d3f2b6967454b1e4c59c700e48caa020456f1ffe6c620c9ccd4b23: Status 404 returned error can't find the container with id b51346f413d3f2b6967454b1e4c59c700e48caa020456f1ffe6c620c9ccd4b23 Jun 05 13:05:04.152355 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:04.152319 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588cb6756-kfj87" event={"ID":"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51","Type":"ContainerStarted","Data":"1485678b9a7b7b3e630650210811b36a00af1a540296bf7666397c96f136d7ee"} Jun 05 13:05:04.152738 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:04.152373 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588cb6756-kfj87" event={"ID":"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51","Type":"ContainerStarted","Data":"b51346f413d3f2b6967454b1e4c59c700e48caa020456f1ffe6c620c9ccd4b23"} Jun 05 13:05:04.152738 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:04.152396 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:04.169752 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:04.169704 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-588cb6756-kfj87" podStartSLOduration=2.169688149 podStartE2EDuration="2.169688149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:05:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:04.16921564 +0000 UTC m=+243.265125030" watchObservedRunningTime="2026-06-05 13:05:04.169688149 +0000 UTC m=+243.265597537" Jun 05 13:05:06.635710 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:06.635672 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" podUID="696566cb-f851-4f93-95c4-0d2d187392d6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 13:05:12.206543 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:12.206501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:05:12.208774 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:12.208753 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38a40729-4f6c-462e-a7a2-476b713066c6-metrics-certs\") pod \"network-metrics-daemon-d8pvr\" (UID: \"38a40729-4f6c-462e-a7a2-476b713066c6\") " pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:05:12.278366 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:12.278333 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v8nr\"" Jun 05 13:05:12.286348 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:12.286324 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8pvr" Jun 05 13:05:12.406971 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:12.406940 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d8pvr"] Jun 05 13:05:13.180448 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:13.180408 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d8pvr" event={"ID":"38a40729-4f6c-462e-a7a2-476b713066c6","Type":"ContainerStarted","Data":"7de9adaa376b9f1fd86dfb39e856c0b2223ad78a77473a745d6daa407bc2260b"} Jun 05 13:05:14.184794 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:14.184757 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d8pvr" event={"ID":"38a40729-4f6c-462e-a7a2-476b713066c6","Type":"ContainerStarted","Data":"8ef6eb86c73765f39df03e1a95113fdf754339e8eb30a4c00d6b09744f11b76d"} Jun 05 13:05:14.185277 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:14.184851 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d8pvr" event={"ID":"38a40729-4f6c-462e-a7a2-476b713066c6","Type":"ContainerStarted","Data":"6081331986b6310bf1d9e3e490a5495f8cd717ebbfb4e8f944d7f870b7c1af00"} Jun 05 13:05:14.200039 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:14.199989 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d8pvr" podStartSLOduration=252.353851055 podStartE2EDuration="4m13.19997488s" totalImagesPullingTime="846.123825ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:14.199315023 +0000 UTC m=+253.295224404" watchObservedRunningTime="2026-06-05 13:05:14.19997488 +0000 UTC m=+253.295884269" Jun 05 13:05:16.636202 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:16.636166 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" podUID="696566cb-f851-4f93-95c4-0d2d187392d6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 13:05:16.636594 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:16.636232 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" Jun 05 13:05:16.636771 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:16.636734 2567 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"2ad7f766b7175b35a513526f0309bef1e8991d054f141bae181957db28bd4c43"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 05 13:05:16.636821 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:16.636807 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" podUID="696566cb-f851-4f93-95c4-0d2d187392d6" containerName="service-proxy" containerID="cri-o://2ad7f766b7175b35a513526f0309bef1e8991d054f141bae181957db28bd4c43" gracePeriod=30 Jun 05 13:05:17.195981 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:17.195948 2567 generic.go:356] "Generic (PLEG): container finished" podID="696566cb-f851-4f93-95c4-0d2d187392d6" containerID="2ad7f766b7175b35a513526f0309bef1e8991d054f141bae181957db28bd4c43" exitCode=2 Jun 05 13:05:17.196152 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:17.196001 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" event={"ID":"696566cb-f851-4f93-95c4-0d2d187392d6","Type":"ContainerDied","Data":"2ad7f766b7175b35a513526f0309bef1e8991d054f141bae181957db28bd4c43"} Jun 05 13:05:17.196152 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:17.196033 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd44cd74-vlzpk" event={"ID":"696566cb-f851-4f93-95c4-0d2d187392d6","Type":"ContainerStarted","Data":"f0797242df7167f7c0c44997a731d2966464e0670e9134007259d37df79a0b24"} Jun 05 13:05:18.909198 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.909163 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n9mh2"] Jun 05 13:05:18.911359 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.911344 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:18.913453 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.913430 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 13:05:18.913586 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.913565 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 13:05:18.913848 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.913832 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 13:05:18.914627 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.914614 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 13:05:18.914627 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.914624 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 13:05:18.914751 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.914634 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 13:05:18.914751 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.914668 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vwt48\"" Jun 05 13:05:18.951162 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.951123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:18.951366 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.951192 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-wtmp\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:18.951366 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.951229 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddaa23f4-288a-49c4-8205-a74f2abfe255-sys\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:18.951366 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.951244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-tls\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:18.951366 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.951264 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:18.951366 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.951283 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddaa23f4-288a-49c4-8205-a74f2abfe255-root\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:18.951366 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.951327 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkgt6\" (UniqueName: \"kubernetes.io/projected/ddaa23f4-288a-49c4-8205-a74f2abfe255-kube-api-access-mkgt6\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:18.951366 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.951343 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-textfile\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:18.951366 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:18.951360 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddaa23f4-288a-49c4-8205-a74f2abfe255-metrics-client-ca\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.052572 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.052531 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.052572 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.052571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddaa23f4-288a-49c4-8205-a74f2abfe255-root\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.052765 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.052602 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkgt6\" (UniqueName: \"kubernetes.io/projected/ddaa23f4-288a-49c4-8205-a74f2abfe255-kube-api-access-mkgt6\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.052765 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.052630 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-textfile\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.052765 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.052655 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddaa23f4-288a-49c4-8205-a74f2abfe255-metrics-client-ca\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.052765 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.052659 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddaa23f4-288a-49c4-8205-a74f2abfe255-root\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.052765 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.052687 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.052765 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.052754 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-wtmp\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.053020 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.052788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddaa23f4-288a-49c4-8205-a74f2abfe255-sys\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.053020 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.052844 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddaa23f4-288a-49c4-8205-a74f2abfe255-sys\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.053020 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.052913 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-tls\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.053020 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.052937 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-wtmp\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.053140 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:05:19.053021 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 05 13:05:19.053140 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.053045 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-textfile\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.053140 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:05:19.053095 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-tls podName:ddaa23f4-288a-49c4-8205-a74f2abfe255 nodeName:}" failed. No retries permitted until 2026-06-05 13:05:19.553075943 +0000 UTC m=+258.648985310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-tls") pod "node-exporter-n9mh2" (UID: "ddaa23f4-288a-49c4-8205-a74f2abfe255") : secret "node-exporter-tls" not found Jun 05 13:05:19.053237 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.053177 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.053270 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.053239 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddaa23f4-288a-49c4-8205-a74f2abfe255-metrics-client-ca\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.055191 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.055166 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.063017 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.062999 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkgt6\" (UniqueName: \"kubernetes.io/projected/ddaa23f4-288a-49c4-8205-a74f2abfe255-kube-api-access-mkgt6\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.556174 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.556142 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-tls\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.558342 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.558318 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddaa23f4-288a-49c4-8205-a74f2abfe255-node-exporter-tls\") pod \"node-exporter-n9mh2\" (UID: \"ddaa23f4-288a-49c4-8205-a74f2abfe255\") " pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.820829 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:19.820756 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n9mh2" Jun 05 13:05:19.830042 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:05:19.830017 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddaa23f4_288a_49c4_8205_a74f2abfe255.slice/crio-ed52cb97ec91d99116dce37bcba82f0633e0f3075683144f69184b606c309ffe WatchSource:0}: Error finding container ed52cb97ec91d99116dce37bcba82f0633e0f3075683144f69184b606c309ffe: Status 404 returned error can't find the container with id ed52cb97ec91d99116dce37bcba82f0633e0f3075683144f69184b606c309ffe Jun 05 13:05:20.205194 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:20.205158 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9mh2" event={"ID":"ddaa23f4-288a-49c4-8205-a74f2abfe255","Type":"ContainerStarted","Data":"ed52cb97ec91d99116dce37bcba82f0633e0f3075683144f69184b606c309ffe"} Jun 05 13:05:21.209276 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:21.209244 2567 generic.go:356] "Generic (PLEG): container finished" podID="ddaa23f4-288a-49c4-8205-a74f2abfe255" containerID="a1949d2ab8b20b0aaa947950ba290739b9603e4a4addb12f775229f74faab9b2" exitCode=0 Jun 05 13:05:21.209667 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:21.209335 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9mh2" event={"ID":"ddaa23f4-288a-49c4-8205-a74f2abfe255","Type":"ContainerDied","Data":"a1949d2ab8b20b0aaa947950ba290739b9603e4a4addb12f775229f74faab9b2"} Jun 05 13:05:22.214885 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:22.214847 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9mh2" event={"ID":"ddaa23f4-288a-49c4-8205-a74f2abfe255","Type":"ContainerStarted","Data":"ad5f25461a354d653b0e017534946742bb9b63c7a92763e96b9aac2bd446db68"} Jun 05 13:05:22.215290 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:22.214907 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9mh2" event={"ID":"ddaa23f4-288a-49c4-8205-a74f2abfe255","Type":"ContainerStarted","Data":"35bd1c5ed686190d17716d6e75bdf62a1f0db09d93a51ace4d96966f8c8b292a"} Jun 05 13:05:22.237793 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:22.237733 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n9mh2" podStartSLOduration=3.3510789020000002 podStartE2EDuration="4.237695216s" totalImagesPullingTime="822.849152ms" totalInitContainerRuntime="63.767162ms" isStatefulPod=true podCreationTimestamp="2026-06-05 13:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:22.237552927 +0000 UTC m=+261.333462315" watchObservedRunningTime="2026-06-05 13:05:22.237695216 +0000 UTC m=+261.333604605" Jun 05 13:05:23.088683 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.088650 2567 patch_prober.go:28] interesting pod/image-registry-588cb6756-kfj87 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:05:23.088830 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.088707 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588cb6756-kfj87" podUID="122a57d4-1c1b-4c5f-91f5-b945bb8e5f51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:05:23.302640 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.302608 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78bc44565c-j8gnp"] Jun 05 13:05:23.304611 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.304595 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.306897 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.306864 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 05 13:05:23.307029 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.306965 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 13:05:23.307093 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.307065 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 05 13:05:23.307755 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.307738 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6mmqau38lc4p4\"" Jun 05 13:05:23.307857 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.307788 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-l7rp2\"" Jun 05 13:05:23.307994 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.307979 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 05 13:05:23.314411 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.314386 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78bc44565c-j8gnp"] Jun 05 13:05:23.381441 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.381406 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0f9a4fe0-df93-467f-a561-19d833dfe9f4-secret-metrics-server-client-certs\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.381441 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.381443 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0f9a4fe0-df93-467f-a561-19d833dfe9f4-secret-metrics-server-tls\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.381639 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.381467 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0f9a4fe0-df93-467f-a561-19d833dfe9f4-audit-log\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.381639 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.381521 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f9a4fe0-df93-467f-a561-19d833dfe9f4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.381639 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.381567 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f9a4fe0-df93-467f-a561-19d833dfe9f4-client-ca-bundle\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.381639 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.381611 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0f9a4fe0-df93-467f-a561-19d833dfe9f4-metrics-server-audit-profiles\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.381761 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.381674 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78lnt\" (UniqueName: \"kubernetes.io/projected/0f9a4fe0-df93-467f-a561-19d833dfe9f4-kube-api-access-78lnt\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.482738 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.482697 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0f9a4fe0-df93-467f-a561-19d833dfe9f4-metrics-server-audit-profiles\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.482738 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.482744 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78lnt\" (UniqueName: \"kubernetes.io/projected/0f9a4fe0-df93-467f-a561-19d833dfe9f4-kube-api-access-78lnt\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.482972 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.482781 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0f9a4fe0-df93-467f-a561-19d833dfe9f4-secret-metrics-server-client-certs\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.482972 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.482810 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0f9a4fe0-df93-467f-a561-19d833dfe9f4-secret-metrics-server-tls\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.482972 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.482832 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0f9a4fe0-df93-467f-a561-19d833dfe9f4-audit-log\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.482972 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.482857 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f9a4fe0-df93-467f-a561-19d833dfe9f4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.482972 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.482900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f9a4fe0-df93-467f-a561-19d833dfe9f4-client-ca-bundle\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.483382 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.483353 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0f9a4fe0-df93-467f-a561-19d833dfe9f4-audit-log\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.483580 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.483551 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f9a4fe0-df93-467f-a561-19d833dfe9f4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.483754 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.483736 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0f9a4fe0-df93-467f-a561-19d833dfe9f4-metrics-server-audit-profiles\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.485269 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.485247 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f9a4fe0-df93-467f-a561-19d833dfe9f4-client-ca-bundle\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.485754 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.485731 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0f9a4fe0-df93-467f-a561-19d833dfe9f4-secret-metrics-server-tls\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.485821 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.485757 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0f9a4fe0-df93-467f-a561-19d833dfe9f4-secret-metrics-server-client-certs\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.491740 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.491720 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78lnt\" (UniqueName: \"kubernetes.io/projected/0f9a4fe0-df93-467f-a561-19d833dfe9f4-kube-api-access-78lnt\") pod \"metrics-server-78bc44565c-j8gnp\" (UID: \"0f9a4fe0-df93-467f-a561-19d833dfe9f4\") " pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.614192 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.614157 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:23.744598 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:23.744564 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78bc44565c-j8gnp"] Jun 05 13:05:23.747659 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:05:23.747634 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9a4fe0_df93_467f_a561_19d833dfe9f4.slice/crio-f2441974dcc2ff16dbc6b87360dc894fd787326e219a087108dbefb2a11ddda2 WatchSource:0}: Error finding container f2441974dcc2ff16dbc6b87360dc894fd787326e219a087108dbefb2a11ddda2: Status 404 returned error can't find the container with id f2441974dcc2ff16dbc6b87360dc894fd787326e219a087108dbefb2a11ddda2 Jun 05 13:05:24.223087 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:24.223045 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" event={"ID":"0f9a4fe0-df93-467f-a561-19d833dfe9f4","Type":"ContainerStarted","Data":"f2441974dcc2ff16dbc6b87360dc894fd787326e219a087108dbefb2a11ddda2"} Jun 05 13:05:25.160363 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:25.160329 2567 patch_prober.go:28] interesting pod/image-registry-588cb6756-kfj87 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:05:25.160712 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:25.160385 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588cb6756-kfj87" podUID="122a57d4-1c1b-4c5f-91f5-b945bb8e5f51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:05:25.228249 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:25.228211 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" event={"ID":"0f9a4fe0-df93-467f-a561-19d833dfe9f4","Type":"ContainerStarted","Data":"7d18465cc185e0d8b7312b5f7dd270f4d8b272cbacd68dd78d235c07efc0c92a"} Jun 05 13:05:25.244543 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:25.244488 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" podStartSLOduration=0.971299671 podStartE2EDuration="2.244467562s" totalImagesPullingTime="1.273167891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:25.243527489 +0000 UTC m=+264.339436878" watchObservedRunningTime="2026-06-05 13:05:25.244467562 +0000 UTC m=+264.340376952" Jun 05 13:05:33.088783 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:33.088749 2567 patch_prober.go:28] interesting pod/image-registry-588cb6756-kfj87 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:05:33.089211 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:33.088804 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588cb6756-kfj87" podUID="122a57d4-1c1b-4c5f-91f5-b945bb8e5f51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:05:35.159085 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:35.159055 2567 patch_prober.go:28] interesting pod/image-registry-588cb6756-kfj87 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:05:35.159477 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:35.159103 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588cb6756-kfj87" podUID="122a57d4-1c1b-4c5f-91f5-b945bb8e5f51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:05:42.904315 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:05:42.904253 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gjjrg" podUID="66185e84-4ad4-4cc9-ba1f-7aeee8766740" Jun 05 13:05:43.089313 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:43.089269 2567 patch_prober.go:28] interesting pod/image-registry-588cb6756-kfj87 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:05:43.089458 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:43.089350 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588cb6756-kfj87" podUID="122a57d4-1c1b-4c5f-91f5-b945bb8e5f51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:05:43.089458 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:43.089388 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:05:43.089805 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:43.089790 2567 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"1485678b9a7b7b3e630650210811b36a00af1a540296bf7666397c96f136d7ee"} pod="openshift-image-registry/image-registry-588cb6756-kfj87" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 13:05:43.093269 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:43.093243 2567 patch_prober.go:28] interesting pod/image-registry-588cb6756-kfj87 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:05:43.093417 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:43.093315 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588cb6756-kfj87" podUID="122a57d4-1c1b-4c5f-91f5-b945bb8e5f51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:05:43.285450 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:43.285372 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gjjrg" Jun 05 13:05:43.614936 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:43.614829 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:43.614936 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:43.614911 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:05:46.252970 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:46.252924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:05:46.255176 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:46.255149 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66185e84-4ad4-4cc9-ba1f-7aeee8766740-metrics-tls\") pod \"dns-default-gjjrg\" (UID: \"66185e84-4ad4-4cc9-ba1f-7aeee8766740\") " pod="openshift-dns/dns-default-gjjrg" Jun 05 13:05:46.288522 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:46.288493 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ncksb\"" Jun 05 13:05:46.296241 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:46.296215 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gjjrg" Jun 05 13:05:46.453431 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:46.453397 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gjjrg"] Jun 05 13:05:46.457234 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:05:46.457207 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66185e84_4ad4_4cc9_ba1f_7aeee8766740.slice/crio-188d3fbaeffc42ddf2aa00c88d640678b3cce483bece272dddd68cb7a7dc7911 WatchSource:0}: Error finding container 188d3fbaeffc42ddf2aa00c88d640678b3cce483bece272dddd68cb7a7dc7911: Status 404 returned error can't find the container with id 188d3fbaeffc42ddf2aa00c88d640678b3cce483bece272dddd68cb7a7dc7911 Jun 05 13:05:47.299158 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:47.299125 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gjjrg" event={"ID":"66185e84-4ad4-4cc9-ba1f-7aeee8766740","Type":"ContainerStarted","Data":"188d3fbaeffc42ddf2aa00c88d640678b3cce483bece272dddd68cb7a7dc7911"} Jun 05 13:05:48.304922 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:48.304894 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gjjrg" event={"ID":"66185e84-4ad4-4cc9-ba1f-7aeee8766740","Type":"ContainerStarted","Data":"237bf17a49b415e5a89a30272418abdaa9df212e5f848b687e0e6b17a0bda814"} Jun 05 13:05:48.305190 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:48.304973 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gjjrg" event={"ID":"66185e84-4ad4-4cc9-ba1f-7aeee8766740","Type":"ContainerStarted","Data":"367efa57a7e5e41e5a23fcb8078845000470ed219d7981ed4b91347075aa0f25"} Jun 05 13:05:49.308658 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:49.308628 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gjjrg" Jun 05 13:05:49.325799 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:49.325614 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gjjrg" podStartSLOduration=251.648629176 podStartE2EDuration="4m13.325595493s" totalImagesPullingTime="1.676966317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:05:49.324865153 +0000 UTC m=+288.420774554" watchObservedRunningTime="2026-06-05 13:05:49.325595493 +0000 UTC m=+288.421504884" Jun 05 13:05:53.094152 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:53.094120 2567 patch_prober.go:28] interesting pod/image-registry-588cb6756-kfj87 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:05:53.094538 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:53.094170 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588cb6756-kfj87" podUID="122a57d4-1c1b-4c5f-91f5-b945bb8e5f51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:05:59.314334 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:05:59.314285 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gjjrg" Jun 05 13:06:01.326124 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:01.326098 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-57l6g_d5bf6331-1821-4fe3-b7ea-65575785f4ec/ovn-acl-logging/0.log" Jun 05 13:06:01.328732 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:01.328710 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 13:06:01.332151 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:01.332132 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-57l6g_d5bf6331-1821-4fe3-b7ea-65575785f4ec/ovn-acl-logging/0.log" Jun 05 13:06:02.348535 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:02.348455 2567 generic.go:356] "Generic (PLEG): container finished" podID="b61e481f-a940-4be0-92d2-b9a923337f36" containerID="fe27f6326d540c8ae2f4c02a99726a1cb37a0669b4ed99637e63a4d89f2c6a92" exitCode=255 Jun 05 13:06:02.348535 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:02.348515 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" event={"ID":"b61e481f-a940-4be0-92d2-b9a923337f36","Type":"ContainerDied","Data":"fe27f6326d540c8ae2f4c02a99726a1cb37a0669b4ed99637e63a4d89f2c6a92"} Jun 05 13:06:02.349005 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:02.348551 2567 scope.go:117] "RemoveContainer" containerID="495d6929c8a4057a7f8babc2ba41ccd020a767b963a5602889a04e3bc3889f2c" Jun 05 13:06:02.349005 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:02.348843 2567 scope.go:117] "RemoveContainer" containerID="fe27f6326d540c8ae2f4c02a99726a1cb37a0669b4ed99637e63a4d89f2c6a92" Jun 05 13:06:02.349098 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:06:02.349022 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-66858d6b4b-c8bw9_open-cluster-management-agent-addon(b61e481f-a940-4be0-92d2-b9a923337f36)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" podUID="b61e481f-a940-4be0-92d2-b9a923337f36" Jun 05 13:06:03.093599 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:03.093567 2567 patch_prober.go:28] interesting pod/image-registry-588cb6756-kfj87 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:06:03.093763 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:03.093630 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588cb6756-kfj87" podUID="122a57d4-1c1b-4c5f-91f5-b945bb8e5f51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:06:03.620339 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:03.620310 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:06:03.624114 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:03.624092 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78bc44565c-j8gnp" Jun 05 13:06:06.627781 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:06.627749 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" Jun 05 13:06:06.628243 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:06.628094 2567 scope.go:117] "RemoveContainer" containerID="fe27f6326d540c8ae2f4c02a99726a1cb37a0669b4ed99637e63a4d89f2c6a92" Jun 05 13:06:06.628288 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:06:06.628244 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-66858d6b4b-c8bw9_open-cluster-management-agent-addon(b61e481f-a940-4be0-92d2-b9a923337f36)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" podUID="b61e481f-a940-4be0-92d2-b9a923337f36" Jun 05 13:06:08.108459 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:08.108417 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-588cb6756-kfj87" podUID="122a57d4-1c1b-4c5f-91f5-b945bb8e5f51" containerName="registry" containerID="cri-o://1485678b9a7b7b3e630650210811b36a00af1a540296bf7666397c96f136d7ee" gracePeriod=30 Jun 05 13:06:09.376681 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:09.376645 2567 generic.go:356] "Generic (PLEG): container finished" podID="122a57d4-1c1b-4c5f-91f5-b945bb8e5f51" containerID="1485678b9a7b7b3e630650210811b36a00af1a540296bf7666397c96f136d7ee" exitCode=0 Jun 05 13:06:09.379471 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:09.379447 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588cb6756-kfj87" event={"ID":"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51","Type":"ContainerDied","Data":"1485678b9a7b7b3e630650210811b36a00af1a540296bf7666397c96f136d7ee"} Jun 05 13:06:09.379607 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:09.379494 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588cb6756-kfj87" event={"ID":"122a57d4-1c1b-4c5f-91f5-b945bb8e5f51","Type":"ContainerStarted","Data":"4dbde6cccd45104aa02d717b69793b7cbdd9d28ff7624d5bde88f018d8d6d513"} Jun 05 13:06:09.379686 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:09.379669 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:06:19.375848 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:19.375816 2567 scope.go:117] "RemoveContainer" containerID="fe27f6326d540c8ae2f4c02a99726a1cb37a0669b4ed99637e63a4d89f2c6a92" Jun 05 13:06:20.411493 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:20.411458 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66858d6b4b-c8bw9" event={"ID":"b61e481f-a940-4be0-92d2-b9a923337f36","Type":"ContainerStarted","Data":"6eefb2153c5e6d24c0817cc682e7bceaa8e125a78bc9ed7f8f23398ce1765bb7"} Jun 05 13:06:30.384759 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:06:30.384731 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-588cb6756-kfj87" Jun 05 13:09:56.448942 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.448866 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd"] Jun 05 13:09:56.451155 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.451140 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.476337 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.476311 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hk5v6\"" Jun 05 13:09:56.476459 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.476430 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 13:09:56.476770 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.476756 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 13:09:56.476843 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.476825 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 13:09:56.479742 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.479724 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 13:09:56.624720 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.624685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rqd4\" (UniqueName: \"kubernetes.io/projected/4cd88427-d8b7-4306-926b-e937c35d1d22-kube-api-access-5rqd4\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.624881 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.624731 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4cd88427-d8b7-4306-926b-e937c35d1d22-manifests\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.624881 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.624753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4cd88427-d8b7-4306-926b-e937c35d1d22-apiservice-cert\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.624881 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.624840 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cd88427-d8b7-4306-926b-e937c35d1d22-tmp\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.625032 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.624882 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cd88427-d8b7-4306-926b-e937c35d1d22-webhook-cert\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.667246 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.667208 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd"] Jun 05 13:09:56.725541 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.725468 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4cd88427-d8b7-4306-926b-e937c35d1d22-manifests\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.725541 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.725497 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4cd88427-d8b7-4306-926b-e937c35d1d22-apiservice-cert\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.725541 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.725537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cd88427-d8b7-4306-926b-e937c35d1d22-tmp\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.725752 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.725565 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cd88427-d8b7-4306-926b-e937c35d1d22-webhook-cert\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.725752 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.725590 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rqd4\" (UniqueName: \"kubernetes.io/projected/4cd88427-d8b7-4306-926b-e937c35d1d22-kube-api-access-5rqd4\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.725947 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.725921 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4cd88427-d8b7-4306-926b-e937c35d1d22-manifests\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.727869 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.727835 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cd88427-d8b7-4306-926b-e937c35d1d22-tmp\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.728022 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.728004 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4cd88427-d8b7-4306-926b-e937c35d1d22-apiservice-cert\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.728081 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.728048 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cd88427-d8b7-4306-926b-e937c35d1d22-webhook-cert\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.739706 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.739687 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rqd4\" (UniqueName: \"kubernetes.io/projected/4cd88427-d8b7-4306-926b-e937c35d1d22-kube-api-access-5rqd4\") pod \"opendatahub-operator-controller-manager-785744655b-v4wnd\" (UID: \"4cd88427-d8b7-4306-926b-e937c35d1d22\") " pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.760264 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.760238 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:09:56.930409 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.930377 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd"] Jun 05 13:09:56.935772 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:09:56.935738 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd88427_d8b7_4306_926b_e937c35d1d22.slice/crio-f2b9e45949f239b53bcb454e491e0a1505bcf8a3bbba1a8319accc3bb35fdc0f WatchSource:0}: Error finding container f2b9e45949f239b53bcb454e491e0a1505bcf8a3bbba1a8319accc3bb35fdc0f: Status 404 returned error can't find the container with id f2b9e45949f239b53bcb454e491e0a1505bcf8a3bbba1a8319accc3bb35fdc0f Jun 05 13:09:56.937399 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:56.937383 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:09:57.112961 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:09:57.112868 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" event={"ID":"4cd88427-d8b7-4306-926b-e937c35d1d22","Type":"ContainerStarted","Data":"f2b9e45949f239b53bcb454e491e0a1505bcf8a3bbba1a8319accc3bb35fdc0f"} Jun 05 13:10:00.126196 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:00.126114 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" event={"ID":"4cd88427-d8b7-4306-926b-e937c35d1d22","Type":"ContainerStarted","Data":"29ba6a16969942d91e2eecc524a0ff0968d23967ca092287caddc04ae3c3c889"} Jun 05 13:10:01.130804 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:01.130767 2567 generic.go:356] "Generic (PLEG): container finished" podID="4cd88427-d8b7-4306-926b-e937c35d1d22" containerID="29ba6a16969942d91e2eecc524a0ff0968d23967ca092287caddc04ae3c3c889" exitCode=0 Jun 05 13:10:01.131144 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:01.130853 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" event={"ID":"4cd88427-d8b7-4306-926b-e937c35d1d22","Type":"ContainerDied","Data":"29ba6a16969942d91e2eecc524a0ff0968d23967ca092287caddc04ae3c3c889"} Jun 05 13:10:02.135563 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:02.135502 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" event={"ID":"4cd88427-d8b7-4306-926b-e937c35d1d22","Type":"ContainerStarted","Data":"6fddf5cfbc128ac9a8f4fab081139769190a6bede9bbdcdcb330fbf2eae2b8d5"} Jun 05 13:10:02.135935 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:02.135613 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:10:02.222841 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:02.222770 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" podStartSLOduration=2.227090951 podStartE2EDuration="6.222749953s" totalImagesPullingTime="3.057991585s" totalInitContainerRuntime="937.667417ms" isStatefulPod=false podCreationTimestamp="2026-06-05 13:09:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:02.221090798 +0000 UTC m=+541.317000215" watchObservedRunningTime="2026-06-05 13:10:02.222749953 +0000 UTC m=+541.318659345" Jun 05 13:10:13.141139 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:13.141107 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-785744655b-v4wnd" Jun 05 13:10:17.210936 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:17.210900 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p"] Jun 05 13:10:17.220217 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:17.220194 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:17.241042 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:10:17.241005 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"lws-controller-manager-d64dc6f78-zgd8p\" is forbidden: User \"system:node:ip-10-0-129-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-41.ec2.internal' and this object" podUID="caf35fc6-4865-4bd6-9694-737f993bd8f2" pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:17.241042 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:10:17.241012 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"metrics-server-cert\" is forbidden: User \"system:node:ip-10-0-129-41.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret" Jun 05 13:10:17.242040 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:10:17.242010 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"lws-manager-config\" is forbidden: User \"system:node:ip-10-0-129-41.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" type="*v1.ConfigMap" Jun 05 13:10:17.242409 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:10:17.242391 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-41.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 05 13:10:17.242876 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:10:17.242853 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-129-41.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret" Jun 05 13:10:17.242876 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:10:17.242856 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"lws-controller-manager-dockercfg-l6m4x\" is forbidden: User \"system:node:ip-10-0-129-41.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-l6m4x\"" type="*v1.Secret" Jun 05 13:10:17.242989 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:10:17.242938 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-41.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-41.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 05 13:10:17.275342 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:17.275305 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p"] Jun 05 13:10:17.275853 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:17.275830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmtd7\" (UniqueName: \"kubernetes.io/projected/caf35fc6-4865-4bd6-9694-737f993bd8f2-kube-api-access-rmtd7\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:17.275955 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:17.275866 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/caf35fc6-4865-4bd6-9694-737f993bd8f2-manager-config\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:17.275955 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:17.275935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caf35fc6-4865-4bd6-9694-737f993bd8f2-cert\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:17.276051 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:17.275965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/caf35fc6-4865-4bd6-9694-737f993bd8f2-metrics-cert\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:17.376952 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:17.376905 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caf35fc6-4865-4bd6-9694-737f993bd8f2-cert\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:17.376952 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:17.376953 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/caf35fc6-4865-4bd6-9694-737f993bd8f2-metrics-cert\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:17.377173 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:17.377021 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmtd7\" (UniqueName: \"kubernetes.io/projected/caf35fc6-4865-4bd6-9694-737f993bd8f2-kube-api-access-rmtd7\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:17.377173 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:17.377054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/caf35fc6-4865-4bd6-9694-737f993bd8f2-manager-config\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:18.130165 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:18.130121 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 05 13:10:18.138720 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:18.138697 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/caf35fc6-4865-4bd6-9694-737f993bd8f2-manager-config\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:18.207616 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:18.207582 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 05 13:10:18.219954 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:18.219923 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caf35fc6-4865-4bd6-9694-737f993bd8f2-cert\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:18.352968 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:18.352938 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:10:18.377964 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:10:18.377940 2567 secret.go:189] Couldn't get secret openshift-lws-operator/metrics-server-cert: failed to sync secret cache: timed out waiting for the condition Jun 05 13:10:18.378129 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:10:18.378020 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf35fc6-4865-4bd6-9694-737f993bd8f2-metrics-cert podName:caf35fc6-4865-4bd6-9694-737f993bd8f2 nodeName:}" failed. No retries permitted until 2026-06-05 13:10:18.878003645 +0000 UTC m=+557.973913013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-cert" (UniqueName: "kubernetes.io/secret/caf35fc6-4865-4bd6-9694-737f993bd8f2-metrics-cert") pod "lws-controller-manager-d64dc6f78-zgd8p" (UID: "caf35fc6-4865-4bd6-9694-737f993bd8f2") : failed to sync secret cache: timed out waiting for the condition Jun 05 13:10:18.450737 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:10:18.450661 2567 projected.go:291] Couldn't get configMap openshift-lws-operator/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 05 13:10:18.450737 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:10:18.450708 2567 projected.go:196] Error preparing data for projected volume kube-api-access-rmtd7 for pod openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p: failed to sync configmap cache: timed out waiting for the condition Jun 05 13:10:18.450898 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:10:18.450768 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caf35fc6-4865-4bd6-9694-737f993bd8f2-kube-api-access-rmtd7 podName:caf35fc6-4865-4bd6-9694-737f993bd8f2 nodeName:}" failed. No retries permitted until 2026-06-05 13:10:18.950749589 +0000 UTC m=+558.046658979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rmtd7" (UniqueName: "kubernetes.io/projected/caf35fc6-4865-4bd6-9694-737f993bd8f2-kube-api-access-rmtd7") pod "lws-controller-manager-d64dc6f78-zgd8p" (UID: "caf35fc6-4865-4bd6-9694-737f993bd8f2") : failed to sync configmap cache: timed out waiting for the condition Jun 05 13:10:18.577958 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:18.577927 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 13:10:18.607858 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:18.607822 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 05 13:10:18.832774 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:18.832686 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-l6m4x\"" Jun 05 13:10:18.890032 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:18.889986 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/caf35fc6-4865-4bd6-9694-737f993bd8f2-metrics-cert\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:18.892615 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:18.892578 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/caf35fc6-4865-4bd6-9694-737f993bd8f2-metrics-cert\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:18.990548 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:18.990508 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmtd7\" (UniqueName: \"kubernetes.io/projected/caf35fc6-4865-4bd6-9694-737f993bd8f2-kube-api-access-rmtd7\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:18.993343 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:18.993292 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmtd7\" (UniqueName: \"kubernetes.io/projected/caf35fc6-4865-4bd6-9694-737f993bd8f2-kube-api-access-rmtd7\") pod \"lws-controller-manager-d64dc6f78-zgd8p\" (UID: \"caf35fc6-4865-4bd6-9694-737f993bd8f2\") " pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:19.029023 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:19.028979 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:19.177900 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:19.177861 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p"] Jun 05 13:10:19.182083 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:10:19.182050 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf35fc6_4865_4bd6_9694_737f993bd8f2.slice/crio-787a55299bf04068140e3ca3d511859f7669bfb3e0ac6522785aedc320bbd0fb WatchSource:0}: Error finding container 787a55299bf04068140e3ca3d511859f7669bfb3e0ac6522785aedc320bbd0fb: Status 404 returned error can't find the container with id 787a55299bf04068140e3ca3d511859f7669bfb3e0ac6522785aedc320bbd0fb Jun 05 13:10:19.193233 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:19.193194 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" event={"ID":"caf35fc6-4865-4bd6-9694-737f993bd8f2","Type":"ContainerStarted","Data":"787a55299bf04068140e3ca3d511859f7669bfb3e0ac6522785aedc320bbd0fb"} Jun 05 13:10:22.207383 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:22.207345 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" event={"ID":"caf35fc6-4865-4bd6-9694-737f993bd8f2","Type":"ContainerStarted","Data":"0db0a9b8ed0a1b43663897a09ab3c3d0f4fe523a8ef3041bf10b44778917a5cd"} Jun 05 13:10:22.207874 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:22.207423 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:22.329815 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:22.329749 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" podStartSLOduration=3.754654815 podStartE2EDuration="6.329727155s" totalImagesPullingTime="2.57507234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:22.328351168 +0000 UTC m=+561.424260557" watchObservedRunningTime="2026-06-05 13:10:22.329727155 +0000 UTC m=+561.425636545" Jun 05 13:10:33.213726 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:33.213697 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d64dc6f78-zgd8p" Jun 05 13:10:54.252862 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:54.252831 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-69fcb86bc6-4dxm7"] Jun 05 13:10:54.254872 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:54.254851 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-69fcb86bc6-4dxm7" Jun 05 13:10:54.265048 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:54.265027 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-p6gwr\"" Jun 05 13:10:54.265193 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:54.265174 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 13:10:54.328350 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:54.328322 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-69fcb86bc6-4dxm7"] Jun 05 13:10:54.364117 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:54.364085 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/486bd983-24bc-4734-b618-c0db5bdb4d5c-redirect-config\") pod \"dashboard-redirect-69fcb86bc6-4dxm7\" (UID: \"486bd983-24bc-4734-b618-c0db5bdb4d5c\") " pod="opendatahub/dashboard-redirect-69fcb86bc6-4dxm7" Jun 05 13:10:54.364317 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:54.364148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8s7z\" (UniqueName: \"kubernetes.io/projected/486bd983-24bc-4734-b618-c0db5bdb4d5c-kube-api-access-g8s7z\") pod \"dashboard-redirect-69fcb86bc6-4dxm7\" (UID: \"486bd983-24bc-4734-b618-c0db5bdb4d5c\") " pod="opendatahub/dashboard-redirect-69fcb86bc6-4dxm7" Jun 05 13:10:54.464770 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:54.464734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/486bd983-24bc-4734-b618-c0db5bdb4d5c-redirect-config\") pod \"dashboard-redirect-69fcb86bc6-4dxm7\" (UID: \"486bd983-24bc-4734-b618-c0db5bdb4d5c\") " pod="opendatahub/dashboard-redirect-69fcb86bc6-4dxm7" Jun 05 13:10:54.464937 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:54.464790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8s7z\" (UniqueName: \"kubernetes.io/projected/486bd983-24bc-4734-b618-c0db5bdb4d5c-kube-api-access-g8s7z\") pod \"dashboard-redirect-69fcb86bc6-4dxm7\" (UID: \"486bd983-24bc-4734-b618-c0db5bdb4d5c\") " pod="opendatahub/dashboard-redirect-69fcb86bc6-4dxm7" Jun 05 13:10:54.465544 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:54.465522 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/486bd983-24bc-4734-b618-c0db5bdb4d5c-redirect-config\") pod \"dashboard-redirect-69fcb86bc6-4dxm7\" (UID: \"486bd983-24bc-4734-b618-c0db5bdb4d5c\") " pod="opendatahub/dashboard-redirect-69fcb86bc6-4dxm7" Jun 05 13:10:54.477721 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:54.477700 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8s7z\" (UniqueName: \"kubernetes.io/projected/486bd983-24bc-4734-b618-c0db5bdb4d5c-kube-api-access-g8s7z\") pod \"dashboard-redirect-69fcb86bc6-4dxm7\" (UID: \"486bd983-24bc-4734-b618-c0db5bdb4d5c\") " pod="opendatahub/dashboard-redirect-69fcb86bc6-4dxm7" Jun 05 13:10:54.566870 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:54.566795 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-69fcb86bc6-4dxm7" Jun 05 13:10:54.708054 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:54.708027 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-69fcb86bc6-4dxm7"] Jun 05 13:10:54.708848 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:10:54.708823 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod486bd983_24bc_4734_b618_c0db5bdb4d5c.slice/crio-ba154a186f4babad7028561cdf3f4ac3025c1aa424754d09820c118265a00e18 WatchSource:0}: Error finding container ba154a186f4babad7028561cdf3f4ac3025c1aa424754d09820c118265a00e18: Status 404 returned error can't find the container with id ba154a186f4babad7028561cdf3f4ac3025c1aa424754d09820c118265a00e18 Jun 05 13:10:55.329714 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:55.329683 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-69fcb86bc6-4dxm7" event={"ID":"486bd983-24bc-4734-b618-c0db5bdb4d5c","Type":"ContainerStarted","Data":"ba154a186f4babad7028561cdf3f4ac3025c1aa424754d09820c118265a00e18"} Jun 05 13:10:57.339146 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:57.339105 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-69fcb86bc6-4dxm7" event={"ID":"486bd983-24bc-4734-b618-c0db5bdb4d5c","Type":"ContainerStarted","Data":"05734fe35e5ec0fac8b655a79478e87a2f49271174081f2929775c0fcd67a4d4"} Jun 05 13:10:57.436352 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:10:57.436279 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-69fcb86bc6-4dxm7" podStartSLOduration=1.299481007 podStartE2EDuration="3.436264863s" totalImagesPullingTime="2.136783856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:10:57.435486204 +0000 UTC m=+596.531395586" watchObservedRunningTime="2026-06-05 13:10:57.436264863 +0000 UTC m=+596.532174251" Jun 05 13:11:01.349446 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:01.349417 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-57l6g_d5bf6331-1821-4fe3-b7ea-65575785f4ec/ovn-acl-logging/0.log" Jun 05 13:11:01.352203 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:01.352182 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-57l6g_d5bf6331-1821-4fe3-b7ea-65575785f4ec/ovn-acl-logging/0.log" Jun 05 13:11:55.918789 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.918745 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs"] Jun 05 13:11:55.921876 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.921861 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:55.925898 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.925876 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 13:11:55.926289 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.926273 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hpsbp\"" Jun 05 13:11:55.937772 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.937751 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 13:11:55.937877 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.937831 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 13:11:55.951997 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.951970 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs"] Jun 05 13:11:55.999333 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.999268 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:55.999333 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.999338 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:55.999669 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.999370 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k74zr\" (UniqueName: \"kubernetes.io/projected/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-kube-api-access-k74zr\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:55.999669 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.999402 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:55.999669 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.999418 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:55.999669 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.999492 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:55.999669 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.999530 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:55.999669 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.999553 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:55.999669 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:55.999581 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.100173 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.100135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.100173 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.100171 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.100408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.100187 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.100408 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.100380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.100502 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.100447 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.100502 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.100469 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.100502 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.100496 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k74zr\" (UniqueName: \"kubernetes.io/projected/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-kube-api-access-k74zr\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.100638 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.100549 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.100638 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.100573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.100778 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.100754 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.100967 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.100942 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.100967 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.100891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.101128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.100947 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.101128 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.101054 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.102604 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.102587 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.102962 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.102942 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.138374 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.138340 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.152353 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.152324 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k74zr\" (UniqueName: \"kubernetes.io/projected/a5fe91c4-5380-4a7b-8e9a-874b3cad5d80-kube-api-access-k74zr\") pod \"data-science-gateway-data-science-gateway-class-74759f9795cw2cs\" (UID: \"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.181578 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.181507 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5"] Jun 05 13:11:56.185820 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.185803 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:11:56.200893 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.200867 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbdzt\" (UniqueName: \"kubernetes.io/projected/0bda33be-e480-475a-aaee-62de0e3cb942-kube-api-access-sbdzt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dq4b5\" (UID: \"0bda33be-e480-475a-aaee-62de0e3cb942\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:11:56.201002 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.200939 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bda33be-e480-475a-aaee-62de0e3cb942-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dq4b5\" (UID: \"0bda33be-e480-475a-aaee-62de0e3cb942\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:11:56.201859 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.201841 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b4rq6\"" Jun 05 13:11:56.203729 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.203713 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 13:11:56.204580 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.204565 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 13:11:56.220116 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.220095 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5"] Jun 05 13:11:56.231948 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.231932 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:11:56.301636 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.301604 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bda33be-e480-475a-aaee-62de0e3cb942-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dq4b5\" (UID: \"0bda33be-e480-475a-aaee-62de0e3cb942\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:11:56.301775 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.301656 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdzt\" (UniqueName: \"kubernetes.io/projected/0bda33be-e480-475a-aaee-62de0e3cb942-kube-api-access-sbdzt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dq4b5\" (UID: \"0bda33be-e480-475a-aaee-62de0e3cb942\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:11:56.301951 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.301932 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bda33be-e480-475a-aaee-62de0e3cb942-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dq4b5\" (UID: \"0bda33be-e480-475a-aaee-62de0e3cb942\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:11:56.319753 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.319725 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbdzt\" (UniqueName: \"kubernetes.io/projected/0bda33be-e480-475a-aaee-62de0e3cb942-kube-api-access-sbdzt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dq4b5\" (UID: \"0bda33be-e480-475a-aaee-62de0e3cb942\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:11:56.433474 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.433396 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs"] Jun 05 13:11:56.437280 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:11:56.437253 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fe91c4_5380_4a7b_8e9a_874b3cad5d80.slice/crio-edf8074cb1bc9cb632a394ff6bb812d6abc79bc21fba847a1b9b9e54c664235c WatchSource:0}: Error finding container edf8074cb1bc9cb632a394ff6bb812d6abc79bc21fba847a1b9b9e54c664235c: Status 404 returned error can't find the container with id edf8074cb1bc9cb632a394ff6bb812d6abc79bc21fba847a1b9b9e54c664235c Jun 05 13:11:56.495917 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.495892 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:11:56.539574 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.539537 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" event={"ID":"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80","Type":"ContainerStarted","Data":"edf8074cb1bc9cb632a394ff6bb812d6abc79bc21fba847a1b9b9e54c664235c"} Jun 05 13:11:56.649099 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.649071 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5"] Jun 05 13:11:56.651932 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:11:56.651909 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bda33be_e480_475a_aaee_62de0e3cb942.slice/crio-6327b11b81c405509c256cda4dfc2ef1e8ed43f798bdec3240619e40bc64c8f3 WatchSource:0}: Error finding container 6327b11b81c405509c256cda4dfc2ef1e8ed43f798bdec3240619e40bc64c8f3: Status 404 returned error can't find the container with id 6327b11b81c405509c256cda4dfc2ef1e8ed43f798bdec3240619e40bc64c8f3 Jun 05 13:11:56.901539 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.901506 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws"] Jun 05 13:11:56.905749 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.905727 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" Jun 05 13:11:56.909394 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.909371 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jfwn4\"" Jun 05 13:11:56.945738 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:56.945704 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws"] Jun 05 13:11:57.008195 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:57.008146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9swbk\" (UniqueName: \"kubernetes.io/projected/84d26b67-900b-4f24-b309-6be06c781d68-kube-api-access-9swbk\") pod \"limitador-operator-controller-manager-859d7b78bd-4btws\" (UID: \"84d26b67-900b-4f24-b309-6be06c781d68\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" Jun 05 13:11:57.108929 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:57.108891 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9swbk\" (UniqueName: \"kubernetes.io/projected/84d26b67-900b-4f24-b309-6be06c781d68-kube-api-access-9swbk\") pod \"limitador-operator-controller-manager-859d7b78bd-4btws\" (UID: \"84d26b67-900b-4f24-b309-6be06c781d68\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" Jun 05 13:11:57.143264 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:57.143228 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9swbk\" (UniqueName: \"kubernetes.io/projected/84d26b67-900b-4f24-b309-6be06c781d68-kube-api-access-9swbk\") pod \"limitador-operator-controller-manager-859d7b78bd-4btws\" (UID: \"84d26b67-900b-4f24-b309-6be06c781d68\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" Jun 05 13:11:57.215896 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:57.215805 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" Jun 05 13:11:57.547547 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:57.547513 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" event={"ID":"0bda33be-e480-475a-aaee-62de0e3cb942","Type":"ContainerStarted","Data":"6327b11b81c405509c256cda4dfc2ef1e8ed43f798bdec3240619e40bc64c8f3"} Jun 05 13:11:57.616600 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:57.616568 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws"] Jun 05 13:11:57.678057 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:11:57.678019 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d26b67_900b_4f24_b309_6be06c781d68.slice/crio-4d057fdaff7831a6e1076786ca245e7b048e08bf58b51521ef32dcb1cc43c0cd WatchSource:0}: Error finding container 4d057fdaff7831a6e1076786ca245e7b048e08bf58b51521ef32dcb1cc43c0cd: Status 404 returned error can't find the container with id 4d057fdaff7831a6e1076786ca245e7b048e08bf58b51521ef32dcb1cc43c0cd Jun 05 13:11:58.553756 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:58.553721 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" event={"ID":"84d26b67-900b-4f24-b309-6be06c781d68","Type":"ContainerStarted","Data":"4d057fdaff7831a6e1076786ca245e7b048e08bf58b51521ef32dcb1cc43c0cd"} Jun 05 13:11:59.352652 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:59.352589 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:11:59.352819 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:59.352697 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:11:59.352819 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:11:59.352744 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:12:00.564689 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:00.564647 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" event={"ID":"84d26b67-900b-4f24-b309-6be06c781d68","Type":"ContainerStarted","Data":"9733fa19afedeb8a88f0624ed84beb4ef50e21f2ffb8de5946d17be4ca2b433b"} Jun 05 13:12:00.565149 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:00.564799 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" Jun 05 13:12:00.566077 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:00.566053 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" event={"ID":"a5fe91c4-5380-4a7b-8e9a-874b3cad5d80","Type":"ContainerStarted","Data":"a16591d2b7377e2c7dbe071aae39803deeb7d7a8af9e10600acb830a3c415219"} Jun 05 13:12:00.611894 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:00.611847 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" podStartSLOduration=1.877537365 podStartE2EDuration="4.611831998s" totalImagesPullingTime="2.734294633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:12:00.601831505 +0000 UTC m=+659.697740893" watchObservedRunningTime="2026-06-05 13:12:00.611831998 +0000 UTC m=+659.707741365" Jun 05 13:12:00.685016 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:00.684910 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" podStartSLOduration=2.771780717 podStartE2EDuration="5.684889378s" totalImagesPullingTime="2.913108661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:12:00.683437419 +0000 UTC m=+659.779346809" watchObservedRunningTime="2026-06-05 13:12:00.684889378 +0000 UTC m=+659.780798767" Jun 05 13:12:01.232738 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:01.232699 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:12:01.237398 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:01.237374 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:12:01.571129 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:01.571024 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:12:01.571979 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:01.571954 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795cw2cs" Jun 05 13:12:03.580918 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:03.580877 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" event={"ID":"0bda33be-e480-475a-aaee-62de0e3cb942","Type":"ContainerStarted","Data":"ac0fdaf2a12d5fdd50035767e57f70ad299b416ea1a79b6543a8a489ec99fdbb"} Jun 05 13:12:03.581351 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:03.581124 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:12:03.639868 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:03.639822 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" podStartSLOduration=1.5640330580000001 podStartE2EDuration="7.639807218s" totalImagesPullingTime="6.07577416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:12:03.636846148 +0000 UTC m=+662.732755550" watchObservedRunningTime="2026-06-05 13:12:03.639807218 +0000 UTC m=+662.735716607" Jun 05 13:12:11.573227 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:11.573196 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" Jun 05 13:12:14.587231 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:14.587205 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:12:17.146707 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.146676 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5"] Jun 05 13:12:17.147165 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.146872 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" podUID="0bda33be-e480-475a-aaee-62de0e3cb942" containerName="manager" containerID="cri-o://ac0fdaf2a12d5fdd50035767e57f70ad299b416ea1a79b6543a8a489ec99fdbb" gracePeriod=2 Jun 05 13:12:17.171050 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.171015 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5"] Jun 05 13:12:17.211863 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.211832 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws"] Jun 05 13:12:17.212077 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.212056 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" podUID="84d26b67-900b-4f24-b309-6be06c781d68" containerName="manager" containerID="cri-o://9733fa19afedeb8a88f0624ed84beb4ef50e21f2ffb8de5946d17be4ca2b433b" gracePeriod=2 Jun 05 13:12:17.216878 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.216855 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws"] Jun 05 13:12:17.250962 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.250937 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7"] Jun 05 13:12:17.251216 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.251201 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bda33be-e480-475a-aaee-62de0e3cb942" containerName="manager" Jun 05 13:12:17.251559 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.251216 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bda33be-e480-475a-aaee-62de0e3cb942" containerName="manager" Jun 05 13:12:17.251559 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.251230 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d26b67-900b-4f24-b309-6be06c781d68" containerName="manager" Jun 05 13:12:17.251559 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.251235 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d26b67-900b-4f24-b309-6be06c781d68" containerName="manager" Jun 05 13:12:17.251559 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.251275 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="84d26b67-900b-4f24-b309-6be06c781d68" containerName="manager" Jun 05 13:12:17.251559 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.251285 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bda33be-e480-475a-aaee-62de0e3cb942" containerName="manager" Jun 05 13:12:17.254402 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.254379 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" Jun 05 13:12:17.256178 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:12:17.256145 2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0bda33be-e480-475a-aaee-62de0e3cb942\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-dq4b5\": pods \"kuadrant-operator-controller-manager-8684c9ff49-dq4b5\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:12:17.320869 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.320804 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7"] Jun 05 13:12:17.321971 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.321949 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnxz4"] Jun 05 13:12:17.326837 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.326414 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnxz4" Jun 05 13:12:17.378826 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.378799 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6affd65d-351c-40d0-a6d1-0a3fc0419c41-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9n6t7\" (UID: \"6affd65d-351c-40d0-a6d1-0a3fc0419c41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" Jun 05 13:12:17.378980 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.378846 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkzds\" (UniqueName: \"kubernetes.io/projected/6affd65d-351c-40d0-a6d1-0a3fc0419c41-kube-api-access-vkzds\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9n6t7\" (UID: \"6affd65d-351c-40d0-a6d1-0a3fc0419c41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" Jun 05 13:12:17.383624 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:12:17.383582 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dq4b5\" is forbidden: User \"system:node:ip-10-0-129-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-41.ec2.internal' and this object" podUID="0bda33be-e480-475a-aaee-62de0e3cb942" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:12:17.388514 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:12:17.388350 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4btws\" is forbidden: User \"system:node:ip-10-0-129-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-41.ec2.internal' and this object" podUID="84d26b67-900b-4f24-b309-6be06c781d68" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" Jun 05 13:12:17.398271 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.398213 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnxz4"] Jun 05 13:12:17.471821 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.471798 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:12:17.474654 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.474635 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" Jun 05 13:12:17.480015 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.479993 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkzds\" (UniqueName: \"kubernetes.io/projected/6affd65d-351c-40d0-a6d1-0a3fc0419c41-kube-api-access-vkzds\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9n6t7\" (UID: \"6affd65d-351c-40d0-a6d1-0a3fc0419c41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" Jun 05 13:12:17.480075 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.480054 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mbng\" (UniqueName: \"kubernetes.io/projected/8794e4c2-f426-47f9-8d01-035d8c7c789f-kube-api-access-8mbng\") pod \"limitador-operator-controller-manager-859d7b78bd-rnxz4\" (UID: \"8794e4c2-f426-47f9-8d01-035d8c7c789f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnxz4" Jun 05 13:12:17.480111 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.480076 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6affd65d-351c-40d0-a6d1-0a3fc0419c41-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9n6t7\" (UID: \"6affd65d-351c-40d0-a6d1-0a3fc0419c41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" Jun 05 13:12:17.480442 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.480427 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6affd65d-351c-40d0-a6d1-0a3fc0419c41-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9n6t7\" (UID: \"6affd65d-351c-40d0-a6d1-0a3fc0419c41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" Jun 05 13:12:17.513754 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.513730 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkzds\" (UniqueName: \"kubernetes.io/projected/6affd65d-351c-40d0-a6d1-0a3fc0419c41-kube-api-access-vkzds\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9n6t7\" (UID: \"6affd65d-351c-40d0-a6d1-0a3fc0419c41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" Jun 05 13:12:17.581404 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.581367 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9swbk\" (UniqueName: \"kubernetes.io/projected/84d26b67-900b-4f24-b309-6be06c781d68-kube-api-access-9swbk\") pod \"84d26b67-900b-4f24-b309-6be06c781d68\" (UID: \"84d26b67-900b-4f24-b309-6be06c781d68\") " Jun 05 13:12:17.581404 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.581410 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbdzt\" (UniqueName: \"kubernetes.io/projected/0bda33be-e480-475a-aaee-62de0e3cb942-kube-api-access-sbdzt\") pod \"0bda33be-e480-475a-aaee-62de0e3cb942\" (UID: \"0bda33be-e480-475a-aaee-62de0e3cb942\") " Jun 05 13:12:17.581634 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.581433 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bda33be-e480-475a-aaee-62de0e3cb942-extensions-socket-volume\") pod \"0bda33be-e480-475a-aaee-62de0e3cb942\" (UID: \"0bda33be-e480-475a-aaee-62de0e3cb942\") " Jun 05 13:12:17.581634 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.581561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mbng\" (UniqueName: \"kubernetes.io/projected/8794e4c2-f426-47f9-8d01-035d8c7c789f-kube-api-access-8mbng\") pod \"limitador-operator-controller-manager-859d7b78bd-rnxz4\" (UID: \"8794e4c2-f426-47f9-8d01-035d8c7c789f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnxz4" Jun 05 13:12:17.581976 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.581944 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bda33be-e480-475a-aaee-62de0e3cb942-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0bda33be-e480-475a-aaee-62de0e3cb942" (UID: "0bda33be-e480-475a-aaee-62de0e3cb942"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:12:17.583643 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.583621 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84d26b67-900b-4f24-b309-6be06c781d68-kube-api-access-9swbk" (OuterVolumeSpecName: "kube-api-access-9swbk") pod "84d26b67-900b-4f24-b309-6be06c781d68" (UID: "84d26b67-900b-4f24-b309-6be06c781d68"). InnerVolumeSpecName "kube-api-access-9swbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:12:17.583643 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.583629 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bda33be-e480-475a-aaee-62de0e3cb942-kube-api-access-sbdzt" (OuterVolumeSpecName: "kube-api-access-sbdzt") pod "0bda33be-e480-475a-aaee-62de0e3cb942" (UID: "0bda33be-e480-475a-aaee-62de0e3cb942"). InnerVolumeSpecName "kube-api-access-sbdzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:12:17.609224 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.609195 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mbng\" (UniqueName: \"kubernetes.io/projected/8794e4c2-f426-47f9-8d01-035d8c7c789f-kube-api-access-8mbng\") pod \"limitador-operator-controller-manager-859d7b78bd-rnxz4\" (UID: \"8794e4c2-f426-47f9-8d01-035d8c7c789f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnxz4" Jun 05 13:12:17.631199 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.631166 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" Jun 05 13:12:17.635902 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.635877 2567 generic.go:356] "Generic (PLEG): container finished" podID="0bda33be-e480-475a-aaee-62de0e3cb942" containerID="ac0fdaf2a12d5fdd50035767e57f70ad299b416ea1a79b6543a8a489ec99fdbb" exitCode=0 Jun 05 13:12:17.635981 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.635919 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dq4b5" Jun 05 13:12:17.635981 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.635972 2567 scope.go:117] "RemoveContainer" containerID="ac0fdaf2a12d5fdd50035767e57f70ad299b416ea1a79b6543a8a489ec99fdbb" Jun 05 13:12:17.637192 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.637168 2567 generic.go:356] "Generic (PLEG): container finished" podID="84d26b67-900b-4f24-b309-6be06c781d68" containerID="9733fa19afedeb8a88f0624ed84beb4ef50e21f2ffb8de5946d17be4ca2b433b" exitCode=0 Jun 05 13:12:17.637284 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.637219 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4btws" Jun 05 13:12:17.639639 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.639615 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnxz4" Jun 05 13:12:17.643919 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.643899 2567 scope.go:117] "RemoveContainer" containerID="ac0fdaf2a12d5fdd50035767e57f70ad299b416ea1a79b6543a8a489ec99fdbb" Jun 05 13:12:17.644225 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:12:17.644197 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac0fdaf2a12d5fdd50035767e57f70ad299b416ea1a79b6543a8a489ec99fdbb\": container with ID starting with ac0fdaf2a12d5fdd50035767e57f70ad299b416ea1a79b6543a8a489ec99fdbb not found: ID does not exist" containerID="ac0fdaf2a12d5fdd50035767e57f70ad299b416ea1a79b6543a8a489ec99fdbb" Jun 05 13:12:17.644313 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.644235 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac0fdaf2a12d5fdd50035767e57f70ad299b416ea1a79b6543a8a489ec99fdbb"} err="failed to get container status \"ac0fdaf2a12d5fdd50035767e57f70ad299b416ea1a79b6543a8a489ec99fdbb\": rpc error: code = NotFound desc = could not find container \"ac0fdaf2a12d5fdd50035767e57f70ad299b416ea1a79b6543a8a489ec99fdbb\": container with ID starting with ac0fdaf2a12d5fdd50035767e57f70ad299b416ea1a79b6543a8a489ec99fdbb not found: ID does not exist" Jun 05 13:12:17.644313 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.644260 2567 scope.go:117] "RemoveContainer" containerID="9733fa19afedeb8a88f0624ed84beb4ef50e21f2ffb8de5946d17be4ca2b433b" Jun 05 13:12:17.653271 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.653251 2567 scope.go:117] "RemoveContainer" containerID="9733fa19afedeb8a88f0624ed84beb4ef50e21f2ffb8de5946d17be4ca2b433b" Jun 05 13:12:17.653594 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:12:17.653572 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9733fa19afedeb8a88f0624ed84beb4ef50e21f2ffb8de5946d17be4ca2b433b\": container with ID starting with 9733fa19afedeb8a88f0624ed84beb4ef50e21f2ffb8de5946d17be4ca2b433b not found: ID does not exist" containerID="9733fa19afedeb8a88f0624ed84beb4ef50e21f2ffb8de5946d17be4ca2b433b" Jun 05 13:12:17.653689 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.653601 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9733fa19afedeb8a88f0624ed84beb4ef50e21f2ffb8de5946d17be4ca2b433b"} err="failed to get container status \"9733fa19afedeb8a88f0624ed84beb4ef50e21f2ffb8de5946d17be4ca2b433b\": rpc error: code = NotFound desc = could not find container \"9733fa19afedeb8a88f0624ed84beb4ef50e21f2ffb8de5946d17be4ca2b433b\": container with ID starting with 9733fa19afedeb8a88f0624ed84beb4ef50e21f2ffb8de5946d17be4ca2b433b not found: ID does not exist" Jun 05 13:12:17.683175 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.683141 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9swbk\" (UniqueName: \"kubernetes.io/projected/84d26b67-900b-4f24-b309-6be06c781d68-kube-api-access-9swbk\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:12:17.683175 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.683176 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbdzt\" (UniqueName: \"kubernetes.io/projected/0bda33be-e480-475a-aaee-62de0e3cb942-kube-api-access-sbdzt\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:12:17.683417 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.683190 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bda33be-e480-475a-aaee-62de0e3cb942-extensions-socket-volume\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:12:17.808311 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.808268 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7"] Jun 05 13:12:17.814745 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:12:17.814721 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6affd65d_351c_40d0_a6d1_0a3fc0419c41.slice/crio-8cfb52c15f1e75e55754827a2aaaf184fdaa16bb3d8e0d349681969c74f28757 WatchSource:0}: Error finding container 8cfb52c15f1e75e55754827a2aaaf184fdaa16bb3d8e0d349681969c74f28757: Status 404 returned error can't find the container with id 8cfb52c15f1e75e55754827a2aaaf184fdaa16bb3d8e0d349681969c74f28757 Jun 05 13:12:17.830523 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:17.830502 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnxz4"] Jun 05 13:12:17.849254 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:12:17.849229 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8794e4c2_f426_47f9_8d01_035d8c7c789f.slice/crio-53cefd844661312f18ae3103dfe27b68d928aab41e417e6c3e4c29ec274436c4 WatchSource:0}: Error finding container 53cefd844661312f18ae3103dfe27b68d928aab41e417e6c3e4c29ec274436c4: Status 404 returned error can't find the container with id 53cefd844661312f18ae3103dfe27b68d928aab41e417e6c3e4c29ec274436c4 Jun 05 13:12:18.642882 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:18.642846 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnxz4" event={"ID":"8794e4c2-f426-47f9-8d01-035d8c7c789f","Type":"ContainerStarted","Data":"d48b469e8dfb89c516277578eeeff3be903837c2e9aa29d106b72d3d3dfa3457"} Jun 05 13:12:18.643332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:18.642903 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnxz4" event={"ID":"8794e4c2-f426-47f9-8d01-035d8c7c789f","Type":"ContainerStarted","Data":"53cefd844661312f18ae3103dfe27b68d928aab41e417e6c3e4c29ec274436c4"} Jun 05 13:12:18.643332 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:18.643031 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnxz4" Jun 05 13:12:18.644409 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:18.644389 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" event={"ID":"6affd65d-351c-40d0-a6d1-0a3fc0419c41","Type":"ContainerStarted","Data":"840efcf4d09fb8bd4112fca9f0d91c048b0edb858650d44a942486c8fc90b514"} Jun 05 13:12:18.644462 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:18.644432 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" event={"ID":"6affd65d-351c-40d0-a6d1-0a3fc0419c41","Type":"ContainerStarted","Data":"8cfb52c15f1e75e55754827a2aaaf184fdaa16bb3d8e0d349681969c74f28757"} Jun 05 13:12:18.644462 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:18.644454 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" Jun 05 13:12:18.692756 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:18.692694 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnxz4" podStartSLOduration=1.692676799 podStartE2EDuration="1.692676799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:12:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:12:18.689481327 +0000 UTC m=+677.785390717" watchObservedRunningTime="2026-06-05 13:12:18.692676799 +0000 UTC m=+677.788586188" Jun 05 13:12:18.772310 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:18.772236 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" podStartSLOduration=1.7722176520000001 podStartE2EDuration="1.772217652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:12:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:12:18.770012 +0000 UTC m=+677.865921389" watchObservedRunningTime="2026-06-05 13:12:18.772217652 +0000 UTC m=+677.868127041" Jun 05 13:12:19.380952 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:19.380919 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bda33be-e480-475a-aaee-62de0e3cb942" path="/var/lib/kubelet/pods/0bda33be-e480-475a-aaee-62de0e3cb942/volumes" Jun 05 13:12:19.381243 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:19.381230 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84d26b67-900b-4f24-b309-6be06c781d68" path="/var/lib/kubelet/pods/84d26b67-900b-4f24-b309-6be06c781d68/volumes" Jun 05 13:12:29.652430 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:29.652404 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" Jun 05 13:12:29.652897 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:29.652482 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rnxz4" Jun 05 13:12:51.940933 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:51.940853 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7"] Jun 05 13:12:51.941407 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:51.941082 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" podUID="6affd65d-351c-40d0-a6d1-0a3fc0419c41" containerName="manager" containerID="cri-o://840efcf4d09fb8bd4112fca9f0d91c048b0edb858650d44a942486c8fc90b514" gracePeriod=10 Jun 05 13:12:52.182271 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.182247 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" Jun 05 13:12:52.257767 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.257676 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6affd65d-351c-40d0-a6d1-0a3fc0419c41-extensions-socket-volume\") pod \"6affd65d-351c-40d0-a6d1-0a3fc0419c41\" (UID: \"6affd65d-351c-40d0-a6d1-0a3fc0419c41\") " Jun 05 13:12:52.257767 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.257740 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkzds\" (UniqueName: \"kubernetes.io/projected/6affd65d-351c-40d0-a6d1-0a3fc0419c41-kube-api-access-vkzds\") pod \"6affd65d-351c-40d0-a6d1-0a3fc0419c41\" (UID: \"6affd65d-351c-40d0-a6d1-0a3fc0419c41\") " Jun 05 13:12:52.258084 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.258056 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6affd65d-351c-40d0-a6d1-0a3fc0419c41-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6affd65d-351c-40d0-a6d1-0a3fc0419c41" (UID: "6affd65d-351c-40d0-a6d1-0a3fc0419c41"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:12:52.259814 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.259791 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6affd65d-351c-40d0-a6d1-0a3fc0419c41-kube-api-access-vkzds" (OuterVolumeSpecName: "kube-api-access-vkzds") pod "6affd65d-351c-40d0-a6d1-0a3fc0419c41" (UID: "6affd65d-351c-40d0-a6d1-0a3fc0419c41"). InnerVolumeSpecName "kube-api-access-vkzds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:12:52.358558 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.358517 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6affd65d-351c-40d0-a6d1-0a3fc0419c41-extensions-socket-volume\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:12:52.358558 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.358548 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkzds\" (UniqueName: \"kubernetes.io/projected/6affd65d-351c-40d0-a6d1-0a3fc0419c41-kube-api-access-vkzds\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:12:52.790650 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.790611 2567 generic.go:356] "Generic (PLEG): container finished" podID="6affd65d-351c-40d0-a6d1-0a3fc0419c41" containerID="840efcf4d09fb8bd4112fca9f0d91c048b0edb858650d44a942486c8fc90b514" exitCode=0 Jun 05 13:12:52.790819 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.790670 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" Jun 05 13:12:52.790819 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.790684 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" event={"ID":"6affd65d-351c-40d0-a6d1-0a3fc0419c41","Type":"ContainerDied","Data":"840efcf4d09fb8bd4112fca9f0d91c048b0edb858650d44a942486c8fc90b514"} Jun 05 13:12:52.790819 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.790755 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7" event={"ID":"6affd65d-351c-40d0-a6d1-0a3fc0419c41","Type":"ContainerDied","Data":"8cfb52c15f1e75e55754827a2aaaf184fdaa16bb3d8e0d349681969c74f28757"} Jun 05 13:12:52.790819 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.790779 2567 scope.go:117] "RemoveContainer" containerID="840efcf4d09fb8bd4112fca9f0d91c048b0edb858650d44a942486c8fc90b514" Jun 05 13:12:52.799291 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.799265 2567 scope.go:117] "RemoveContainer" containerID="840efcf4d09fb8bd4112fca9f0d91c048b0edb858650d44a942486c8fc90b514" Jun 05 13:12:52.799606 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:12:52.799584 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"840efcf4d09fb8bd4112fca9f0d91c048b0edb858650d44a942486c8fc90b514\": container with ID starting with 840efcf4d09fb8bd4112fca9f0d91c048b0edb858650d44a942486c8fc90b514 not found: ID does not exist" containerID="840efcf4d09fb8bd4112fca9f0d91c048b0edb858650d44a942486c8fc90b514" Jun 05 13:12:52.799656 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.799616 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"840efcf4d09fb8bd4112fca9f0d91c048b0edb858650d44a942486c8fc90b514"} err="failed to get container status \"840efcf4d09fb8bd4112fca9f0d91c048b0edb858650d44a942486c8fc90b514\": rpc error: code = NotFound desc = could not find container \"840efcf4d09fb8bd4112fca9f0d91c048b0edb858650d44a942486c8fc90b514\": container with ID starting with 840efcf4d09fb8bd4112fca9f0d91c048b0edb858650d44a942486c8fc90b514 not found: ID does not exist" Jun 05 13:12:52.821874 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.821842 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7"] Jun 05 13:12:52.840788 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:52.840751 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n6t7"] Jun 05 13:12:53.379877 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:12:53.379844 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6affd65d-351c-40d0-a6d1-0a3fc0419c41" path="/var/lib/kubelet/pods/6affd65d-351c-40d0-a6d1-0a3fc0419c41/volumes" Jun 05 13:13:08.460771 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.460735 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl"] Jun 05 13:13:08.461134 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.460986 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6affd65d-351c-40d0-a6d1-0a3fc0419c41" containerName="manager" Jun 05 13:13:08.461134 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.460997 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6affd65d-351c-40d0-a6d1-0a3fc0419c41" containerName="manager" Jun 05 13:13:08.461134 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.461056 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6affd65d-351c-40d0-a6d1-0a3fc0419c41" containerName="manager" Jun 05 13:13:08.463537 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.463520 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.468088 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.468070 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mrndm\"" Jun 05 13:13:08.494600 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.494566 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl"] Jun 05 13:13:08.593467 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.593419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e600146-a968-4105-b148-1320d4d99629-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.593467 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.593465 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.593722 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.593487 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs28n\" (UniqueName: \"kubernetes.io/projected/8e600146-a968-4105-b148-1320d4d99629-kube-api-access-rs28n\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.593722 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.593551 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.593722 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.593593 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e600146-a968-4105-b148-1320d4d99629-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.593722 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.593648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.593722 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.593688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e600146-a968-4105-b148-1320d4d99629-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.593722 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.593722 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.593947 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.593750 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.694910 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.694879 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.694910 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.694915 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.695158 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.694941 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e600146-a968-4105-b148-1320d4d99629-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.695158 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.694958 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.695158 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.694975 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs28n\" (UniqueName: \"kubernetes.io/projected/8e600146-a968-4105-b148-1320d4d99629-kube-api-access-rs28n\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.695158 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.695007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.695158 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.695024 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e600146-a968-4105-b148-1320d4d99629-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.695158 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.695054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.695158 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.695091 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e600146-a968-4105-b148-1320d4d99629-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.695521 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.695375 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.695521 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.695408 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.695521 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.695464 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.695659 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.695608 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.695954 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.695935 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e600146-a968-4105-b148-1320d4d99629-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.697443 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.697417 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e600146-a968-4105-b148-1320d4d99629-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.697560 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.697484 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e600146-a968-4105-b148-1320d4d99629-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.712955 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.712883 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e600146-a968-4105-b148-1320d4d99629-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.713080 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.713035 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs28n\" (UniqueName: \"kubernetes.io/projected/8e600146-a968-4105-b148-1320d4d99629-kube-api-access-rs28n\") pod \"maas-default-gateway-openshift-default-687ff6996-sfxfl\" (UID: \"8e600146-a968-4105-b148-1320d4d99629\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.773276 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.773242 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:08.920619 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.920591 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl"] Jun 05 13:13:08.923057 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:13:08.923030 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e600146_a968_4105_b148_1320d4d99629.slice/crio-9ba0228851485470660a50b9234ec80a20202ae5f9d816cca982537fab90284c WatchSource:0}: Error finding container 9ba0228851485470660a50b9234ec80a20202ae5f9d816cca982537fab90284c: Status 404 returned error can't find the container with id 9ba0228851485470660a50b9234ec80a20202ae5f9d816cca982537fab90284c Jun 05 13:13:08.925135 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.925099 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:13:08.925190 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.925174 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:13:08.925225 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:08.925204 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:13:09.866202 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:09.866167 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" event={"ID":"8e600146-a968-4105-b148-1320d4d99629","Type":"ContainerStarted","Data":"4e11f4f79c89927ae218429fe05fcc06128857621a3a6c46d9b0b239b29f17a0"} Jun 05 13:13:09.866613 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:09.866219 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" event={"ID":"8e600146-a968-4105-b148-1320d4d99629","Type":"ContainerStarted","Data":"9ba0228851485470660a50b9234ec80a20202ae5f9d816cca982537fab90284c"} Jun 05 13:13:09.912457 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:09.912411 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" podStartSLOduration=1.9123962140000001 podStartE2EDuration="1.912396214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:13:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:13:09.911016186 +0000 UTC m=+729.006925576" watchObservedRunningTime="2026-06-05 13:13:09.912396214 +0000 UTC m=+729.008305603" Jun 05 13:13:10.773655 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:10.773619 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:10.778389 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:10.778360 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:10.870894 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:10.870856 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:10.871852 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:10.871833 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:13:11.231763 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.231711 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxtjf"] Jun 05 13:13:11.234635 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.234617 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" Jun 05 13:13:11.241653 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.241384 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fj5pc\"" Jun 05 13:13:11.241722 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.241693 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 13:13:11.263426 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.263395 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxtjf"] Jun 05 13:13:11.317891 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.317856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qp7h\" (UniqueName: \"kubernetes.io/projected/9901557b-51bc-43bd-a950-ed0c915e1d07-kube-api-access-6qp7h\") pod \"limitador-limitador-64c94fd64f-kxtjf\" (UID: \"9901557b-51bc-43bd-a950-ed0c915e1d07\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" Jun 05 13:13:11.318050 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.317965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9901557b-51bc-43bd-a950-ed0c915e1d07-config-file\") pod \"limitador-limitador-64c94fd64f-kxtjf\" (UID: \"9901557b-51bc-43bd-a950-ed0c915e1d07\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" Jun 05 13:13:11.344895 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.344860 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxtjf"] Jun 05 13:13:11.419172 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.419143 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qp7h\" (UniqueName: \"kubernetes.io/projected/9901557b-51bc-43bd-a950-ed0c915e1d07-kube-api-access-6qp7h\") pod \"limitador-limitador-64c94fd64f-kxtjf\" (UID: \"9901557b-51bc-43bd-a950-ed0c915e1d07\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" Jun 05 13:13:11.419334 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.419192 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9901557b-51bc-43bd-a950-ed0c915e1d07-config-file\") pod \"limitador-limitador-64c94fd64f-kxtjf\" (UID: \"9901557b-51bc-43bd-a950-ed0c915e1d07\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" Jun 05 13:13:11.419772 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.419754 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9901557b-51bc-43bd-a950-ed0c915e1d07-config-file\") pod \"limitador-limitador-64c94fd64f-kxtjf\" (UID: \"9901557b-51bc-43bd-a950-ed0c915e1d07\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" Jun 05 13:13:11.431861 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.431835 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qp7h\" (UniqueName: \"kubernetes.io/projected/9901557b-51bc-43bd-a950-ed0c915e1d07-kube-api-access-6qp7h\") pod \"limitador-limitador-64c94fd64f-kxtjf\" (UID: \"9901557b-51bc-43bd-a950-ed0c915e1d07\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" Jun 05 13:13:11.545579 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.545491 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" Jun 05 13:13:11.679339 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.679311 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxtjf"] Jun 05 13:13:11.681181 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:13:11.681159 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9901557b_51bc_43bd_a950_ed0c915e1d07.slice/crio-30ef8dfca5372a5c8485fc3261059c9998d251c2cf840f7334bd92a8ac361a86 WatchSource:0}: Error finding container 30ef8dfca5372a5c8485fc3261059c9998d251c2cf840f7334bd92a8ac361a86: Status 404 returned error can't find the container with id 30ef8dfca5372a5c8485fc3261059c9998d251c2cf840f7334bd92a8ac361a86 Jun 05 13:13:11.875960 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:11.875886 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" event={"ID":"9901557b-51bc-43bd-a950-ed0c915e1d07","Type":"ContainerStarted","Data":"30ef8dfca5372a5c8485fc3261059c9998d251c2cf840f7334bd92a8ac361a86"} Jun 05 13:13:12.256724 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.256695 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-dq69x"] Jun 05 13:13:12.260284 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.260262 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dq69x" Jun 05 13:13:12.263751 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.263667 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ktbzb\"" Jun 05 13:13:12.275930 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.275910 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dq69x"] Jun 05 13:13:12.427896 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.427797 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhrnk\" (UniqueName: \"kubernetes.io/projected/4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c-kube-api-access-dhrnk\") pod \"authorino-58cd955675-dq69x\" (UID: \"4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c\") " pod="kuadrant-system/authorino-58cd955675-dq69x" Jun 05 13:13:12.528555 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.528470 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhrnk\" (UniqueName: \"kubernetes.io/projected/4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c-kube-api-access-dhrnk\") pod \"authorino-58cd955675-dq69x\" (UID: \"4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c\") " pod="kuadrant-system/authorino-58cd955675-dq69x" Jun 05 13:13:12.540409 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.540380 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhrnk\" (UniqueName: \"kubernetes.io/projected/4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c-kube-api-access-dhrnk\") pod \"authorino-58cd955675-dq69x\" (UID: \"4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c\") " pod="kuadrant-system/authorino-58cd955675-dq69x" Jun 05 13:13:12.572134 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.572102 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dq69x" Jun 05 13:13:12.600631 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.600587 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xlpd8"] Jun 05 13:13:12.603943 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.603919 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xlpd8" Jun 05 13:13:12.616718 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.616694 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xlpd8"] Jun 05 13:13:12.731670 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.731525 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qt6m\" (UniqueName: \"kubernetes.io/projected/979347ef-6d20-475b-b0d3-6a61c3054127-kube-api-access-6qt6m\") pod \"authorino-75d556bd77-xlpd8\" (UID: \"979347ef-6d20-475b-b0d3-6a61c3054127\") " pod="kuadrant-system/authorino-75d556bd77-xlpd8" Jun 05 13:13:12.732696 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.732166 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dq69x"] Jun 05 13:13:12.736671 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:13:12.736636 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e51dcbd_f2c1_43ac_a8ce_a9fac3be007c.slice/crio-f68100452576f5a245fb38332c53a0297c8ff0fac36be4663beb727e1db72d4c WatchSource:0}: Error finding container f68100452576f5a245fb38332c53a0297c8ff0fac36be4663beb727e1db72d4c: Status 404 returned error can't find the container with id f68100452576f5a245fb38332c53a0297c8ff0fac36be4663beb727e1db72d4c Jun 05 13:13:12.832604 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.832516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qt6m\" (UniqueName: \"kubernetes.io/projected/979347ef-6d20-475b-b0d3-6a61c3054127-kube-api-access-6qt6m\") pod \"authorino-75d556bd77-xlpd8\" (UID: \"979347ef-6d20-475b-b0d3-6a61c3054127\") " pod="kuadrant-system/authorino-75d556bd77-xlpd8" Jun 05 13:13:12.848714 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.848682 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qt6m\" (UniqueName: \"kubernetes.io/projected/979347ef-6d20-475b-b0d3-6a61c3054127-kube-api-access-6qt6m\") pod \"authorino-75d556bd77-xlpd8\" (UID: \"979347ef-6d20-475b-b0d3-6a61c3054127\") " pod="kuadrant-system/authorino-75d556bd77-xlpd8" Jun 05 13:13:12.882036 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.882000 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dq69x" event={"ID":"4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c","Type":"ContainerStarted","Data":"f68100452576f5a245fb38332c53a0297c8ff0fac36be4663beb727e1db72d4c"} Jun 05 13:13:12.916458 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:12.916431 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xlpd8" Jun 05 13:13:13.061552 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:13.061521 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xlpd8"] Jun 05 13:13:13.552775 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:13:13.552739 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod979347ef_6d20_475b_b0d3_6a61c3054127.slice/crio-b4e6d163b6dc929a84ff0454937433a19309c1058eba8c2905957d8d5be6672c WatchSource:0}: Error finding container b4e6d163b6dc929a84ff0454937433a19309c1058eba8c2905957d8d5be6672c: Status 404 returned error can't find the container with id b4e6d163b6dc929a84ff0454937433a19309c1058eba8c2905957d8d5be6672c Jun 05 13:13:13.888118 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:13.888091 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xlpd8" event={"ID":"979347ef-6d20-475b-b0d3-6a61c3054127","Type":"ContainerStarted","Data":"b4e6d163b6dc929a84ff0454937433a19309c1058eba8c2905957d8d5be6672c"} Jun 05 13:13:14.897801 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:14.897743 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" event={"ID":"9901557b-51bc-43bd-a950-ed0c915e1d07","Type":"ContainerStarted","Data":"c4b603d73cc774d55f4f6636b395ce91c5b0abd1550a9da1887b63e484af4d08"} Jun 05 13:13:14.898673 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:14.898587 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" Jun 05 13:13:17.911710 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:17.911672 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xlpd8" event={"ID":"979347ef-6d20-475b-b0d3-6a61c3054127","Type":"ContainerStarted","Data":"3484ab92b1f175c9b3e3bc04edf1b24ce3c0cab9294f26428061d3437104327b"} Jun 05 13:13:17.913092 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:17.913064 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dq69x" event={"ID":"4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c","Type":"ContainerStarted","Data":"85237d66f873add14c134ffe43c6a88634bd2759eea3e59e1a1866ffc0979d1d"} Jun 05 13:13:17.931600 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:17.931551 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" podStartSLOduration=4.200528773 podStartE2EDuration="6.931536187s" totalImagesPullingTime="2.731007414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:13:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:13:14.921577579 +0000 UTC m=+734.017486969" watchObservedRunningTime="2026-06-05 13:13:17.931536187 +0000 UTC m=+737.027445579" Jun 05 13:13:17.931970 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:17.931942 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xlpd8" podStartSLOduration=2.398366218 podStartE2EDuration="5.931932685s" totalImagesPullingTime="3.533566467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:13:17.931393276 +0000 UTC m=+737.027302665" watchObservedRunningTime="2026-06-05 13:13:17.931932685 +0000 UTC m=+737.027842073" Jun 05 13:13:17.955078 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:17.955025 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-dq69x" podStartSLOduration=1.618631221 podStartE2EDuration="5.955005856s" totalImagesPullingTime="4.336374635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:13:17.95433063 +0000 UTC m=+737.050240020" watchObservedRunningTime="2026-06-05 13:13:17.955005856 +0000 UTC m=+737.050915246" Jun 05 13:13:17.982117 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:17.982085 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dq69x"] Jun 05 13:13:19.921395 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:19.921349 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-dq69x" podUID="4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c" containerName="authorino" containerID="cri-o://85237d66f873add14c134ffe43c6a88634bd2759eea3e59e1a1866ffc0979d1d" gracePeriod=30 Jun 05 13:13:20.175165 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:20.175092 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dq69x" Jun 05 13:13:20.300496 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:20.300453 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhrnk\" (UniqueName: \"kubernetes.io/projected/4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c-kube-api-access-dhrnk\") pod \"4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c\" (UID: \"4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c\") " Jun 05 13:13:20.302536 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:20.302503 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c-kube-api-access-dhrnk" (OuterVolumeSpecName: "kube-api-access-dhrnk") pod "4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c" (UID: "4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c"). InnerVolumeSpecName "kube-api-access-dhrnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:13:20.401858 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:20.401818 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhrnk\" (UniqueName: \"kubernetes.io/projected/4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c-kube-api-access-dhrnk\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:13:20.926235 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:20.926198 2567 generic.go:356] "Generic (PLEG): container finished" podID="4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c" containerID="85237d66f873add14c134ffe43c6a88634bd2759eea3e59e1a1866ffc0979d1d" exitCode=0 Jun 05 13:13:20.926235 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:20.926236 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dq69x" Jun 05 13:13:20.926680 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:20.926285 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dq69x" event={"ID":"4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c","Type":"ContainerDied","Data":"85237d66f873add14c134ffe43c6a88634bd2759eea3e59e1a1866ffc0979d1d"} Jun 05 13:13:20.926680 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:20.926344 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dq69x" event={"ID":"4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c","Type":"ContainerDied","Data":"f68100452576f5a245fb38332c53a0297c8ff0fac36be4663beb727e1db72d4c"} Jun 05 13:13:20.926680 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:20.926363 2567 scope.go:117] "RemoveContainer" containerID="85237d66f873add14c134ffe43c6a88634bd2759eea3e59e1a1866ffc0979d1d" Jun 05 13:13:20.935189 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:20.935168 2567 scope.go:117] "RemoveContainer" containerID="85237d66f873add14c134ffe43c6a88634bd2759eea3e59e1a1866ffc0979d1d" Jun 05 13:13:20.935486 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:13:20.935461 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85237d66f873add14c134ffe43c6a88634bd2759eea3e59e1a1866ffc0979d1d\": container with ID starting with 85237d66f873add14c134ffe43c6a88634bd2759eea3e59e1a1866ffc0979d1d not found: ID does not exist" containerID="85237d66f873add14c134ffe43c6a88634bd2759eea3e59e1a1866ffc0979d1d" Jun 05 13:13:20.935551 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:20.935495 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85237d66f873add14c134ffe43c6a88634bd2759eea3e59e1a1866ffc0979d1d"} err="failed to get container status \"85237d66f873add14c134ffe43c6a88634bd2759eea3e59e1a1866ffc0979d1d\": rpc error: code = NotFound desc = could not find container \"85237d66f873add14c134ffe43c6a88634bd2759eea3e59e1a1866ffc0979d1d\": container with ID starting with 85237d66f873add14c134ffe43c6a88634bd2759eea3e59e1a1866ffc0979d1d not found: ID does not exist" Jun 05 13:13:20.948563 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:20.948541 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dq69x"] Jun 05 13:13:20.954830 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:20.954808 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-dq69x"] Jun 05 13:13:21.379901 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:21.379873 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c" path="/var/lib/kubelet/pods/4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c/volumes" Jun 05 13:13:26.908060 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:26.908028 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" Jun 05 13:13:26.986505 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:26.986473 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxtjf"] Jun 05 13:13:26.986694 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:26.986667 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" podUID="9901557b-51bc-43bd-a950-ed0c915e1d07" containerName="limitador" containerID="cri-o://c4b603d73cc774d55f4f6636b395ce91c5b0abd1550a9da1887b63e484af4d08" gracePeriod=30 Jun 05 13:13:27.532005 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.531980 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" Jun 05 13:13:27.556176 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.556084 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9901557b-51bc-43bd-a950-ed0c915e1d07-config-file\") pod \"9901557b-51bc-43bd-a950-ed0c915e1d07\" (UID: \"9901557b-51bc-43bd-a950-ed0c915e1d07\") " Jun 05 13:13:27.556176 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.556133 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qp7h\" (UniqueName: \"kubernetes.io/projected/9901557b-51bc-43bd-a950-ed0c915e1d07-kube-api-access-6qp7h\") pod \"9901557b-51bc-43bd-a950-ed0c915e1d07\" (UID: \"9901557b-51bc-43bd-a950-ed0c915e1d07\") " Jun 05 13:13:27.556547 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.556517 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9901557b-51bc-43bd-a950-ed0c915e1d07-config-file" (OuterVolumeSpecName: "config-file") pod "9901557b-51bc-43bd-a950-ed0c915e1d07" (UID: "9901557b-51bc-43bd-a950-ed0c915e1d07"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:13:27.558249 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.558223 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9901557b-51bc-43bd-a950-ed0c915e1d07-kube-api-access-6qp7h" (OuterVolumeSpecName: "kube-api-access-6qp7h") pod "9901557b-51bc-43bd-a950-ed0c915e1d07" (UID: "9901557b-51bc-43bd-a950-ed0c915e1d07"). InnerVolumeSpecName "kube-api-access-6qp7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:13:27.657156 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.657118 2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9901557b-51bc-43bd-a950-ed0c915e1d07-config-file\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:13:27.657156 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.657147 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qp7h\" (UniqueName: \"kubernetes.io/projected/9901557b-51bc-43bd-a950-ed0c915e1d07-kube-api-access-6qp7h\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:13:27.955348 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.955314 2567 generic.go:356] "Generic (PLEG): container finished" podID="9901557b-51bc-43bd-a950-ed0c915e1d07" containerID="c4b603d73cc774d55f4f6636b395ce91c5b0abd1550a9da1887b63e484af4d08" exitCode=0 Jun 05 13:13:27.955348 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.955345 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" Jun 05 13:13:27.955348 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.955324 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" event={"ID":"9901557b-51bc-43bd-a950-ed0c915e1d07","Type":"ContainerDied","Data":"c4b603d73cc774d55f4f6636b395ce91c5b0abd1550a9da1887b63e484af4d08"} Jun 05 13:13:27.955836 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.955391 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxtjf" event={"ID":"9901557b-51bc-43bd-a950-ed0c915e1d07","Type":"ContainerDied","Data":"30ef8dfca5372a5c8485fc3261059c9998d251c2cf840f7334bd92a8ac361a86"} Jun 05 13:13:27.955836 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.955419 2567 scope.go:117] "RemoveContainer" containerID="c4b603d73cc774d55f4f6636b395ce91c5b0abd1550a9da1887b63e484af4d08" Jun 05 13:13:27.963975 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.963956 2567 scope.go:117] "RemoveContainer" containerID="c4b603d73cc774d55f4f6636b395ce91c5b0abd1550a9da1887b63e484af4d08" Jun 05 13:13:27.964202 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:13:27.964185 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4b603d73cc774d55f4f6636b395ce91c5b0abd1550a9da1887b63e484af4d08\": container with ID starting with c4b603d73cc774d55f4f6636b395ce91c5b0abd1550a9da1887b63e484af4d08 not found: ID does not exist" containerID="c4b603d73cc774d55f4f6636b395ce91c5b0abd1550a9da1887b63e484af4d08" Jun 05 13:13:27.964244 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.964209 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b603d73cc774d55f4f6636b395ce91c5b0abd1550a9da1887b63e484af4d08"} err="failed to get container status \"c4b603d73cc774d55f4f6636b395ce91c5b0abd1550a9da1887b63e484af4d08\": rpc error: code = NotFound desc = could not find container \"c4b603d73cc774d55f4f6636b395ce91c5b0abd1550a9da1887b63e484af4d08\": container with ID starting with c4b603d73cc774d55f4f6636b395ce91c5b0abd1550a9da1887b63e484af4d08 not found: ID does not exist" Jun 05 13:13:27.978417 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.978393 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxtjf"] Jun 05 13:13:27.981395 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:27.981375 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxtjf"] Jun 05 13:13:29.385106 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:29.385075 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9901557b-51bc-43bd-a950-ed0c915e1d07" path="/var/lib/kubelet/pods/9901557b-51bc-43bd-a950-ed0c915e1d07/volumes" Jun 05 13:13:32.342121 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.342086 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-wtl9h"] Jun 05 13:13:32.342579 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.342430 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c" containerName="authorino" Jun 05 13:13:32.342579 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.342443 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c" containerName="authorino" Jun 05 13:13:32.342579 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.342464 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9901557b-51bc-43bd-a950-ed0c915e1d07" containerName="limitador" Jun 05 13:13:32.342579 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.342469 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9901557b-51bc-43bd-a950-ed0c915e1d07" containerName="limitador" Jun 05 13:13:32.342579 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.342518 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9901557b-51bc-43bd-a950-ed0c915e1d07" containerName="limitador" Jun 05 13:13:32.342579 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.342525 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e51dcbd-f2c1-43ac-a8ce-a9fac3be007c" containerName="authorino" Jun 05 13:13:32.346269 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.346251 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wtl9h" Jun 05 13:13:32.352986 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.352964 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 05 13:13:32.376642 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.376609 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wtl9h"] Jun 05 13:13:32.385717 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.385680 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8337ab60-2567-4eb7-8091-5339fcd201c5-data\") pod \"postgres-69fb4594cf-wtl9h\" (UID: \"8337ab60-2567-4eb7-8091-5339fcd201c5\") " pod="opendatahub/postgres-69fb4594cf-wtl9h" Jun 05 13:13:32.385853 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.385764 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvn5b\" (UniqueName: \"kubernetes.io/projected/8337ab60-2567-4eb7-8091-5339fcd201c5-kube-api-access-bvn5b\") pod \"postgres-69fb4594cf-wtl9h\" (UID: \"8337ab60-2567-4eb7-8091-5339fcd201c5\") " pod="opendatahub/postgres-69fb4594cf-wtl9h" Jun 05 13:13:32.486589 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.486549 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8337ab60-2567-4eb7-8091-5339fcd201c5-data\") pod \"postgres-69fb4594cf-wtl9h\" (UID: \"8337ab60-2567-4eb7-8091-5339fcd201c5\") " pod="opendatahub/postgres-69fb4594cf-wtl9h" Jun 05 13:13:32.486799 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.486603 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvn5b\" (UniqueName: \"kubernetes.io/projected/8337ab60-2567-4eb7-8091-5339fcd201c5-kube-api-access-bvn5b\") pod \"postgres-69fb4594cf-wtl9h\" (UID: \"8337ab60-2567-4eb7-8091-5339fcd201c5\") " pod="opendatahub/postgres-69fb4594cf-wtl9h" Jun 05 13:13:32.486995 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.486973 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8337ab60-2567-4eb7-8091-5339fcd201c5-data\") pod \"postgres-69fb4594cf-wtl9h\" (UID: \"8337ab60-2567-4eb7-8091-5339fcd201c5\") " pod="opendatahub/postgres-69fb4594cf-wtl9h" Jun 05 13:13:32.496090 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.496064 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvn5b\" (UniqueName: \"kubernetes.io/projected/8337ab60-2567-4eb7-8091-5339fcd201c5-kube-api-access-bvn5b\") pod \"postgres-69fb4594cf-wtl9h\" (UID: \"8337ab60-2567-4eb7-8091-5339fcd201c5\") " pod="opendatahub/postgres-69fb4594cf-wtl9h" Jun 05 13:13:32.656399 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.656365 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wtl9h" Jun 05 13:13:32.800472 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.800435 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wtl9h"] Jun 05 13:13:32.804808 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:13:32.804785 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8337ab60_2567_4eb7_8091_5339fcd201c5.slice/crio-02daa11d7ae104637c70e373ab1813a85756fee5307eb96773dcbbdf710ece7c WatchSource:0}: Error finding container 02daa11d7ae104637c70e373ab1813a85756fee5307eb96773dcbbdf710ece7c: Status 404 returned error can't find the container with id 02daa11d7ae104637c70e373ab1813a85756fee5307eb96773dcbbdf710ece7c Jun 05 13:13:32.984226 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:32.984136 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wtl9h" event={"ID":"8337ab60-2567-4eb7-8091-5339fcd201c5","Type":"ContainerStarted","Data":"02daa11d7ae104637c70e373ab1813a85756fee5307eb96773dcbbdf710ece7c"} Jun 05 13:13:35.999262 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:35.999228 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wtl9h" event={"ID":"8337ab60-2567-4eb7-8091-5339fcd201c5","Type":"ContainerStarted","Data":"275ab706058818f4cda507ccac5a6df5ec18fd848e475bd15cfc5e88cd7b3b24"} Jun 05 13:13:35.999663 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:35.999361 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-wtl9h" Jun 05 13:13:36.018121 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:36.018071 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-wtl9h" podStartSLOduration=1.353984067 podStartE2EDuration="4.018052541s" totalImagesPullingTime="2.664068474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:13:36.016920073 +0000 UTC m=+755.112829464" watchObservedRunningTime="2026-06-05 13:13:36.018052541 +0000 UTC m=+755.113961978" Jun 05 13:13:42.036385 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:42.036346 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-wtl9h" Jun 05 13:13:53.673820 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:53.673787 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-7qn25"] Jun 05 13:13:53.675860 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:53.675843 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-7qn25" Jun 05 13:13:53.678512 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:53.678490 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-p8xlj\"" Jun 05 13:13:53.678750 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:53.678730 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 13:13:53.679270 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:53.679254 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 13:13:53.688260 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:53.688236 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-7qn25"] Jun 05 13:13:53.764180 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:53.764150 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qlst\" (UniqueName: \"kubernetes.io/projected/ae5dc354-b381-437a-b7ea-c930d8ed483b-kube-api-access-4qlst\") pod \"keycloak-operator-dd84cbf46-7qn25\" (UID: \"ae5dc354-b381-437a-b7ea-c930d8ed483b\") " pod="keycloak-system/keycloak-operator-dd84cbf46-7qn25" Jun 05 13:13:53.865029 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:53.864989 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qlst\" (UniqueName: \"kubernetes.io/projected/ae5dc354-b381-437a-b7ea-c930d8ed483b-kube-api-access-4qlst\") pod \"keycloak-operator-dd84cbf46-7qn25\" (UID: \"ae5dc354-b381-437a-b7ea-c930d8ed483b\") " pod="keycloak-system/keycloak-operator-dd84cbf46-7qn25" Jun 05 13:13:53.880746 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:53.880713 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qlst\" (UniqueName: \"kubernetes.io/projected/ae5dc354-b381-437a-b7ea-c930d8ed483b-kube-api-access-4qlst\") pod \"keycloak-operator-dd84cbf46-7qn25\" (UID: \"ae5dc354-b381-437a-b7ea-c930d8ed483b\") " pod="keycloak-system/keycloak-operator-dd84cbf46-7qn25" Jun 05 13:13:53.985741 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:53.985667 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-7qn25" Jun 05 13:13:54.120654 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:13:54.120625 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5dc354_b381_437a_b7ea_c930d8ed483b.slice/crio-f5cdd564776e3b6c57399ae68a4542057a59c5aa32db0ea13364c9df5f882968 WatchSource:0}: Error finding container f5cdd564776e3b6c57399ae68a4542057a59c5aa32db0ea13364c9df5f882968: Status 404 returned error can't find the container with id f5cdd564776e3b6c57399ae68a4542057a59c5aa32db0ea13364c9df5f882968 Jun 05 13:13:54.121288 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:54.121255 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-7qn25"] Jun 05 13:13:55.081872 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:13:55.081838 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-7qn25" event={"ID":"ae5dc354-b381-437a-b7ea-c930d8ed483b","Type":"ContainerStarted","Data":"f5cdd564776e3b6c57399ae68a4542057a59c5aa32db0ea13364c9df5f882968"} Jun 05 13:14:01.114751 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:01.114711 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-7qn25" event={"ID":"ae5dc354-b381-437a-b7ea-c930d8ed483b","Type":"ContainerStarted","Data":"5fd9215b35d73e424c3f0c6fffb8c848fc2be3a82f71a760699e4475dbd49a8d"} Jun 05 13:14:01.160965 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:01.160908 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-7qn25" podStartSLOduration=2.067883924 podStartE2EDuration="8.160891995s" totalImagesPullingTime="6.093008071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:13:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:14:01.157030846 +0000 UTC m=+780.252940234" watchObservedRunningTime="2026-06-05 13:14:01.160891995 +0000 UTC m=+780.256801384" Jun 05 13:14:39.844073 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:39.843995 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k6kdz"] Jun 05 13:14:39.850847 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:39.850825 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k6kdz" Jun 05 13:14:39.858460 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:39.858436 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k6kdz"] Jun 05 13:14:39.952064 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:39.952028 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktvg4\" (UniqueName: \"kubernetes.io/projected/853d85b7-1207-439f-9b5f-fd0f3ae7081c-kube-api-access-ktvg4\") pod \"authorino-5d4b67c446-k6kdz\" (UID: \"853d85b7-1207-439f-9b5f-fd0f3ae7081c\") " pod="kuadrant-system/authorino-5d4b67c446-k6kdz" Jun 05 13:14:40.053427 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.053389 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktvg4\" (UniqueName: \"kubernetes.io/projected/853d85b7-1207-439f-9b5f-fd0f3ae7081c-kube-api-access-ktvg4\") pod \"authorino-5d4b67c446-k6kdz\" (UID: \"853d85b7-1207-439f-9b5f-fd0f3ae7081c\") " pod="kuadrant-system/authorino-5d4b67c446-k6kdz" Jun 05 13:14:40.062124 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.062097 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktvg4\" (UniqueName: \"kubernetes.io/projected/853d85b7-1207-439f-9b5f-fd0f3ae7081c-kube-api-access-ktvg4\") pod \"authorino-5d4b67c446-k6kdz\" (UID: \"853d85b7-1207-439f-9b5f-fd0f3ae7081c\") " pod="kuadrant-system/authorino-5d4b67c446-k6kdz" Jun 05 13:14:40.074983 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.074955 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k6kdz"] Jun 05 13:14:40.075192 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.075181 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k6kdz" Jun 05 13:14:40.115480 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.115389 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84d845b58f-42pzz"] Jun 05 13:14:40.117636 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.117614 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84d845b58f-42pzz" Jun 05 13:14:40.136376 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.136319 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84d845b58f-42pzz"] Jun 05 13:14:40.154253 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.154225 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svsck\" (UniqueName: \"kubernetes.io/projected/b2006975-27d7-41a3-a1fc-5a641876e7d2-kube-api-access-svsck\") pod \"authorino-84d845b58f-42pzz\" (UID: \"b2006975-27d7-41a3-a1fc-5a641876e7d2\") " pod="kuadrant-system/authorino-84d845b58f-42pzz" Jun 05 13:14:40.208182 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.208150 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k6kdz"] Jun 05 13:14:40.211534 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:14:40.211507 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod853d85b7_1207_439f_9b5f_fd0f3ae7081c.slice/crio-029f2074e1cf81140b9bb4ee2f64c46d3fbbd91a9a436e4ad1e87effeb233ac6 WatchSource:0}: Error finding container 029f2074e1cf81140b9bb4ee2f64c46d3fbbd91a9a436e4ad1e87effeb233ac6: Status 404 returned error can't find the container with id 029f2074e1cf81140b9bb4ee2f64c46d3fbbd91a9a436e4ad1e87effeb233ac6 Jun 05 13:14:40.255447 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.255411 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svsck\" (UniqueName: \"kubernetes.io/projected/b2006975-27d7-41a3-a1fc-5a641876e7d2-kube-api-access-svsck\") pod \"authorino-84d845b58f-42pzz\" (UID: \"b2006975-27d7-41a3-a1fc-5a641876e7d2\") " pod="kuadrant-system/authorino-84d845b58f-42pzz" Jun 05 13:14:40.264790 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.264768 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svsck\" (UniqueName: \"kubernetes.io/projected/b2006975-27d7-41a3-a1fc-5a641876e7d2-kube-api-access-svsck\") pod \"authorino-84d845b58f-42pzz\" (UID: \"b2006975-27d7-41a3-a1fc-5a641876e7d2\") " pod="kuadrant-system/authorino-84d845b58f-42pzz" Jun 05 13:14:40.273038 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.273016 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k6kdz" event={"ID":"853d85b7-1207-439f-9b5f-fd0f3ae7081c","Type":"ContainerStarted","Data":"029f2074e1cf81140b9bb4ee2f64c46d3fbbd91a9a436e4ad1e87effeb233ac6"} Jun 05 13:14:40.382191 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.382158 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84d845b58f-42pzz"] Jun 05 13:14:40.382377 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.382365 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84d845b58f-42pzz" Jun 05 13:14:40.426174 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.426138 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8564547dc7-6hswc"] Jun 05 13:14:40.428697 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.428676 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8564547dc7-6hswc" Jun 05 13:14:40.432234 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.432203 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 05 13:14:40.440147 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.440120 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8564547dc7-6hswc"] Jun 05 13:14:40.456512 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.456488 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j57p\" (UniqueName: \"kubernetes.io/projected/e77fec43-e670-443f-8fd4-db40d4d4da4c-kube-api-access-5j57p\") pod \"authorino-8564547dc7-6hswc\" (UID: \"e77fec43-e670-443f-8fd4-db40d4d4da4c\") " pod="kuadrant-system/authorino-8564547dc7-6hswc" Jun 05 13:14:40.456674 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.456523 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e77fec43-e670-443f-8fd4-db40d4d4da4c-tls-cert\") pod \"authorino-8564547dc7-6hswc\" (UID: \"e77fec43-e670-443f-8fd4-db40d4d4da4c\") " pod="kuadrant-system/authorino-8564547dc7-6hswc" Jun 05 13:14:40.511345 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.511270 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84d845b58f-42pzz"] Jun 05 13:14:40.513915 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:14:40.513889 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2006975_27d7_41a3_a1fc_5a641876e7d2.slice/crio-8c7c88e87e634e9948b2f683856f59a9a0314f9c74c11c9a2011eddbbb33f94f WatchSource:0}: Error finding container 8c7c88e87e634e9948b2f683856f59a9a0314f9c74c11c9a2011eddbbb33f94f: Status 404 returned error can't find the container with id 8c7c88e87e634e9948b2f683856f59a9a0314f9c74c11c9a2011eddbbb33f94f Jun 05 13:14:40.557019 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.556992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j57p\" (UniqueName: \"kubernetes.io/projected/e77fec43-e670-443f-8fd4-db40d4d4da4c-kube-api-access-5j57p\") pod \"authorino-8564547dc7-6hswc\" (UID: \"e77fec43-e670-443f-8fd4-db40d4d4da4c\") " pod="kuadrant-system/authorino-8564547dc7-6hswc" Jun 05 13:14:40.557137 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.557028 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e77fec43-e670-443f-8fd4-db40d4d4da4c-tls-cert\") pod \"authorino-8564547dc7-6hswc\" (UID: \"e77fec43-e670-443f-8fd4-db40d4d4da4c\") " pod="kuadrant-system/authorino-8564547dc7-6hswc" Jun 05 13:14:40.559250 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.559224 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e77fec43-e670-443f-8fd4-db40d4d4da4c-tls-cert\") pod \"authorino-8564547dc7-6hswc\" (UID: \"e77fec43-e670-443f-8fd4-db40d4d4da4c\") " pod="kuadrant-system/authorino-8564547dc7-6hswc" Jun 05 13:14:40.565686 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.565662 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j57p\" (UniqueName: \"kubernetes.io/projected/e77fec43-e670-443f-8fd4-db40d4d4da4c-kube-api-access-5j57p\") pod \"authorino-8564547dc7-6hswc\" (UID: \"e77fec43-e670-443f-8fd4-db40d4d4da4c\") " pod="kuadrant-system/authorino-8564547dc7-6hswc" Jun 05 13:14:40.743155 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.743077 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8564547dc7-6hswc" Jun 05 13:14:40.867262 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:40.867234 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8564547dc7-6hswc"] Jun 05 13:14:40.870212 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:14:40.870186 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode77fec43_e670_443f_8fd4_db40d4d4da4c.slice/crio-f78b591813376b8c8915409836a5b28e53a7288dd454f4847f6f209d7196ab7b WatchSource:0}: Error finding container f78b591813376b8c8915409836a5b28e53a7288dd454f4847f6f209d7196ab7b: Status 404 returned error can't find the container with id f78b591813376b8c8915409836a5b28e53a7288dd454f4847f6f209d7196ab7b Jun 05 13:14:41.279129 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.279100 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k6kdz" event={"ID":"853d85b7-1207-439f-9b5f-fd0f3ae7081c","Type":"ContainerStarted","Data":"56ccf2d757932a2851eb6a91065b003ca5cf4856ba07e8b84b7481b1f1fc8bf1"} Jun 05 13:14:41.279271 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.279179 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-k6kdz" podUID="853d85b7-1207-439f-9b5f-fd0f3ae7081c" containerName="authorino" containerID="cri-o://56ccf2d757932a2851eb6a91065b003ca5cf4856ba07e8b84b7481b1f1fc8bf1" gracePeriod=30 Jun 05 13:14:41.287154 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.287125 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84d845b58f-42pzz" event={"ID":"b2006975-27d7-41a3-a1fc-5a641876e7d2","Type":"ContainerStarted","Data":"4e529c7530923f2dfd78eb23b12368436f2900e08ac3f44c5610287709c84945"} Jun 05 13:14:41.287288 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.287170 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84d845b58f-42pzz" event={"ID":"b2006975-27d7-41a3-a1fc-5a641876e7d2","Type":"ContainerStarted","Data":"8c7c88e87e634e9948b2f683856f59a9a0314f9c74c11c9a2011eddbbb33f94f"} Jun 05 13:14:41.287288 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.287154 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-84d845b58f-42pzz" podUID="b2006975-27d7-41a3-a1fc-5a641876e7d2" containerName="authorino" containerID="cri-o://4e529c7530923f2dfd78eb23b12368436f2900e08ac3f44c5610287709c84945" gracePeriod=30 Jun 05 13:14:41.288934 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.288888 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8564547dc7-6hswc" event={"ID":"e77fec43-e670-443f-8fd4-db40d4d4da4c","Type":"ContainerStarted","Data":"a2cd1c9aea9a24ce3fe853ab442fe1b719076540355b22c73ec58d135a18ec01"} Jun 05 13:14:41.288934 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.288926 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8564547dc7-6hswc" event={"ID":"e77fec43-e670-443f-8fd4-db40d4d4da4c","Type":"ContainerStarted","Data":"f78b591813376b8c8915409836a5b28e53a7288dd454f4847f6f209d7196ab7b"} Jun 05 13:14:41.322374 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.322330 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-k6kdz" podStartSLOduration=2.015962993 podStartE2EDuration="2.322315569s" totalImagesPullingTime="306.352576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:14:41.31995351 +0000 UTC m=+820.415862900" watchObservedRunningTime="2026-06-05 13:14:41.322315569 +0000 UTC m=+820.418224955" Jun 05 13:14:41.352339 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.352279 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8564547dc7-6hswc" podStartSLOduration=1.025498896 podStartE2EDuration="1.352263245s" totalImagesPullingTime="326.764349ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:14:41.35008742 +0000 UTC m=+820.445996808" watchObservedRunningTime="2026-06-05 13:14:41.352263245 +0000 UTC m=+820.448172657" Jun 05 13:14:41.385284 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.385225 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84d845b58f-42pzz" podStartSLOduration=0.994258165 podStartE2EDuration="1.385202787s" totalImagesPullingTime="390.944622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:14:41.384072093 +0000 UTC m=+820.479981483" watchObservedRunningTime="2026-06-05 13:14:41.385202787 +0000 UTC m=+820.481112176" Jun 05 13:14:41.410754 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.410717 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xlpd8"] Jun 05 13:14:41.411010 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.410930 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xlpd8" podUID="979347ef-6d20-475b-b0d3-6a61c3054127" containerName="authorino" containerID="cri-o://3484ab92b1f175c9b3e3bc04edf1b24ce3c0cab9294f26428061d3437104327b" gracePeriod=30 Jun 05 13:14:41.566820 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.566794 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k6kdz" Jun 05 13:14:41.569999 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.569975 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84d845b58f-42pzz" Jun 05 13:14:41.649948 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.649920 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xlpd8" Jun 05 13:14:41.673692 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.673667 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktvg4\" (UniqueName: \"kubernetes.io/projected/853d85b7-1207-439f-9b5f-fd0f3ae7081c-kube-api-access-ktvg4\") pod \"853d85b7-1207-439f-9b5f-fd0f3ae7081c\" (UID: \"853d85b7-1207-439f-9b5f-fd0f3ae7081c\") " Jun 05 13:14:41.673819 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.673706 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svsck\" (UniqueName: \"kubernetes.io/projected/b2006975-27d7-41a3-a1fc-5a641876e7d2-kube-api-access-svsck\") pod \"b2006975-27d7-41a3-a1fc-5a641876e7d2\" (UID: \"b2006975-27d7-41a3-a1fc-5a641876e7d2\") " Jun 05 13:14:41.675593 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.675564 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/853d85b7-1207-439f-9b5f-fd0f3ae7081c-kube-api-access-ktvg4" (OuterVolumeSpecName: "kube-api-access-ktvg4") pod "853d85b7-1207-439f-9b5f-fd0f3ae7081c" (UID: "853d85b7-1207-439f-9b5f-fd0f3ae7081c"). InnerVolumeSpecName "kube-api-access-ktvg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:14:41.675700 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.675645 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2006975-27d7-41a3-a1fc-5a641876e7d2-kube-api-access-svsck" (OuterVolumeSpecName: "kube-api-access-svsck") pod "b2006975-27d7-41a3-a1fc-5a641876e7d2" (UID: "b2006975-27d7-41a3-a1fc-5a641876e7d2"). InnerVolumeSpecName "kube-api-access-svsck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:14:41.774847 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.774754 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qt6m\" (UniqueName: \"kubernetes.io/projected/979347ef-6d20-475b-b0d3-6a61c3054127-kube-api-access-6qt6m\") pod \"979347ef-6d20-475b-b0d3-6a61c3054127\" (UID: \"979347ef-6d20-475b-b0d3-6a61c3054127\") " Jun 05 13:14:41.775031 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.775015 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktvg4\" (UniqueName: \"kubernetes.io/projected/853d85b7-1207-439f-9b5f-fd0f3ae7081c-kube-api-access-ktvg4\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:14:41.775101 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.775033 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svsck\" (UniqueName: \"kubernetes.io/projected/b2006975-27d7-41a3-a1fc-5a641876e7d2-kube-api-access-svsck\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:14:41.776771 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.776747 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/979347ef-6d20-475b-b0d3-6a61c3054127-kube-api-access-6qt6m" (OuterVolumeSpecName: "kube-api-access-6qt6m") pod "979347ef-6d20-475b-b0d3-6a61c3054127" (UID: "979347ef-6d20-475b-b0d3-6a61c3054127"). InnerVolumeSpecName "kube-api-access-6qt6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:14:41.876261 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:41.876234 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qt6m\" (UniqueName: \"kubernetes.io/projected/979347ef-6d20-475b-b0d3-6a61c3054127-kube-api-access-6qt6m\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:14:42.294063 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.294029 2567 generic.go:356] "Generic (PLEG): container finished" podID="853d85b7-1207-439f-9b5f-fd0f3ae7081c" containerID="56ccf2d757932a2851eb6a91065b003ca5cf4856ba07e8b84b7481b1f1fc8bf1" exitCode=0 Jun 05 13:14:42.294219 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.294071 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k6kdz" Jun 05 13:14:42.294219 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.294108 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k6kdz" event={"ID":"853d85b7-1207-439f-9b5f-fd0f3ae7081c","Type":"ContainerDied","Data":"56ccf2d757932a2851eb6a91065b003ca5cf4856ba07e8b84b7481b1f1fc8bf1"} Jun 05 13:14:42.294219 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.294157 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k6kdz" event={"ID":"853d85b7-1207-439f-9b5f-fd0f3ae7081c","Type":"ContainerDied","Data":"029f2074e1cf81140b9bb4ee2f64c46d3fbbd91a9a436e4ad1e87effeb233ac6"} Jun 05 13:14:42.294219 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.294181 2567 scope.go:117] "RemoveContainer" containerID="56ccf2d757932a2851eb6a91065b003ca5cf4856ba07e8b84b7481b1f1fc8bf1" Jun 05 13:14:42.295502 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.295337 2567 generic.go:356] "Generic (PLEG): container finished" podID="b2006975-27d7-41a3-a1fc-5a641876e7d2" containerID="4e529c7530923f2dfd78eb23b12368436f2900e08ac3f44c5610287709c84945" exitCode=0 Jun 05 13:14:42.295502 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.295369 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84d845b58f-42pzz" Jun 05 13:14:42.295502 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.295369 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84d845b58f-42pzz" event={"ID":"b2006975-27d7-41a3-a1fc-5a641876e7d2","Type":"ContainerDied","Data":"4e529c7530923f2dfd78eb23b12368436f2900e08ac3f44c5610287709c84945"} Jun 05 13:14:42.295502 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.295479 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84d845b58f-42pzz" event={"ID":"b2006975-27d7-41a3-a1fc-5a641876e7d2","Type":"ContainerDied","Data":"8c7c88e87e634e9948b2f683856f59a9a0314f9c74c11c9a2011eddbbb33f94f"} Jun 05 13:14:42.296797 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.296775 2567 generic.go:356] "Generic (PLEG): container finished" podID="979347ef-6d20-475b-b0d3-6a61c3054127" containerID="3484ab92b1f175c9b3e3bc04edf1b24ce3c0cab9294f26428061d3437104327b" exitCode=0 Jun 05 13:14:42.296917 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.296857 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xlpd8" event={"ID":"979347ef-6d20-475b-b0d3-6a61c3054127","Type":"ContainerDied","Data":"3484ab92b1f175c9b3e3bc04edf1b24ce3c0cab9294f26428061d3437104327b"} Jun 05 13:14:42.296917 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.296890 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xlpd8" event={"ID":"979347ef-6d20-475b-b0d3-6a61c3054127","Type":"ContainerDied","Data":"b4e6d163b6dc929a84ff0454937433a19309c1058eba8c2905957d8d5be6672c"} Jun 05 13:14:42.297006 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.296981 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xlpd8" Jun 05 13:14:42.303775 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.303757 2567 scope.go:117] "RemoveContainer" containerID="56ccf2d757932a2851eb6a91065b003ca5cf4856ba07e8b84b7481b1f1fc8bf1" Jun 05 13:14:42.304046 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:14:42.304024 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56ccf2d757932a2851eb6a91065b003ca5cf4856ba07e8b84b7481b1f1fc8bf1\": container with ID starting with 56ccf2d757932a2851eb6a91065b003ca5cf4856ba07e8b84b7481b1f1fc8bf1 not found: ID does not exist" containerID="56ccf2d757932a2851eb6a91065b003ca5cf4856ba07e8b84b7481b1f1fc8bf1" Jun 05 13:14:42.304100 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.304059 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56ccf2d757932a2851eb6a91065b003ca5cf4856ba07e8b84b7481b1f1fc8bf1"} err="failed to get container status \"56ccf2d757932a2851eb6a91065b003ca5cf4856ba07e8b84b7481b1f1fc8bf1\": rpc error: code = NotFound desc = could not find container \"56ccf2d757932a2851eb6a91065b003ca5cf4856ba07e8b84b7481b1f1fc8bf1\": container with ID starting with 56ccf2d757932a2851eb6a91065b003ca5cf4856ba07e8b84b7481b1f1fc8bf1 not found: ID does not exist" Jun 05 13:14:42.304100 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.304082 2567 scope.go:117] "RemoveContainer" containerID="4e529c7530923f2dfd78eb23b12368436f2900e08ac3f44c5610287709c84945" Jun 05 13:14:42.312328 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.312310 2567 scope.go:117] "RemoveContainer" containerID="4e529c7530923f2dfd78eb23b12368436f2900e08ac3f44c5610287709c84945" Jun 05 13:14:42.312555 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:14:42.312536 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e529c7530923f2dfd78eb23b12368436f2900e08ac3f44c5610287709c84945\": container with ID starting with 4e529c7530923f2dfd78eb23b12368436f2900e08ac3f44c5610287709c84945 not found: ID does not exist" containerID="4e529c7530923f2dfd78eb23b12368436f2900e08ac3f44c5610287709c84945" Jun 05 13:14:42.312640 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.312563 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e529c7530923f2dfd78eb23b12368436f2900e08ac3f44c5610287709c84945"} err="failed to get container status \"4e529c7530923f2dfd78eb23b12368436f2900e08ac3f44c5610287709c84945\": rpc error: code = NotFound desc = could not find container \"4e529c7530923f2dfd78eb23b12368436f2900e08ac3f44c5610287709c84945\": container with ID starting with 4e529c7530923f2dfd78eb23b12368436f2900e08ac3f44c5610287709c84945 not found: ID does not exist" Jun 05 13:14:42.312640 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.312578 2567 scope.go:117] "RemoveContainer" containerID="3484ab92b1f175c9b3e3bc04edf1b24ce3c0cab9294f26428061d3437104327b" Jun 05 13:14:42.319150 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.319134 2567 scope.go:117] "RemoveContainer" containerID="3484ab92b1f175c9b3e3bc04edf1b24ce3c0cab9294f26428061d3437104327b" Jun 05 13:14:42.319427 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:14:42.319408 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3484ab92b1f175c9b3e3bc04edf1b24ce3c0cab9294f26428061d3437104327b\": container with ID starting with 3484ab92b1f175c9b3e3bc04edf1b24ce3c0cab9294f26428061d3437104327b not found: ID does not exist" containerID="3484ab92b1f175c9b3e3bc04edf1b24ce3c0cab9294f26428061d3437104327b" Jun 05 13:14:42.319479 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.319432 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3484ab92b1f175c9b3e3bc04edf1b24ce3c0cab9294f26428061d3437104327b"} err="failed to get container status \"3484ab92b1f175c9b3e3bc04edf1b24ce3c0cab9294f26428061d3437104327b\": rpc error: code = NotFound desc = could not find container \"3484ab92b1f175c9b3e3bc04edf1b24ce3c0cab9294f26428061d3437104327b\": container with ID starting with 3484ab92b1f175c9b3e3bc04edf1b24ce3c0cab9294f26428061d3437104327b not found: ID does not exist" Jun 05 13:14:42.324031 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.324011 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xlpd8"] Jun 05 13:14:42.330145 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.330127 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xlpd8"] Jun 05 13:14:42.346499 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.346477 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84d845b58f-42pzz"] Jun 05 13:14:42.352272 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.352255 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-84d845b58f-42pzz"] Jun 05 13:14:42.366422 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.366401 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k6kdz"] Jun 05 13:14:42.370849 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:42.370829 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k6kdz"] Jun 05 13:14:43.380185 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:43.380153 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="853d85b7-1207-439f-9b5f-fd0f3ae7081c" path="/var/lib/kubelet/pods/853d85b7-1207-439f-9b5f-fd0f3ae7081c/volumes" Jun 05 13:14:43.380550 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:43.380493 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="979347ef-6d20-475b-b0d3-6a61c3054127" path="/var/lib/kubelet/pods/979347ef-6d20-475b-b0d3-6a61c3054127/volumes" Jun 05 13:14:43.380761 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:14:43.380748 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2006975-27d7-41a3-a1fc-5a641876e7d2" path="/var/lib/kubelet/pods/b2006975-27d7-41a3-a1fc-5a641876e7d2/volumes" Jun 05 13:15:29.487847 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:29.487813 2567 generic.go:356] "Generic (PLEG): container finished" podID="8e600146-a968-4105-b148-1320d4d99629" containerID="4e11f4f79c89927ae218429fe05fcc06128857621a3a6c46d9b0b239b29f17a0" exitCode=0 Jun 05 13:15:29.488320 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:29.487853 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" event={"ID":"8e600146-a968-4105-b148-1320d4d99629","Type":"ContainerDied","Data":"4e11f4f79c89927ae218429fe05fcc06128857621a3a6c46d9b0b239b29f17a0"} Jun 05 13:15:29.488320 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:29.488207 2567 scope.go:117] "RemoveContainer" containerID="4e11f4f79c89927ae218429fe05fcc06128857621a3a6c46d9b0b239b29f17a0" Jun 05 13:15:29.489125 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:29.489093 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:15:29.489220 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:29.489181 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:15:29.489279 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:29.489234 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:15:30.496907 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:30.496863 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" event={"ID":"8e600146-a968-4105-b148-1320d4d99629","Type":"ContainerStarted","Data":"449b4e4f027ee4f8719cb18ada8e7aaf0e5262fa3c5688bc397ca83bc6988875"} Jun 05 13:15:30.773754 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:30.773655 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:15:30.773905 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:30.773880 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-sfxfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" start-of-body= Jun 05 13:15:30.773957 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:30.773929 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" podUID="8e600146-a968-4105-b148-1320d4d99629" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" Jun 05 13:15:31.774693 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:31.774647 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-sfxfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" start-of-body= Jun 05 13:15:31.775119 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:31.774724 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" podUID="8e600146-a968-4105-b148-1320d4d99629" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" Jun 05 13:15:32.774143 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:32.774101 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-sfxfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" start-of-body= Jun 05 13:15:32.774342 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:32.774169 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" podUID="8e600146-a968-4105-b148-1320d4d99629" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" Jun 05 13:15:33.774241 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:33.774205 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-sfxfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" start-of-body= Jun 05 13:15:33.774626 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:33.774278 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" podUID="8e600146-a968-4105-b148-1320d4d99629" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" Jun 05 13:15:34.777438 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:34.777407 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:15:34.777796 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:34.777778 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:15:34.778372 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:15:34.778351 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfxfl" Jun 05 13:16:01.373755 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:01.373679 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-57l6g_d5bf6331-1821-4fe3-b7ea-65575785f4ec/ovn-acl-logging/0.log" Jun 05 13:16:01.374333 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:01.373781 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-57l6g_d5bf6331-1821-4fe3-b7ea-65575785f4ec/ovn-acl-logging/0.log" Jun 05 13:16:10.996141 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:10.996106 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d4c4dd4bf-65m6m"] Jun 05 13:16:10.996798 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:10.996420 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="979347ef-6d20-475b-b0d3-6a61c3054127" containerName="authorino" Jun 05 13:16:10.996798 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:10.996432 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="979347ef-6d20-475b-b0d3-6a61c3054127" containerName="authorino" Jun 05 13:16:10.996798 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:10.996445 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2006975-27d7-41a3-a1fc-5a641876e7d2" containerName="authorino" Jun 05 13:16:10.996798 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:10.996451 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2006975-27d7-41a3-a1fc-5a641876e7d2" containerName="authorino" Jun 05 13:16:10.996798 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:10.996462 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="853d85b7-1207-439f-9b5f-fd0f3ae7081c" containerName="authorino" Jun 05 13:16:10.996798 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:10.996468 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="853d85b7-1207-439f-9b5f-fd0f3ae7081c" containerName="authorino" Jun 05 13:16:10.996798 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:10.996514 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2006975-27d7-41a3-a1fc-5a641876e7d2" containerName="authorino" Jun 05 13:16:10.996798 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:10.996524 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="853d85b7-1207-439f-9b5f-fd0f3ae7081c" containerName="authorino" Jun 05 13:16:10.996798 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:10.996530 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="979347ef-6d20-475b-b0d3-6a61c3054127" containerName="authorino" Jun 05 13:16:10.999308 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:10.999282 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" Jun 05 13:16:11.001845 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.001827 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 05 13:16:11.007995 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.007972 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d4c4dd4bf-65m6m"] Jun 05 13:16:11.022693 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.022669 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-tls-cert\") pod \"authorino-7d4c4dd4bf-65m6m\" (UID: \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\") " pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" Jun 05 13:16:11.022804 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.022741 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-oidc-ca\") pod \"authorino-7d4c4dd4bf-65m6m\" (UID: \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\") " pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" Jun 05 13:16:11.022804 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.022770 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28w7r\" (UniqueName: \"kubernetes.io/projected/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-kube-api-access-28w7r\") pod \"authorino-7d4c4dd4bf-65m6m\" (UID: \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\") " pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" Jun 05 13:16:11.123781 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.123749 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-oidc-ca\") pod \"authorino-7d4c4dd4bf-65m6m\" (UID: \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\") " pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" Jun 05 13:16:11.123781 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.123790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28w7r\" (UniqueName: \"kubernetes.io/projected/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-kube-api-access-28w7r\") pod \"authorino-7d4c4dd4bf-65m6m\" (UID: \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\") " pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" Jun 05 13:16:11.123980 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.123824 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-tls-cert\") pod \"authorino-7d4c4dd4bf-65m6m\" (UID: \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\") " pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" Jun 05 13:16:11.124559 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.124540 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-oidc-ca\") pod \"authorino-7d4c4dd4bf-65m6m\" (UID: \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\") " pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" Jun 05 13:16:11.126221 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.126203 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-tls-cert\") pod \"authorino-7d4c4dd4bf-65m6m\" (UID: \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\") " pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" Jun 05 13:16:11.132114 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.132091 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28w7r\" (UniqueName: \"kubernetes.io/projected/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-kube-api-access-28w7r\") pod \"authorino-7d4c4dd4bf-65m6m\" (UID: \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\") " pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" Jun 05 13:16:11.309325 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.309222 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" Jun 05 13:16:11.436606 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.436575 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d4c4dd4bf-65m6m"] Jun 05 13:16:11.439992 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:16:11.439967 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ee4b89a_4853_4007_bcdf_e27aaa8013c2.slice/crio-f817cb1b5680e7bfe194e67d718a8e0c4467509b490d2c3c0bf2575ef7a92ddd WatchSource:0}: Error finding container f817cb1b5680e7bfe194e67d718a8e0c4467509b490d2c3c0bf2575ef7a92ddd: Status 404 returned error can't find the container with id f817cb1b5680e7bfe194e67d718a8e0c4467509b490d2c3c0bf2575ef7a92ddd Jun 05 13:16:11.441379 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.441360 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:16:11.658750 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:11.658714 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" event={"ID":"5ee4b89a-4853-4007-bcdf-e27aaa8013c2","Type":"ContainerStarted","Data":"f817cb1b5680e7bfe194e67d718a8e0c4467509b490d2c3c0bf2575ef7a92ddd"} Jun 05 13:16:12.664752 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:12.664718 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" event={"ID":"5ee4b89a-4853-4007-bcdf-e27aaa8013c2","Type":"ContainerStarted","Data":"038e3a169a2bf6bc8e069534b1065628074ffc51b09aecdb2ed1741604a45d04"} Jun 05 13:16:12.682672 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:12.682622 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" podStartSLOduration=2.375019952 podStartE2EDuration="2.682608076s" totalImagesPullingTime="307.588124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:16:12.681228676 +0000 UTC m=+911.777138066" watchObservedRunningTime="2026-06-05 13:16:12.682608076 +0000 UTC m=+911.778517464" Jun 05 13:16:12.712433 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:12.710621 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8564547dc7-6hswc"] Jun 05 13:16:12.712433 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:12.710859 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-8564547dc7-6hswc" podUID="e77fec43-e670-443f-8fd4-db40d4d4da4c" containerName="authorino" containerID="cri-o://a2cd1c9aea9a24ce3fe853ab442fe1b719076540355b22c73ec58d135a18ec01" gracePeriod=30 Jun 05 13:16:12.972721 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:12.972697 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8564547dc7-6hswc" Jun 05 13:16:13.041515 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.041478 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j57p\" (UniqueName: \"kubernetes.io/projected/e77fec43-e670-443f-8fd4-db40d4d4da4c-kube-api-access-5j57p\") pod \"e77fec43-e670-443f-8fd4-db40d4d4da4c\" (UID: \"e77fec43-e670-443f-8fd4-db40d4d4da4c\") " Jun 05 13:16:13.041686 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.041533 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e77fec43-e670-443f-8fd4-db40d4d4da4c-tls-cert\") pod \"e77fec43-e670-443f-8fd4-db40d4d4da4c\" (UID: \"e77fec43-e670-443f-8fd4-db40d4d4da4c\") " Jun 05 13:16:13.043583 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.043555 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e77fec43-e670-443f-8fd4-db40d4d4da4c-kube-api-access-5j57p" (OuterVolumeSpecName: "kube-api-access-5j57p") pod "e77fec43-e670-443f-8fd4-db40d4d4da4c" (UID: "e77fec43-e670-443f-8fd4-db40d4d4da4c"). InnerVolumeSpecName "kube-api-access-5j57p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:16:13.050717 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.050693 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e77fec43-e670-443f-8fd4-db40d4d4da4c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e77fec43-e670-443f-8fd4-db40d4d4da4c" (UID: "e77fec43-e670-443f-8fd4-db40d4d4da4c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:16:13.143036 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.143001 2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e77fec43-e670-443f-8fd4-db40d4d4da4c-tls-cert\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:16:13.143036 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.143029 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j57p\" (UniqueName: \"kubernetes.io/projected/e77fec43-e670-443f-8fd4-db40d4d4da4c-kube-api-access-5j57p\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:16:13.670208 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.670112 2567 generic.go:356] "Generic (PLEG): container finished" podID="e77fec43-e670-443f-8fd4-db40d4d4da4c" containerID="a2cd1c9aea9a24ce3fe853ab442fe1b719076540355b22c73ec58d135a18ec01" exitCode=0 Jun 05 13:16:13.670208 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.670159 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8564547dc7-6hswc" Jun 05 13:16:13.670208 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.670192 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8564547dc7-6hswc" event={"ID":"e77fec43-e670-443f-8fd4-db40d4d4da4c","Type":"ContainerDied","Data":"a2cd1c9aea9a24ce3fe853ab442fe1b719076540355b22c73ec58d135a18ec01"} Jun 05 13:16:13.670702 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.670239 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8564547dc7-6hswc" event={"ID":"e77fec43-e670-443f-8fd4-db40d4d4da4c","Type":"ContainerDied","Data":"f78b591813376b8c8915409836a5b28e53a7288dd454f4847f6f209d7196ab7b"} Jun 05 13:16:13.670702 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.670264 2567 scope.go:117] "RemoveContainer" containerID="a2cd1c9aea9a24ce3fe853ab442fe1b719076540355b22c73ec58d135a18ec01" Jun 05 13:16:13.678624 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.678603 2567 scope.go:117] "RemoveContainer" containerID="a2cd1c9aea9a24ce3fe853ab442fe1b719076540355b22c73ec58d135a18ec01" Jun 05 13:16:13.678894 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:16:13.678873 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2cd1c9aea9a24ce3fe853ab442fe1b719076540355b22c73ec58d135a18ec01\": container with ID starting with a2cd1c9aea9a24ce3fe853ab442fe1b719076540355b22c73ec58d135a18ec01 not found: ID does not exist" containerID="a2cd1c9aea9a24ce3fe853ab442fe1b719076540355b22c73ec58d135a18ec01" Jun 05 13:16:13.678942 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.678902 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2cd1c9aea9a24ce3fe853ab442fe1b719076540355b22c73ec58d135a18ec01"} err="failed to get container status \"a2cd1c9aea9a24ce3fe853ab442fe1b719076540355b22c73ec58d135a18ec01\": rpc error: code = NotFound desc = could not find container \"a2cd1c9aea9a24ce3fe853ab442fe1b719076540355b22c73ec58d135a18ec01\": container with ID starting with a2cd1c9aea9a24ce3fe853ab442fe1b719076540355b22c73ec58d135a18ec01 not found: ID does not exist" Jun 05 13:16:13.686050 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.686028 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8564547dc7-6hswc"] Jun 05 13:16:13.691722 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:13.691701 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8564547dc7-6hswc"] Jun 05 13:16:15.380588 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:16:15.380556 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e77fec43-e670-443f-8fd4-db40d4d4da4c" path="/var/lib/kubelet/pods/e77fec43-e670-443f-8fd4-db40d4d4da4c/volumes" Jun 05 13:21:01.403412 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:01.403384 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-57l6g_d5bf6331-1821-4fe3-b7ea-65575785f4ec/ovn-acl-logging/0.log" Jun 05 13:21:01.406062 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:01.405132 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-57l6g_d5bf6331-1821-4fe3-b7ea-65575785f4ec/ovn-acl-logging/0.log" Jun 05 13:21:16.127083 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.127045 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5655bc6cbd-bfwjr"] Jun 05 13:21:16.127478 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.127349 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e77fec43-e670-443f-8fd4-db40d4d4da4c" containerName="authorino" Jun 05 13:21:16.127478 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.127361 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e77fec43-e670-443f-8fd4-db40d4d4da4c" containerName="authorino" Jun 05 13:21:16.127478 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.127423 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e77fec43-e670-443f-8fd4-db40d4d4da4c" containerName="authorino" Jun 05 13:21:16.130054 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.130035 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" Jun 05 13:21:16.151490 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.151460 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5655bc6cbd-bfwjr"] Jun 05 13:21:16.195890 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.195850 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/445295c9-7a6d-426d-b260-aac88148e27e-oidc-ca\") pod \"authorino-5655bc6cbd-bfwjr\" (UID: \"445295c9-7a6d-426d-b260-aac88148e27e\") " pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" Jun 05 13:21:16.196093 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.195902 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/445295c9-7a6d-426d-b260-aac88148e27e-tls-cert\") pod \"authorino-5655bc6cbd-bfwjr\" (UID: \"445295c9-7a6d-426d-b260-aac88148e27e\") " pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" Jun 05 13:21:16.196093 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.196011 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jdnh\" (UniqueName: \"kubernetes.io/projected/445295c9-7a6d-426d-b260-aac88148e27e-kube-api-access-6jdnh\") pod \"authorino-5655bc6cbd-bfwjr\" (UID: \"445295c9-7a6d-426d-b260-aac88148e27e\") " pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" Jun 05 13:21:16.296695 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.296659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/445295c9-7a6d-426d-b260-aac88148e27e-tls-cert\") pod \"authorino-5655bc6cbd-bfwjr\" (UID: \"445295c9-7a6d-426d-b260-aac88148e27e\") " pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" Jun 05 13:21:16.296877 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.296709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jdnh\" (UniqueName: \"kubernetes.io/projected/445295c9-7a6d-426d-b260-aac88148e27e-kube-api-access-6jdnh\") pod \"authorino-5655bc6cbd-bfwjr\" (UID: \"445295c9-7a6d-426d-b260-aac88148e27e\") " pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" Jun 05 13:21:16.296877 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.296750 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/445295c9-7a6d-426d-b260-aac88148e27e-oidc-ca\") pod \"authorino-5655bc6cbd-bfwjr\" (UID: \"445295c9-7a6d-426d-b260-aac88148e27e\") " pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" Jun 05 13:21:16.297454 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.297434 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/445295c9-7a6d-426d-b260-aac88148e27e-oidc-ca\") pod \"authorino-5655bc6cbd-bfwjr\" (UID: \"445295c9-7a6d-426d-b260-aac88148e27e\") " pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" Jun 05 13:21:16.299076 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.299053 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/445295c9-7a6d-426d-b260-aac88148e27e-tls-cert\") pod \"authorino-5655bc6cbd-bfwjr\" (UID: \"445295c9-7a6d-426d-b260-aac88148e27e\") " pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" Jun 05 13:21:16.304606 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.304582 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jdnh\" (UniqueName: \"kubernetes.io/projected/445295c9-7a6d-426d-b260-aac88148e27e-kube-api-access-6jdnh\") pod \"authorino-5655bc6cbd-bfwjr\" (UID: \"445295c9-7a6d-426d-b260-aac88148e27e\") " pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" Jun 05 13:21:16.438245 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.438148 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" Jun 05 13:21:16.569807 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.569777 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5655bc6cbd-bfwjr"] Jun 05 13:21:16.573181 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:21:16.573153 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod445295c9_7a6d_426d_b260_aac88148e27e.slice/crio-2918f730d5a2a665fd696c03da5c976e808c167a68278439769787ab88058101 WatchSource:0}: Error finding container 2918f730d5a2a665fd696c03da5c976e808c167a68278439769787ab88058101: Status 404 returned error can't find the container with id 2918f730d5a2a665fd696c03da5c976e808c167a68278439769787ab88058101 Jun 05 13:21:16.574504 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.574484 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:21:16.894057 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:16.894024 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" event={"ID":"445295c9-7a6d-426d-b260-aac88148e27e","Type":"ContainerStarted","Data":"2918f730d5a2a665fd696c03da5c976e808c167a68278439769787ab88058101"} Jun 05 13:21:17.901010 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:17.900974 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" event={"ID":"445295c9-7a6d-426d-b260-aac88148e27e","Type":"ContainerStarted","Data":"5a205506ddfedad81a14664dbb77b33ff39a6f1754855a728161b7a67ad2971a"} Jun 05 13:21:17.921776 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:17.921710 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5655bc6cbd-bfwjr" podStartSLOduration=1.364249751 podStartE2EDuration="1.921689074s" totalImagesPullingTime="557.439323ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:21:17.91951103 +0000 UTC m=+1217.015420402" watchObservedRunningTime="2026-06-05 13:21:17.921689074 +0000 UTC m=+1217.017598464" Jun 05 13:21:17.962284 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:17.962235 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d4c4dd4bf-65m6m"] Jun 05 13:21:17.963131 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:17.963087 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" podUID="5ee4b89a-4853-4007-bcdf-e27aaa8013c2" containerName="authorino" containerID="cri-o://038e3a169a2bf6bc8e069534b1065628074ffc51b09aecdb2ed1741604a45d04" gracePeriod=30 Jun 05 13:21:18.217245 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.217218 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" Jun 05 13:21:18.314043 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.314003 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-tls-cert\") pod \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\" (UID: \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\") " Jun 05 13:21:18.314214 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.314131 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-oidc-ca\") pod \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\" (UID: \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\") " Jun 05 13:21:18.314214 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.314179 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28w7r\" (UniqueName: \"kubernetes.io/projected/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-kube-api-access-28w7r\") pod \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\" (UID: \"5ee4b89a-4853-4007-bcdf-e27aaa8013c2\") " Jun 05 13:21:18.316234 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.316197 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-kube-api-access-28w7r" (OuterVolumeSpecName: "kube-api-access-28w7r") pod "5ee4b89a-4853-4007-bcdf-e27aaa8013c2" (UID: "5ee4b89a-4853-4007-bcdf-e27aaa8013c2"). InnerVolumeSpecName "kube-api-access-28w7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:21:18.318397 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.318371 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "5ee4b89a-4853-4007-bcdf-e27aaa8013c2" (UID: "5ee4b89a-4853-4007-bcdf-e27aaa8013c2"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:21:18.322653 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.322629 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5ee4b89a-4853-4007-bcdf-e27aaa8013c2" (UID: "5ee4b89a-4853-4007-bcdf-e27aaa8013c2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:21:18.415086 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.415050 2567 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-oidc-ca\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:21:18.415086 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.415081 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28w7r\" (UniqueName: \"kubernetes.io/projected/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-kube-api-access-28w7r\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:21:18.415086 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.415094 2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5ee4b89a-4853-4007-bcdf-e27aaa8013c2-tls-cert\") on node \"ip-10-0-129-41.ec2.internal\" DevicePath \"\"" Jun 05 13:21:18.905708 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.905671 2567 generic.go:356] "Generic (PLEG): container finished" podID="5ee4b89a-4853-4007-bcdf-e27aaa8013c2" containerID="038e3a169a2bf6bc8e069534b1065628074ffc51b09aecdb2ed1741604a45d04" exitCode=0 Jun 05 13:21:18.906151 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.905713 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" Jun 05 13:21:18.906151 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.905757 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" event={"ID":"5ee4b89a-4853-4007-bcdf-e27aaa8013c2","Type":"ContainerDied","Data":"038e3a169a2bf6bc8e069534b1065628074ffc51b09aecdb2ed1741604a45d04"} Jun 05 13:21:18.906151 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.905809 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d4c4dd4bf-65m6m" event={"ID":"5ee4b89a-4853-4007-bcdf-e27aaa8013c2","Type":"ContainerDied","Data":"f817cb1b5680e7bfe194e67d718a8e0c4467509b490d2c3c0bf2575ef7a92ddd"} Jun 05 13:21:18.906151 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.905844 2567 scope.go:117] "RemoveContainer" containerID="038e3a169a2bf6bc8e069534b1065628074ffc51b09aecdb2ed1741604a45d04" Jun 05 13:21:18.914031 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.914014 2567 scope.go:117] "RemoveContainer" containerID="038e3a169a2bf6bc8e069534b1065628074ffc51b09aecdb2ed1741604a45d04" Jun 05 13:21:18.914262 ip-10-0-129-41 kubenswrapper[2567]: E0605 13:21:18.914246 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"038e3a169a2bf6bc8e069534b1065628074ffc51b09aecdb2ed1741604a45d04\": container with ID starting with 038e3a169a2bf6bc8e069534b1065628074ffc51b09aecdb2ed1741604a45d04 not found: ID does not exist" containerID="038e3a169a2bf6bc8e069534b1065628074ffc51b09aecdb2ed1741604a45d04" Jun 05 13:21:18.914350 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.914270 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"038e3a169a2bf6bc8e069534b1065628074ffc51b09aecdb2ed1741604a45d04"} err="failed to get container status \"038e3a169a2bf6bc8e069534b1065628074ffc51b09aecdb2ed1741604a45d04\": rpc error: code = NotFound desc = could not find container \"038e3a169a2bf6bc8e069534b1065628074ffc51b09aecdb2ed1741604a45d04\": container with ID starting with 038e3a169a2bf6bc8e069534b1065628074ffc51b09aecdb2ed1741604a45d04 not found: ID does not exist" Jun 05 13:21:18.925391 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.925368 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d4c4dd4bf-65m6m"] Jun 05 13:21:18.929491 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:18.929472 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d4c4dd4bf-65m6m"] Jun 05 13:21:19.380379 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:19.380348 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ee4b89a-4853-4007-bcdf-e27aaa8013c2" path="/var/lib/kubelet/pods/5ee4b89a-4853-4007-bcdf-e27aaa8013c2/volumes" Jun 05 13:21:57.318434 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:21:57.318351 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5655bc6cbd-bfwjr_445295c9-7a6d-426d-b260-aac88148e27e/authorino/0.log" Jun 05 13:22:01.763841 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:01.763750 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-69fcb86bc6-4dxm7_486bd983-24bc-4734-b618-c0db5bdb4d5c/nginx/0.log" Jun 05 13:22:02.941910 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:02.941876 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-785744655b-v4wnd_4cd88427-d8b7-4306-926b-e937c35d1d22/manager/0.log" Jun 05 13:22:02.952528 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:02.952507 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-785744655b-v4wnd_4cd88427-d8b7-4306-926b-e937c35d1d22/copy-manifests/0.log" Jun 05 13:22:03.061966 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:03.061941 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wtl9h_8337ab60-2567-4eb7-8091-5339fcd201c5/postgres/0.log" Jun 05 13:22:04.359576 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:04.359529 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5655bc6cbd-bfwjr_445295c9-7a6d-426d-b260-aac88148e27e/authorino/0.log" Jun 05 13:22:05.194417 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:05.194381 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rnxz4_8794e4c2-f426-47f9-8d01-035d8c7c789f/manager/0.log" Jun 05 13:22:05.556571 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:05.556493 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795cw2cs_a5fe91c4-5380-4a7b-8e9a-874b3cad5d80/istio-proxy/0.log" Jun 05 13:22:06.038886 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:06.038853 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfxfl_8e600146-a968-4105-b148-1320d4d99629/istio-proxy/1.log" Jun 05 13:22:11.555434 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.555392 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fnzwf/must-gather-5fzgb"] Jun 05 13:22:11.555790 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.555682 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee4b89a-4853-4007-bcdf-e27aaa8013c2" containerName="authorino" Jun 05 13:22:11.555790 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.555692 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee4b89a-4853-4007-bcdf-e27aaa8013c2" containerName="authorino" Jun 05 13:22:11.555790 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.555741 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee4b89a-4853-4007-bcdf-e27aaa8013c2" containerName="authorino" Jun 05 13:22:11.559783 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.559767 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fnzwf/must-gather-5fzgb" Jun 05 13:22:11.562427 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.562401 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fnzwf\"/\"kube-root-ca.crt\"" Jun 05 13:22:11.562550 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.562408 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fnzwf\"/\"openshift-service-ca.crt\"" Jun 05 13:22:11.562550 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.562449 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fnzwf\"/\"default-dockercfg-b24jj\"" Jun 05 13:22:11.569204 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.569185 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fnzwf/must-gather-5fzgb"] Jun 05 13:22:11.661261 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.661229 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/12a5c3dd-b453-4b62-9cb2-85dd53950d17-must-gather-output\") pod \"must-gather-5fzgb\" (UID: \"12a5c3dd-b453-4b62-9cb2-85dd53950d17\") " pod="openshift-must-gather-fnzwf/must-gather-5fzgb" Jun 05 13:22:11.661451 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.661272 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b895r\" (UniqueName: \"kubernetes.io/projected/12a5c3dd-b453-4b62-9cb2-85dd53950d17-kube-api-access-b895r\") pod \"must-gather-5fzgb\" (UID: \"12a5c3dd-b453-4b62-9cb2-85dd53950d17\") " pod="openshift-must-gather-fnzwf/must-gather-5fzgb" Jun 05 13:22:11.762374 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.762337 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/12a5c3dd-b453-4b62-9cb2-85dd53950d17-must-gather-output\") pod \"must-gather-5fzgb\" (UID: \"12a5c3dd-b453-4b62-9cb2-85dd53950d17\") " pod="openshift-must-gather-fnzwf/must-gather-5fzgb" Jun 05 13:22:11.762374 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.762377 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b895r\" (UniqueName: \"kubernetes.io/projected/12a5c3dd-b453-4b62-9cb2-85dd53950d17-kube-api-access-b895r\") pod \"must-gather-5fzgb\" (UID: \"12a5c3dd-b453-4b62-9cb2-85dd53950d17\") " pod="openshift-must-gather-fnzwf/must-gather-5fzgb" Jun 05 13:22:11.762771 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.762751 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/12a5c3dd-b453-4b62-9cb2-85dd53950d17-must-gather-output\") pod \"must-gather-5fzgb\" (UID: \"12a5c3dd-b453-4b62-9cb2-85dd53950d17\") " pod="openshift-must-gather-fnzwf/must-gather-5fzgb" Jun 05 13:22:11.771258 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.771237 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b895r\" (UniqueName: \"kubernetes.io/projected/12a5c3dd-b453-4b62-9cb2-85dd53950d17-kube-api-access-b895r\") pod \"must-gather-5fzgb\" (UID: \"12a5c3dd-b453-4b62-9cb2-85dd53950d17\") " pod="openshift-must-gather-fnzwf/must-gather-5fzgb" Jun 05 13:22:11.869779 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:11.869691 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fnzwf/must-gather-5fzgb" Jun 05 13:22:12.002075 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:12.001932 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fnzwf/must-gather-5fzgb"] Jun 05 13:22:12.004922 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:22:12.004891 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12a5c3dd_b453_4b62_9cb2_85dd53950d17.slice/crio-987d16038ba22bdc76dec3d4b2283abef0a92cc41a71f9fe937af7e1b4587606 WatchSource:0}: Error finding container 987d16038ba22bdc76dec3d4b2283abef0a92cc41a71f9fe937af7e1b4587606: Status 404 returned error can't find the container with id 987d16038ba22bdc76dec3d4b2283abef0a92cc41a71f9fe937af7e1b4587606 Jun 05 13:22:12.123513 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:12.123428 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnzwf/must-gather-5fzgb" event={"ID":"12a5c3dd-b453-4b62-9cb2-85dd53950d17","Type":"ContainerStarted","Data":"987d16038ba22bdc76dec3d4b2283abef0a92cc41a71f9fe937af7e1b4587606"} Jun 05 13:22:13.131321 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:13.131236 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnzwf/must-gather-5fzgb" event={"ID":"12a5c3dd-b453-4b62-9cb2-85dd53950d17","Type":"ContainerStarted","Data":"f0009b750cc2c1d02eb588df5bc1b11ef792edfb63b8fe649b23025fe92b98b4"} Jun 05 13:22:14.137642 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:14.137610 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnzwf/must-gather-5fzgb" event={"ID":"12a5c3dd-b453-4b62-9cb2-85dd53950d17","Type":"ContainerStarted","Data":"9a485295892de88b2c6a9820b0eaaacdffabfd5361a20d44f459545b837e74ad"} Jun 05 13:22:14.158612 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:14.158546 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fnzwf/must-gather-5fzgb" podStartSLOduration=2.175700214 podStartE2EDuration="3.158525541s" totalImagesPullingTime="982.825327ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:22:14.156527466 +0000 UTC m=+1273.252436855" watchObservedRunningTime="2026-06-05 13:22:14.158525541 +0000 UTC m=+1273.254434932" Jun 05 13:22:14.773096 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:14.773068 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jkcwh_9ba01329-9a7f-41c0-bdd0-2e0877800815/global-pull-secret-syncer/0.log" Jun 05 13:22:14.938707 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:14.938676 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n2zjb_ac4dfe8d-bf55-4914-a0d8-e1488fb959fe/konnectivity-agent/0.log" Jun 05 13:22:14.963553 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:14.963522 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-41.ec2.internal_28389313146ae7cbd001561ce72544af/haproxy/0.log" Jun 05 13:22:19.895317 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:19.895097 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5655bc6cbd-bfwjr_445295c9-7a6d-426d-b260-aac88148e27e/authorino/0.log" Jun 05 13:22:20.138200 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:20.138162 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rnxz4_8794e4c2-f426-47f9-8d01-035d8c7c789f/manager/0.log" Jun 05 13:22:21.976003 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:21.975976 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78bc44565c-j8gnp_0f9a4fe0-df93-467f-a561-19d833dfe9f4/metrics-server/0.log" Jun 05 13:22:22.142613 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:22.142586 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9mh2_ddaa23f4-288a-49c4-8205-a74f2abfe255/node-exporter/0.log" Jun 05 13:22:22.164207 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:22.164182 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9mh2_ddaa23f4-288a-49c4-8205-a74f2abfe255/kube-rbac-proxy/0.log" Jun 05 13:22:22.189067 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:22.189031 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9mh2_ddaa23f4-288a-49c4-8205-a74f2abfe255/init-textfile/0.log" Jun 05 13:22:25.334578 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.334538 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6"] Jun 05 13:22:25.339808 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.339783 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.348421 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.348393 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6"] Jun 05 13:22:25.411317 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.411200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-podres\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.411317 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.411278 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-972cs\" (UniqueName: \"kubernetes.io/projected/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-kube-api-access-972cs\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.411586 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.411340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-sys\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.411586 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.411372 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-lib-modules\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.411586 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.411446 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-proc\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.512872 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.512834 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-proc\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.513047 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.512894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-podres\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.513047 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.512954 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-972cs\" (UniqueName: \"kubernetes.io/projected/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-kube-api-access-972cs\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.513047 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.512990 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-proc\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.513191 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.513115 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-podres\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.513191 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.513174 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-sys\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.513288 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.513222 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-lib-modules\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.513288 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.513277 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-sys\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.513440 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.513420 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-lib-modules\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.521287 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.521264 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-972cs\" (UniqueName: \"kubernetes.io/projected/04e8eb75-1ed2-4ad5-8fe0-5f256f209834-kube-api-access-972cs\") pod \"perf-node-gather-daemonset-mcbb6\" (UID: \"04e8eb75-1ed2-4ad5-8fe0-5f256f209834\") " pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.655142 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.655108 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:25.828899 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:25.828858 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6"] Jun 05 13:22:25.836160 ip-10-0-129-41 kubenswrapper[2567]: W0605 13:22:25.832262 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod04e8eb75_1ed2_4ad5_8fe0_5f256f209834.slice/crio-21ad771d31493068c301dd7d9cb4f390b73cfd8b12dda430557a7bc6dad17644 WatchSource:0}: Error finding container 21ad771d31493068c301dd7d9cb4f390b73cfd8b12dda430557a7bc6dad17644: Status 404 returned error can't find the container with id 21ad771d31493068c301dd7d9cb4f390b73cfd8b12dda430557a7bc6dad17644 Jun 05 13:22:26.239091 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:26.239008 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" event={"ID":"04e8eb75-1ed2-4ad5-8fe0-5f256f209834","Type":"ContainerStarted","Data":"4d9d488319eddb7f92906838b9ed52095cb8a9aef8d91ade25da8d2490604324"} Jun 05 13:22:26.239258 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:26.239097 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" event={"ID":"04e8eb75-1ed2-4ad5-8fe0-5f256f209834","Type":"ContainerStarted","Data":"21ad771d31493068c301dd7d9cb4f390b73cfd8b12dda430557a7bc6dad17644"} Jun 05 13:22:26.239258 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:26.239154 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:27.206258 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:27.206230 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gjjrg_66185e84-4ad4-4cc9-ba1f-7aeee8766740/dns/0.log" Jun 05 13:22:27.226574 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:27.226530 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gjjrg_66185e84-4ad4-4cc9-ba1f-7aeee8766740/kube-rbac-proxy/0.log" Jun 05 13:22:27.344584 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:27.344553 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xppfg_36ce25a6-fa50-41db-b03f-f156bba97276/dns-node-resolver/0.log" Jun 05 13:22:27.888138 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:27.888104 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-588cb6756-kfj87_122a57d4-1c1b-4c5f-91f5-b945bb8e5f51/registry/0.log" Jun 05 13:22:27.896449 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:27.896390 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-588cb6756-kfj87_122a57d4-1c1b-4c5f-91f5-b945bb8e5f51/registry/1.log" Jun 05 13:22:27.944247 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:27.944218 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-clw7t_21a97422-63c7-4f86-8a0f-5b26c892c724/node-ca/0.log" Jun 05 13:22:28.938079 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:28.938050 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795cw2cs_a5fe91c4-5380-4a7b-8e9a-874b3cad5d80/istio-proxy/0.log" Jun 05 13:22:29.057141 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:29.057103 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfxfl_8e600146-a968-4105-b148-1320d4d99629/istio-proxy/1.log" Jun 05 13:22:29.057595 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:29.057571 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfxfl_8e600146-a968-4105-b148-1320d4d99629/istio-proxy/0.log" Jun 05 13:22:29.791456 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:29.791401 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sdcfn_65c18ec1-2a1a-4848-873f-cc54c505901e/serve-healthcheck-canary/0.log" Jun 05 13:22:30.401857 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:30.401828 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cvkkw_84f4d4da-a915-48ba-9c70-0a6acf5b010e/kube-rbac-proxy/0.log" Jun 05 13:22:30.422825 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:30.422797 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cvkkw_84f4d4da-a915-48ba-9c70-0a6acf5b010e/exporter/0.log" Jun 05 13:22:30.447315 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:30.447252 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cvkkw_84f4d4da-a915-48ba-9c70-0a6acf5b010e/extractor/0.log" Jun 05 13:22:32.254009 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:32.253981 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" Jun 05 13:22:32.275709 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:32.275640 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fnzwf/perf-node-gather-daemonset-mcbb6" podStartSLOduration=7.27561943 podStartE2EDuration="7.27561943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:22:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:22:26.257020989 +0000 UTC m=+1285.352930379" watchObservedRunningTime="2026-06-05 13:22:32.27561943 +0000 UTC m=+1291.371528820" Jun 05 13:22:32.818036 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:32.818015 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-69fcb86bc6-4dxm7_486bd983-24bc-4734-b618-c0db5bdb4d5c/nginx/0.log" Jun 05 13:22:33.393181 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:33.393139 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-785744655b-v4wnd_4cd88427-d8b7-4306-926b-e937c35d1d22/manager/0.log" Jun 05 13:22:33.410258 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:33.410220 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-785744655b-v4wnd_4cd88427-d8b7-4306-926b-e937c35d1d22/copy-manifests/0.log" Jun 05 13:22:33.446049 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:33.446017 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wtl9h_8337ab60-2567-4eb7-8091-5339fcd201c5/postgres/0.log" Jun 05 13:22:35.163457 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:35.163418 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d64dc6f78-zgd8p_caf35fc6-4865-4bd6-9694-737f993bd8f2/manager/0.log" Jun 05 13:22:39.576471 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:39.576440 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795cw2cs_a5fe91c4-5380-4a7b-8e9a-874b3cad5d80/istio-proxy/0.log" Jun 05 13:22:39.665677 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:39.665644 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfxfl_8e600146-a968-4105-b148-1320d4d99629/istio-proxy/1.log" Jun 05 13:22:39.665862 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:39.665833 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfxfl_8e600146-a968-4105-b148-1320d4d99629/istio-proxy/0.log" Jun 05 13:22:40.807420 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:40.807386 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795cw2cs_a5fe91c4-5380-4a7b-8e9a-874b3cad5d80/istio-proxy/0.log" Jun 05 13:22:40.898499 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:40.898463 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfxfl_8e600146-a968-4105-b148-1320d4d99629/istio-proxy/1.log" Jun 05 13:22:40.898697 ip-10-0-129-41 kubenswrapper[2567]: I0605 13:22:40.898679 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfxfl_8e600146-a968-4105-b148-1320d4d99629/istio-proxy/0.log"