Jun 10 14:52:13.430144 ip-10-0-130-107 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 14:52:13.430155 ip-10-0-130-107 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 14:52:13.430162 ip-10-0-130-107 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 14:52:13.430385 ip-10-0-130-107 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 14:52:23.679551 ip-10-0-130-107 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 14:52:23.679567 ip-10-0-130-107 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 641d11501c474e28a382691cb9daf97a -- Jun 10 14:54:58.290800 ip-10-0-130-107 systemd[1]: Starting Kubernetes Kubelet... Jun 10 14:54:58.694555 ip-10-0-130-107 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 14:54:58.694555 ip-10-0-130-107 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 14:54:58.694555 ip-10-0-130-107 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 14:54:58.694555 ip-10-0-130-107 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 14:54:58.694555 ip-10-0-130-107 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 14:54:58.695465 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.695365 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 14:54:58.703573 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703550 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 14:54:58.703573 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703570 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 14:54:58.703573 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703574 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 14:54:58.703573 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703577 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 14:54:58.703573 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703580 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703583 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703585 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703588 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703591 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703594 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703596 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703599 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703602 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703604 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703607 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703610 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703612 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703615 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703617 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703620 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703623 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703625 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703628 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703631 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 14:54:58.703775 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703633 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703636 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703638 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703641 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703644 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703646 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703650 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703654 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703657 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703660 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703662 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703665 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703668 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703670 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703674 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703677 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703679 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703682 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703685 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 14:54:58.704249 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703687 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703690 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703692 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703695 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703697 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703701 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703703 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703706 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703708 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703711 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703713 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703716 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703718 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703721 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703724 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703726 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703729 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703731 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703734 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703736 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 14:54:58.704772 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703739 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703742 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703744 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703747 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703749 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703752 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703754 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703757 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703760 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703763 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703765 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703770 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703773 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703776 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703779 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703783 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703786 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703788 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703791 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 14:54:58.705256 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703794 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703803 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703806 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703809 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703811 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703814 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703816 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703819 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703821 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703824 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703826 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703829 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703831 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703834 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703838 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703841 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.703844 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704599 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704607 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 14:54:58.705721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704610 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704616 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704620 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704624 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704627 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704630 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704633 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704635 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704638 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704641 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704644 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704647 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704649 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704652 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704654 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704663 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704666 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704668 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704671 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704673 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 14:54:58.706173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704676 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704678 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704681 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704684 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704687 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704690 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704692 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704695 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704697 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704700 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704703 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704705 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704708 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704712 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704714 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704717 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704719 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704722 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704724 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 14:54:58.706681 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704726 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704729 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704731 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704734 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704738 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704742 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704745 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704747 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704750 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704760 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704763 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704765 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704768 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704770 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704773 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704776 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704779 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704782 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704785 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 14:54:58.707173 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704787 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704790 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704793 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704795 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704798 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704801 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704803 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704806 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704808 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704811 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704813 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704816 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704818 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704821 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704823 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704826 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704829 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704831 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704834 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704836 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704839 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 14:54:58.707721 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704841 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704844 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704847 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704851 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704855 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704859 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704862 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704865 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704868 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704871 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704874 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704877 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704879 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704882 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704884 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704887 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704889 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.704892 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705268 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 14:54:58.708238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705274 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705276 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705279 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705282 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705285 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705287 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705290 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705294 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705298 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705301 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705304 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705307 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705310 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705313 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705316 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705319 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705322 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705325 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705328 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705331 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 14:54:58.708710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705333 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705337 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705340 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705342 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705345 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705347 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705350 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705352 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705355 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705358 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705360 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705363 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705366 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705368 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705371 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705373 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705376 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705378 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705380 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705400 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 14:54:58.709209 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705403 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705406 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705408 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705411 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705414 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705416 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705419 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705421 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705424 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705427 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705430 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705432 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705434 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705440 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705443 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705447 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705450 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705454 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705456 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 14:54:58.709705 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705459 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705462 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705464 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705467 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705470 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705472 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705474 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705477 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705479 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705482 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705484 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705487 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705490 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705496 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705499 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705502 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705505 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705508 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705511 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705513 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 14:54:58.710167 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705516 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705519 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705522 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705525 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705527 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705530 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705534 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705536 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705539 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705541 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705544 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705546 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705549 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705551 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705553 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705556 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705558 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705561 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.705563 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705635 2560 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 14:54:58.710710 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705643 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705649 2560 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705653 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705665 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705668 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705672 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705676 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705679 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705682 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705685 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705689 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705692 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705694 2560 flags.go:64] FLAG: --cgroup-root="" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705697 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705700 2560 flags.go:64] FLAG: --client-ca-file="" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705703 2560 flags.go:64] FLAG: --cloud-provider="external" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705706 2560 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705713 2560 flags.go:64] FLAG: --cluster-domain="" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705718 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705722 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705725 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705728 2560 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705732 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 14:54:58.711186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705735 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705738 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705742 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705745 2560 flags.go:64] FLAG: --contention-profiling="false" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705748 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705751 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705754 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705757 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705761 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705764 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705766 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705769 2560 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705772 2560 flags.go:64] FLAG: --enable-server="true" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705775 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705779 2560 flags.go:64] FLAG: --event-burst="100" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705782 2560 flags.go:64] FLAG: --event-qps="50" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705785 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705788 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705791 2560 flags.go:64] FLAG: --eviction-hard="" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705795 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705798 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705800 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705804 2560 flags.go:64] FLAG: --eviction-soft="" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705807 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705809 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 14:54:58.711748 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705813 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705816 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705819 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705822 2560 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705825 2560 flags.go:64] FLAG: --feature-gates="" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705828 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705831 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705834 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705837 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705840 2560 flags.go:64] FLAG: --healthz-port="10248" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705843 2560 flags.go:64] FLAG: --help="false" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705845 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-130-107.ec2.internal" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705849 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705851 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705854 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705857 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705860 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705863 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705866 2560 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705868 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705874 2560 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705876 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705879 2560 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705882 2560 flags.go:64] FLAG: --kube-reserved="" Jun 10 14:54:58.712578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705885 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705887 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705890 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705893 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705896 2560 flags.go:64] FLAG: --lock-file="" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705898 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705901 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705904 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705909 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705912 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705916 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705919 2560 flags.go:64] FLAG: --logging-format="text" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705921 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705924 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705927 2560 flags.go:64] FLAG: --manifest-url="" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705930 2560 flags.go:64] FLAG: --manifest-url-header="" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705934 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705938 2560 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705942 2560 flags.go:64] FLAG: --max-pods="110" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705945 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705948 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705951 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705954 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705957 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705959 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 14:54:58.713634 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705962 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705969 2560 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705972 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705976 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705979 2560 flags.go:64] FLAG: --pod-cidr="" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705982 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705988 2560 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705991 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705994 2560 flags.go:64] FLAG: --pods-per-core="0" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.705997 2560 flags.go:64] FLAG: --port="10250" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706000 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706003 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04409c70ae096a95f" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706006 2560 flags.go:64] FLAG: --qos-reserved="" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706008 2560 flags.go:64] FLAG: --read-only-port="10255" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706011 2560 flags.go:64] FLAG: --register-node="true" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706015 2560 flags.go:64] FLAG: --register-with-taints="" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706018 2560 flags.go:64] FLAG: --registry-burst="10" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706021 2560 flags.go:64] FLAG: --registry-qps="5" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706024 2560 flags.go:64] FLAG: --reserved-cpus="" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706027 2560 flags.go:64] FLAG: --reserved-memory="" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706031 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706034 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706037 2560 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706039 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706042 2560 flags.go:64] FLAG: --runonce="false" Jun 10 14:54:58.714772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706045 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706048 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706050 2560 flags.go:64] FLAG: --seccomp-default="false" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706053 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706056 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706058 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706061 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706064 2560 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706067 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706069 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706076 2560 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706079 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706082 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706085 2560 flags.go:64] FLAG: --system-cgroups="" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706087 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706092 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706095 2560 flags.go:64] FLAG: --tls-cert-file="" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706098 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706101 2560 flags.go:64] FLAG: --tls-min-version="" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706104 2560 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706106 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706109 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706112 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706114 2560 flags.go:64] FLAG: --v="2" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706119 2560 flags.go:64] FLAG: --version="false" Jun 10 14:54:58.715887 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706123 2560 flags.go:64] FLAG: --vmodule="" Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706127 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.706130 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706266 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706270 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706273 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706276 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706279 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706282 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706285 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706288 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706291 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706293 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706296 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706298 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706301 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706303 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706307 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706310 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706312 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 14:54:58.716755 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706315 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706319 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706322 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706325 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706328 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706331 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706334 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706337 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706340 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706343 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706345 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706348 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706352 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706355 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706358 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706361 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706363 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706366 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706368 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 14:54:58.717608 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706371 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706374 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706376 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706379 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706381 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706398 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706401 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706404 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706407 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706409 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706414 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706417 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706420 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706422 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706425 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706427 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706430 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706432 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706435 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706437 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 14:54:58.718171 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706440 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706442 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706445 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706447 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706451 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706456 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706458 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706461 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706464 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706466 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706469 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706471 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706474 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706476 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706479 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706482 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706484 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706488 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706491 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 14:54:58.718892 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706494 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706497 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706500 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706504 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706507 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706509 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706512 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706515 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706517 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706520 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706522 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706525 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706527 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706530 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706532 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706535 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706537 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706540 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706545 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706547 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 14:54:58.719363 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706550 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706552 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706555 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.706557 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.707042 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.714411 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.714433 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.714459 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.714467 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714552 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714560 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714565 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714572 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714578 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 14:54:58.719931 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714585 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714590 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714594 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714599 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714603 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714607 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714612 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714617 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714621 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714626 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714630 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714634 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714638 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714642 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714646 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714651 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714655 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714660 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714664 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714669 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 14:54:58.720286 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714674 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714678 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714682 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714687 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714692 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714697 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714702 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714706 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714713 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714718 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714723 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714728 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714733 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714737 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714741 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714746 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714750 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714755 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714759 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 14:54:58.720849 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714763 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714767 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714771 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714775 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714779 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714782 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714786 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714790 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714794 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714798 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714803 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714807 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714811 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714816 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714821 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714825 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714830 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714836 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714840 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 14:54:58.721343 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714845 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714849 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714853 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714858 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714863 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714867 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714871 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714875 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714879 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714883 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714887 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714892 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714896 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714900 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714904 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714909 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714913 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714917 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714921 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714925 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 14:54:58.721855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714929 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714933 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714937 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714941 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714946 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714950 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714955 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714960 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714965 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714969 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714973 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714977 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714982 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714986 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714990 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 14:54:58.722796 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.714994 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.715002 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715207 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715217 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715221 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715225 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715230 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715234 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715239 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715243 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715247 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715251 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715256 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715260 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715264 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 14:54:58.723451 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715268 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715273 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715277 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715282 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715286 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715290 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715294 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715299 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715303 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715307 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715312 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715317 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715322 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715326 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715330 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715334 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715338 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715342 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715347 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715351 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 14:54:58.724112 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715358 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715364 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715369 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715374 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715378 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715383 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715409 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715414 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715418 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715422 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715427 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715431 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715435 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715440 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715444 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715451 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715456 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715461 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715465 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715470 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 14:54:58.724889 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715475 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715480 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715485 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715490 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715494 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715498 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715502 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715506 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715510 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715514 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715519 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715523 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715527 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715532 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715538 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715544 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715549 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715555 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715560 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 14:54:58.725419 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715564 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715568 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715573 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715577 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715582 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715586 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715591 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715595 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715599 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715603 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715608 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715612 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715616 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715620 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715624 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715629 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715633 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715638 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715642 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 14:54:58.725909 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715647 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 14:54:58.726367 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715651 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 14:54:58.726367 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715655 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 14:54:58.726367 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715659 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 14:54:58.726367 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715663 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 14:54:58.726367 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715666 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 14:54:58.726367 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715674 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 14:54:58.726367 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:58.715678 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 14:54:58.726367 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.715686 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 14:54:58.726367 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.715835 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 14:54:58.726367 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.718308 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 14:54:58.726367 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.719673 2560 server.go:1019] "Starting client certificate rotation" Jun 10 14:54:58.726367 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.719782 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 14:54:58.726367 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.719821 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 14:54:58.726756 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.722453 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 14:54:58.726756 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.724713 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 14:54:58.739588 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.739570 2560 log.go:25] "Validated CRI v1 runtime API" Jun 10 14:54:58.741709 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.741691 2560 log.go:25] "Validated CRI v1 image API" Jun 10 14:54:58.742494 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.742474 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 14:54:58.744932 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.744910 2560 fs.go:135] Filesystem UUIDs: map[5a2f2712-75e4-4f9e-b7cb-ff67b9193366:/dev/nvme0n1p4 6211afce-0e72-4147-b799-2f55488fe468:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 10 14:54:58.745029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.744930 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 14:54:58.749863 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.749752 2560 manager.go:216] Machine: {Timestamp:2026-06-10 14:54:58.748566236 +0000 UTC m=+0.335355950 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3069109 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec235e90581dd979eb1e94517c7e8afb SystemUUID:ec235e90-581d-d979-eb1e-94517c7e8afb BootID:641d1150-1c47-4e28-a382-691cb9daf97a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:01:cc:ed:62:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:01:cc:ed:62:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:69:e5:7f:8b:c8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 14:54:58.749863 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.749852 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 14:54:58.750031 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.749950 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 14:54:58.750696 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.750681 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 14:54:58.753012 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.752989 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 14:54:58.753151 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.753016 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 14:54:58.753738 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.753728 2560 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 14:54:58.753770 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.753742 2560 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 14:54:58.753770 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.753750 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 14:54:58.754585 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.754574 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 14:54:58.755245 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.755236 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 14:54:58.757682 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.757672 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 10 14:54:58.757802 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.757793 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 14:54:58.757837 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.757821 2560 kubelet.go:486] "Attempting to sync node with API server" Jun 10 14:54:58.757837 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.757832 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 14:54:58.757903 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.757846 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 14:54:58.757903 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.757856 2560 kubelet.go:398] "Adding apiserver pod source" Jun 10 14:54:58.757903 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.757865 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 14:54:58.758228 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.758204 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 14:54:58.758228 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.758223 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 14:54:58.760502 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.760488 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 14:54:58.761680 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.761666 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 14:54:58.761720 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.761697 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 14:54:58.762714 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.762703 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 14:54:58.762745 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.762719 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 14:54:58.762745 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.762725 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 14:54:58.762745 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.762731 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 14:54:58.762745 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.762740 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 14:54:58.762745 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.762746 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 14:54:58.762885 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.762754 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 14:54:58.762885 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.762759 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 14:54:58.762885 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.762765 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 14:54:58.762885 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.762770 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 14:54:58.762885 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.762779 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 14:54:58.762885 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.762785 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 14:54:58.763484 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.763475 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 14:54:58.763519 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.763484 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 14:54:58.766935 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.766921 2560 server.go:1268] "Started kubelet" Jun 10 14:54:58.767053 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.767030 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 14:54:58.767145 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.767095 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 14:54:58.767200 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.767169 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 14:54:58.767250 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.767239 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-107.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 14:54:58.767730 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.767700 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 14:54:58.767730 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.767699 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 14:54:58.770080 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.770006 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 14:54:58.770475 ip-10-0-130-107 systemd[1]: Started Kubernetes Kubelet. Jun 10 14:54:58.772807 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.772787 2560 server.go:310] "Adding debug handlers to kubelet server" Jun 10 14:54:58.774512 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.774496 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 14:54:58.775216 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.775196 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 14:54:58.775216 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.775211 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 14:54:58.775359 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.775303 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:54:58.775757 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.775736 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 14:54:58.775926 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.775910 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 14:54:58.775975 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.775930 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 14:54:58.776051 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.776035 2560 reconstruct.go:97] "Volume reconstruction finished" Jun 10 14:54:58.776051 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.776052 2560 reconciler.go:29] "Reconciler: start to sync state" Jun 10 14:54:58.776129 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.776040 2560 factory.go:55] Registering systemd factory Jun 10 14:54:58.776129 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.776068 2560 factory.go:223] Registration of the systemd container factory successfully Jun 10 14:54:58.776411 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.776380 2560 factory.go:153] Registering CRI-O factory Jun 10 14:54:58.776411 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.776412 2560 factory.go:223] Registration of the crio container factory successfully Jun 10 14:54:58.776532 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.776461 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 14:54:58.776532 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.776488 2560 factory.go:103] Registering Raw factory Jun 10 14:54:58.776532 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.775453 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-107.ec2.internal.18b7c00377470375 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-107.ec2.internal,UID:ip-10-0-130-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-107.ec2.internal,},FirstTimestamp:2026-06-10 14:54:58.766898037 +0000 UTC m=+0.353687751,LastTimestamp:2026-06-10 14:54:58.766898037 +0000 UTC m=+0.353687751,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-107.ec2.internal,}" Jun 10 14:54:58.776532 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.776502 2560 manager.go:1196] Started watching for new ooms in manager Jun 10 14:54:58.777322 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.777308 2560 manager.go:349] Starting recovery of all containers Jun 10 14:54:58.778264 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.778238 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v9gnp" Jun 10 14:54:58.784349 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.784169 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 14:54:58.784472 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.784448 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 14:54:58.785851 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.785826 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v9gnp" Jun 10 14:54:58.786967 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.786948 2560 manager.go:354] Recovery completed Jun 10 14:54:58.789180 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.789123 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 14:54:58.793336 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.793323 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:54:58.795246 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.795227 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:54:58.795320 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.795265 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:54:58.795320 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.795275 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:54:58.795877 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.795860 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 14:54:58.795877 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.795874 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 14:54:58.795985 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.795882 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:54:58.795985 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.795889 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 10 14:54:58.796762 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.796751 2560 policy_none.go:49] "None policy: Start" Jun 10 14:54:58.796821 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.796769 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 14:54:58.796821 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.796781 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 14:54:58.797102 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.797088 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:54:58.797138 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.797128 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:54:58.797169 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.797139 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:54:58.797556 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.797543 2560 policy_none.go:47] "Start" Jun 10 14:54:58.797737 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.797651 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-107.ec2.internal.18b7c00378f78a03 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-107.ec2.internal,UID:ip-10-0-130-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-107.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-107.ec2.internal,},FirstTimestamp:2026-06-10 14:54:58.795244035 +0000 UTC m=+0.382033749,LastTimestamp:2026-06-10 14:54:58.795244035 +0000 UTC m=+0.382033749,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-107.ec2.internal,}" Jun 10 14:54:58.828995 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.828976 2560 manager.go:337] "Starting Device Plugin manager" Jun 10 14:54:58.829137 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.829032 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 14:54:58.829137 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.829047 2560 server.go:87] "Starting device plugin registration server" Jun 10 14:54:58.829328 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.829314 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 14:54:58.829424 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.829331 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 14:54:58.829535 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.829522 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 14:54:58.829673 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.829595 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 14:54:58.829673 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.829609 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 14:54:58.830148 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.830124 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 14:54:58.830231 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.830170 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:54:58.845640 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.845620 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 14:54:58.846378 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.845658 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 14:54:58.846378 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.845677 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 14:54:58.846378 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.845705 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 14:54:58.848296 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.848278 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 14:54:58.929682 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.929636 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:54:58.930834 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.930809 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:54:58.930897 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.930843 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:54:58.930897 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.930854 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:54:58.930897 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.930881 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-107.ec2.internal" Jun 10 14:54:58.941879 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.941864 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-107.ec2.internal" Jun 10 14:54:58.941933 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.941887 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-107.ec2.internal\": node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:54:58.946173 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.946129 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal"] Jun 10 14:54:58.946217 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.946191 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:54:58.948446 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.948430 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:54:58.948446 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.948456 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:54:58.948565 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.948468 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:54:58.949506 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.949494 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:54:58.949624 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.949607 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Jun 10 14:54:58.949664 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.949639 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:54:58.950242 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.950219 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:54:58.950242 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.950236 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:54:58.950370 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.950251 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:54:58.950370 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.950260 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:54:58.950370 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.950265 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:54:58.950370 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.950271 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:54:58.951291 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.951276 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Jun 10 14:54:58.951332 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.951311 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 14:54:58.952038 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.952022 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Jun 10 14:54:58.952131 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.952047 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 14:54:58.952131 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.952060 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Jun 10 14:54:58.975107 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.975082 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-107.ec2.internal\" not found" node="ip-10-0-130-107.ec2.internal" Jun 10 14:54:58.976793 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.976774 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e251d96f88f737740ad888eb8d094183-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"e251d96f88f737740ad888eb8d094183\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Jun 10 14:54:58.976881 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.976797 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8be6d5f80eb92a9d92719a07fd96bd87-config\") pod \"kube-apiserver-proxy-ip-10-0-130-107.ec2.internal\" (UID: \"8be6d5f80eb92a9d92719a07fd96bd87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Jun 10 14:54:58.976881 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:58.976815 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e251d96f88f737740ad888eb8d094183-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"e251d96f88f737740ad888eb8d094183\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Jun 10 14:54:58.979814 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:58.979798 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-107.ec2.internal\" not found" node="ip-10-0-130-107.ec2.internal" Jun 10 14:54:59.003464 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:59.003439 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:54:59.077216 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.077180 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8be6d5f80eb92a9d92719a07fd96bd87-config\") pod \"kube-apiserver-proxy-ip-10-0-130-107.ec2.internal\" (UID: \"8be6d5f80eb92a9d92719a07fd96bd87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Jun 10 14:54:59.077216 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.077214 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e251d96f88f737740ad888eb8d094183-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"e251d96f88f737740ad888eb8d094183\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Jun 10 14:54:59.077430 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.077234 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e251d96f88f737740ad888eb8d094183-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"e251d96f88f737740ad888eb8d094183\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Jun 10 14:54:59.077430 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.077260 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8be6d5f80eb92a9d92719a07fd96bd87-config\") pod \"kube-apiserver-proxy-ip-10-0-130-107.ec2.internal\" (UID: \"8be6d5f80eb92a9d92719a07fd96bd87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Jun 10 14:54:59.077430 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.077282 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e251d96f88f737740ad888eb8d094183-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"e251d96f88f737740ad888eb8d094183\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Jun 10 14:54:59.077430 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.077282 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e251d96f88f737740ad888eb8d094183-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"e251d96f88f737740ad888eb8d094183\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Jun 10 14:54:59.104495 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:59.104469 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:54:59.205589 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:59.205536 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:54:59.279068 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.279046 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Jun 10 14:54:59.283243 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.283228 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Jun 10 14:54:59.306520 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:59.306494 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:54:59.407086 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:59.407053 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:54:59.507555 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:59.507493 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:54:59.608086 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:59.608056 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:54:59.709778 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:59.708515 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:54:59.718808 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.718783 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 14:54:59.718990 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.718971 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 14:54:59.758043 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:59.757964 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be6d5f80eb92a9d92719a07fd96bd87.slice/crio-33284e97fde313101ffd5d9f957b13820d669740c0b9450628534ccc83cfe1c9 WatchSource:0}: Error finding container 33284e97fde313101ffd5d9f957b13820d669740c0b9450628534ccc83cfe1c9: Status 404 returned error can't find the container with id 33284e97fde313101ffd5d9f957b13820d669740c0b9450628534ccc83cfe1c9 Jun 10 14:54:59.758226 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:54:59.758206 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode251d96f88f737740ad888eb8d094183.slice/crio-88812759176b4b06dee939d400e76169a31e9c123a97b6b00f99621be5a8a945 WatchSource:0}: Error finding container 88812759176b4b06dee939d400e76169a31e9c123a97b6b00f99621be5a8a945: Status 404 returned error can't find the container with id 88812759176b4b06dee939d400e76169a31e9c123a97b6b00f99621be5a8a945 Jun 10 14:54:59.763990 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.763975 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 14:54:59.788662 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.788636 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 14:49:58 +0000 UTC" deadline="2028-01-28 14:09:32.157702908 +0000 UTC" Jun 10 14:54:59.788662 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.788660 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14327h14m32.36904625s" Jun 10 14:54:59.808984 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:59.808962 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:54:59.849372 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.849321 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" event={"ID":"8be6d5f80eb92a9d92719a07fd96bd87","Type":"ContainerStarted","Data":"33284e97fde313101ffd5d9f957b13820d669740c0b9450628534ccc83cfe1c9"} Jun 10 14:54:59.850271 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:54:59.850249 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" event={"ID":"e251d96f88f737740ad888eb8d094183","Type":"ContainerStarted","Data":"88812759176b4b06dee939d400e76169a31e9c123a97b6b00f99621be5a8a945"} Jun 10 14:54:59.909720 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:54:59.909695 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:55:00.010189 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:00.010129 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:55:00.110628 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:00.110599 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:55:00.132648 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.132620 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 14:55:00.210931 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:00.210895 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Jun 10 14:55:00.276961 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.276876 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 14:55:00.284626 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.284469 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 14:55:00.375759 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.375730 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Jun 10 14:55:00.384145 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.384114 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 14:55:00.385122 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.385100 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Jun 10 14:55:00.405863 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.405841 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 14:55:00.670916 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.670850 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 14:55:00.758195 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.758166 2560 apiserver.go:52] "Watching apiserver" Jun 10 14:55:00.767587 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.767564 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 14:55:00.767948 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.767924 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-4plgp","kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq","openshift-dns/node-resolver-72c4r","openshift-image-registry/node-ca-dbpgp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal","openshift-multus/multus-additional-cni-plugins-hrdbz","openshift-cluster-node-tuning-operator/tuned-9zthd","openshift-multus/multus-k54c5","openshift-multus/network-metrics-daemon-nvzzs","openshift-network-diagnostics/network-check-target-b74wj","openshift-network-operator/iptables-alerter-fhh6n","openshift-ovn-kubernetes/ovnkube-node-224fh","kube-system/global-pull-secret-syncer-qdpbt"] Jun 10 14:55:00.769471 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.769449 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.770329 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.770307 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.771341 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.771321 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.772095 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.772077 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 14:55:00.772379 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.772354 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-72c4r" Jun 10 14:55:00.772631 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.772610 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 14:55:00.772871 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.772854 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k2d66\"" Jun 10 14:55:00.772973 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.772864 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-72h4q\"" Jun 10 14:55:00.773160 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.773145 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 14:55:00.773616 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.773596 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 14:55:00.773705 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.773651 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dbpgp" Jun 10 14:55:00.773896 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.773879 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 14:55:00.774075 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.774059 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 14:55:00.774293 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.774277 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sdrt7\"" Jun 10 14:55:00.774402 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.774371 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 14:55:00.774686 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.774668 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 14:55:00.774803 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.774782 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 14:55:00.774957 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.774942 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 14:55:00.775010 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.774968 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gdmkn\"" Jun 10 14:55:00.775237 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.775223 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 14:55:00.775293 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.775269 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4plgp" Jun 10 14:55:00.775746 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.775728 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 14:55:00.775851 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.775800 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n2qpw\"" Jun 10 14:55:00.775950 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.775928 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 14:55:00.776029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.775988 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 14:55:00.776567 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.776547 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.776649 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.776631 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 14:55:00.778065 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.777856 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:00.778065 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:00.777931 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:00.779628 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.779606 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:00.779716 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:00.779679 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:00.779880 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.779862 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 14:55:00.779999 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.779926 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-87nqr\"" Jun 10 14:55:00.781288 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.781270 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fhh6n" Jun 10 14:55:00.783247 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.783231 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.783777 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.783760 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 14:55:00.783962 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.783946 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 14:55:00.784087 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.784074 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 14:55:00.784255 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.784243 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 14:55:00.784309 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.784276 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 14:55:00.784422 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.784383 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n452z\"" Jun 10 14:55:00.784788 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.784769 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 14:55:00.784873 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.784776 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cggs2\"" Jun 10 14:55:00.784951 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.784934 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:00.785010 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:00.784988 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:00.785641 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.785619 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 14:55:00.785733 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.785716 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 14:55:00.785930 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.785909 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-multus-conf-dir\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.786007 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.785931 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-systemd\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.786007 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.785945 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-run\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.786007 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.785964 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-modprobe-d\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.786007 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.785987 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-run-k8s-cni-cncf-io\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.786200 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786011 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8gh6\" (UniqueName: \"kubernetes.io/projected/2438bf76-f556-4a2f-83c6-dcf98a216432-kube-api-access-w8gh6\") pod \"node-resolver-72c4r\" (UID: \"2438bf76-f556-4a2f-83c6-dcf98a216432\") " pod="openshift-dns/node-resolver-72c4r" Jun 10 14:55:00.786200 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/366482e2-0d37-4e7a-8344-4414bcab48d6-serviceca\") pod \"node-ca-dbpgp\" (UID: \"366482e2-0d37-4e7a-8344-4414bcab48d6\") " pod="openshift-image-registry/node-ca-dbpgp" Jun 10 14:55:00.786200 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786051 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-device-dir\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.786200 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786070 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v4sz\" (UniqueName: \"kubernetes.io/projected/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-kube-api-access-5v4sz\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.786200 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-var-lib-cni-bin\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.786200 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786161 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96be0e35-f6f4-4074-af48-3c2600372ee9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.786200 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786192 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/443a9574-ddb3-4b8d-949a-c1fcbb4e7a36-agent-certs\") pod \"konnectivity-agent-4plgp\" (UID: \"443a9574-ddb3-4b8d-949a-c1fcbb4e7a36\") " pod="kube-system/konnectivity-agent-4plgp" Jun 10 14:55:00.786579 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvwmn\" (UniqueName: \"kubernetes.io/projected/0be51e0a-72b9-42c9-9dd2-4249c560e96b-kube-api-access-nvwmn\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.786579 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786263 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-sys-fs\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.786579 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786318 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-cnibin\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.786579 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786346 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-multus-socket-dir-parent\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.786579 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786368 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96be0e35-f6f4-4074-af48-3c2600372ee9-cnibin\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.786579 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786383 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-socket-dir\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.786579 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsm2j\" (UniqueName: \"kubernetes.io/projected/96be0e35-f6f4-4074-af48-3c2600372ee9-kube-api-access-wsm2j\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.786579 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/366482e2-0d37-4e7a-8344-4414bcab48d6-host\") pod \"node-ca-dbpgp\" (UID: \"366482e2-0d37-4e7a-8344-4414bcab48d6\") " pod="openshift-image-registry/node-ca-dbpgp" Jun 10 14:55:00.786579 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786460 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-sys\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.786579 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786473 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-host\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.786579 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786508 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-cni-binary-copy\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.786579 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786566 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-hostroot\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786595 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-etc-kubernetes\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786616 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2438bf76-f556-4a2f-83c6-dcf98a216432-tmp-dir\") pod \"node-resolver-72c4r\" (UID: \"2438bf76-f556-4a2f-83c6-dcf98a216432\") " pod="openshift-dns/node-resolver-72c4r" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786664 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-sysctl-d\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786690 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7wz2\" (UniqueName: \"kubernetes.io/projected/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-kube-api-access-w7wz2\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786706 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/443a9574-ddb3-4b8d-949a-c1fcbb4e7a36-konnectivity-ca\") pod \"konnectivity-agent-4plgp\" (UID: \"443a9574-ddb3-4b8d-949a-c1fcbb4e7a36\") " pod="kube-system/konnectivity-agent-4plgp" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0be51e0a-72b9-42c9-9dd2-4249c560e96b-tmp\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786796 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-registration-dir\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786832 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786858 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-system-cni-dir\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-multus-cni-dir\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786895 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-lib-modules\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786910 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2438bf76-f556-4a2f-83c6-dcf98a216432-hosts-file\") pod \"node-resolver-72c4r\" (UID: \"2438bf76-f556-4a2f-83c6-dcf98a216432\") " pod="openshift-dns/node-resolver-72c4r" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786923 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-sysconfig\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-var-lib-kubelet\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.786966 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-sysctl-conf\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.787029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787001 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-multus-daemon-config\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787049 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96be0e35-f6f4-4074-af48-3c2600372ee9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787071 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96be0e35-f6f4-4074-af48-3c2600372ee9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787087 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfmd8\" (UniqueName: \"kubernetes.io/projected/366482e2-0d37-4e7a-8344-4414bcab48d6-kube-api-access-vfmd8\") pod \"node-ca-dbpgp\" (UID: \"366482e2-0d37-4e7a-8344-4414bcab48d6\") " pod="openshift-image-registry/node-ca-dbpgp" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-kubernetes\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787134 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787166 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-var-lib-cni-multus\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787193 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96be0e35-f6f4-4074-af48-3c2600372ee9-system-cni-dir\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787222 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96be0e35-f6f4-4074-af48-3c2600372ee9-os-release\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-run-multus-certs\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787266 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96be0e35-f6f4-4074-af48-3c2600372ee9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787299 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-tuned\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787344 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-os-release\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787371 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-run-netns\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.787684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.787423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-var-lib-kubelet\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.788418 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.788237 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 14:55:00.788418 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.788298 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 14:55:00.788676 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.788660 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 14:55:00.788769 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.788730 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 14:55:00.788856 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.788833 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nsm8n\"" Jun 10 14:55:00.795725 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.795702 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 14:55:00.821082 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.821058 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-24swx" Jun 10 14:55:00.833730 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.833709 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-24swx" Jun 10 14:55:00.877137 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.877092 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 14:55:00.888248 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888220 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7wz2\" (UniqueName: \"kubernetes.io/projected/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-kube-api-access-w7wz2\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.888248 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888250 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/443a9574-ddb3-4b8d-949a-c1fcbb4e7a36-konnectivity-ca\") pod \"konnectivity-agent-4plgp\" (UID: \"443a9574-ddb3-4b8d-949a-c1fcbb4e7a36\") " pod="kube-system/konnectivity-agent-4plgp" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888266 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0be51e0a-72b9-42c9-9dd2-4249c560e96b-tmp\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888285 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/792f5971-505f-4445-873d-156674dfc5b0-ovnkube-config\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888300 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-registration-dir\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888339 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888354 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-system-cni-dir\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888370 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-multus-cni-dir\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888409 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-run-ovn\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888432 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-lib-modules\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888451 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a-host-slash\") pod \"iptables-alerter-fhh6n\" (UID: \"25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a\") " pod="openshift-network-operator/iptables-alerter-fhh6n" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888471 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt2r6\" (UniqueName: \"kubernetes.io/projected/792f5971-505f-4445-873d-156674dfc5b0-kube-api-access-lt2r6\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888492 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-system-cni-dir\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888496 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2438bf76-f556-4a2f-83c6-dcf98a216432-hosts-file\") pod \"node-resolver-72c4r\" (UID: \"2438bf76-f556-4a2f-83c6-dcf98a216432\") " pod="openshift-dns/node-resolver-72c4r" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888508 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-multus-cni-dir\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.888515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888515 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-registration-dir\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888519 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888538 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-sysconfig\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888580 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-var-lib-kubelet\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888600 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2438bf76-f556-4a2f-83c6-dcf98a216432-hosts-file\") pod \"node-resolver-72c4r\" (UID: \"2438bf76-f556-4a2f-83c6-dcf98a216432\") " pod="openshift-dns/node-resolver-72c4r" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888623 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/792f5971-505f-4445-873d-156674dfc5b0-env-overrides\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888615 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888650 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-sysconfig\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888654 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-lib-modules\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888656 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-654k2\" (UniqueName: \"kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2\") pod \"network-check-target-b74wj\" (UID: \"3542c9e3-6f7b-4b12-8cfd-7a4cc475080c\") " pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888713 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-sysctl-conf\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888658 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-var-lib-kubelet\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888739 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-multus-daemon-config\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888768 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96be0e35-f6f4-4074-af48-3c2600372ee9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888797 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96be0e35-f6f4-4074-af48-3c2600372ee9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfmd8\" (UniqueName: \"kubernetes.io/projected/366482e2-0d37-4e7a-8344-4414bcab48d6-kube-api-access-vfmd8\") pod \"node-ca-dbpgp\" (UID: \"366482e2-0d37-4e7a-8344-4414bcab48d6\") " pod="openshift-image-registry/node-ca-dbpgp" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888848 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-kubernetes\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.889170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888875 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ee837172-4366-4f5e-8aa0-06c0c17f0bca-kubelet-config\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888909 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888935 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-var-lib-cni-multus\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888959 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96be0e35-f6f4-4074-af48-3c2600372ee9-system-cni-dir\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889002 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96be0e35-f6f4-4074-af48-3c2600372ee9-os-release\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889027 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-run-netns\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889052 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-run-multus-certs\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889074 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/443a9574-ddb3-4b8d-949a-c1fcbb4e7a36-konnectivity-ca\") pod \"konnectivity-agent-4plgp\" (UID: \"443a9574-ddb3-4b8d-949a-c1fcbb4e7a36\") " pod="kube-system/konnectivity-agent-4plgp" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889313 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-multus-daemon-config\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889328 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-kubernetes\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889357 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96be0e35-f6f4-4074-af48-3c2600372ee9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889371 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-var-lib-cni-multus\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889077 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96be0e35-f6f4-4074-af48-3c2600372ee9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889379 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96be0e35-f6f4-4074-af48-3c2600372ee9-system-cni-dir\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.888844 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-sysctl-conf\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889410 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96be0e35-f6f4-4074-af48-3c2600372ee9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889419 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-tuned\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.889945 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889456 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-kubelet\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/792f5971-505f-4445-873d-156674dfc5b0-ovnkube-script-lib\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889482 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96be0e35-f6f4-4074-af48-3c2600372ee9-os-release\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889557 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96be0e35-f6f4-4074-af48-3c2600372ee9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889605 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-os-release\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889650 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-run-netns\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-var-lib-kubelet\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889697 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-multus-conf-dir\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889711 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-os-release\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889712 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-run-multus-certs\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889722 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-systemd\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889709 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-run-netns\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889742 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-var-lib-kubelet\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889749 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-multus-conf-dir\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889753 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-run\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889778 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-systemd\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889806 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-cni-netd\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.890749 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889827 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-run\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889851 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889921 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-modprobe-d\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889938 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-var-lib-openvswitch\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889960 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-log-socket\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-run-k8s-cni-cncf-io\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.889992 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8gh6\" (UniqueName: \"kubernetes.io/projected/2438bf76-f556-4a2f-83c6-dcf98a216432-kube-api-access-w8gh6\") pod \"node-resolver-72c4r\" (UID: \"2438bf76-f556-4a2f-83c6-dcf98a216432\") " pod="openshift-dns/node-resolver-72c4r" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890011 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/366482e2-0d37-4e7a-8344-4414bcab48d6-serviceca\") pod \"node-ca-dbpgp\" (UID: \"366482e2-0d37-4e7a-8344-4414bcab48d6\") " pod="openshift-image-registry/node-ca-dbpgp" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890013 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-modprobe-d\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890050 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-run-k8s-cni-cncf-io\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890092 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a-iptables-alerter-script\") pod \"iptables-alerter-fhh6n\" (UID: \"25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a\") " pod="openshift-network-operator/iptables-alerter-fhh6n" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890126 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh57k\" (UniqueName: \"kubernetes.io/projected/f54ab5dc-d0e0-453e-92f1-968e16b67c00-kube-api-access-rh57k\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890150 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ee837172-4366-4f5e-8aa0-06c0c17f0bca-dbus\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890177 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-device-dir\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890211 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v4sz\" (UniqueName: \"kubernetes.io/projected/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-kube-api-access-5v4sz\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890296 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-device-dir\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890323 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-var-lib-cni-bin\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.891573 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890352 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96be0e35-f6f4-4074-af48-3c2600372ee9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890432 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-host-var-lib-cni-bin\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890461 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/366482e2-0d37-4e7a-8344-4414bcab48d6-serviceca\") pod \"node-ca-dbpgp\" (UID: \"366482e2-0d37-4e7a-8344-4414bcab48d6\") " pod="openshift-image-registry/node-ca-dbpgp" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890435 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/443a9574-ddb3-4b8d-949a-c1fcbb4e7a36-agent-certs\") pod \"konnectivity-agent-4plgp\" (UID: \"443a9574-ddb3-4b8d-949a-c1fcbb4e7a36\") " pod="kube-system/konnectivity-agent-4plgp" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890509 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvwmn\" (UniqueName: \"kubernetes.io/projected/0be51e0a-72b9-42c9-9dd2-4249c560e96b-kube-api-access-nvwmn\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890535 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890559 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-sys-fs\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890586 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-etc-openvswitch\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890586 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96be0e35-f6f4-4074-af48-3c2600372ee9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890608 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/792f5971-505f-4445-873d-156674dfc5b0-ovn-node-metrics-cert\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890635 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-cnibin\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890660 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-multus-socket-dir-parent\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890683 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96be0e35-f6f4-4074-af48-3c2600372ee9-cnibin\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890706 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-systemd-units\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890728 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-run-systemd\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890751 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-node-log\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890777 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.892211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890803 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-cnibin\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890808 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96be0e35-f6f4-4074-af48-3c2600372ee9-cnibin\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890852 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-socket-dir\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890865 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-sys-fs\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890856 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-multus-socket-dir-parent\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890886 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsm2j\" (UniqueName: \"kubernetes.io/projected/96be0e35-f6f4-4074-af48-3c2600372ee9-kube-api-access-wsm2j\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890914 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/366482e2-0d37-4e7a-8344-4414bcab48d6-host\") pod \"node-ca-dbpgp\" (UID: \"366482e2-0d37-4e7a-8344-4414bcab48d6\") " pod="openshift-image-registry/node-ca-dbpgp" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890938 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-sys\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890941 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-socket-dir\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-host\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890990 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/366482e2-0d37-4e7a-8344-4414bcab48d6-host\") pod \"node-ca-dbpgp\" (UID: \"366482e2-0d37-4e7a-8344-4414bcab48d6\") " pod="openshift-image-registry/node-ca-dbpgp" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.890996 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-run-openvswitch\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891019 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-cni-bin\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891027 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-sys\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891037 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-host\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891042 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891096 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdbl8\" (UniqueName: \"kubernetes.io/projected/25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a-kube-api-access-hdbl8\") pod \"iptables-alerter-fhh6n\" (UID: \"25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a\") " pod="openshift-network-operator/iptables-alerter-fhh6n" Jun 10 14:55:00.892910 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891132 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-cni-binary-copy\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.893373 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891154 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-hostroot\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.893373 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891175 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-etc-kubernetes\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.893373 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891194 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2438bf76-f556-4a2f-83c6-dcf98a216432-tmp-dir\") pod \"node-resolver-72c4r\" (UID: \"2438bf76-f556-4a2f-83c6-dcf98a216432\") " pod="openshift-dns/node-resolver-72c4r" Jun 10 14:55:00.893373 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891217 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-hostroot\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.893373 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891226 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-etc-kubernetes\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.893373 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891245 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-sysctl-d\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.893373 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891277 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-slash\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.893373 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891376 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-sysctl-d\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.893373 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891464 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2438bf76-f556-4a2f-83c6-dcf98a216432-tmp-dir\") pod \"node-resolver-72c4r\" (UID: \"2438bf76-f556-4a2f-83c6-dcf98a216432\") " pod="openshift-dns/node-resolver-72c4r" Jun 10 14:55:00.893373 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891722 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-cni-binary-copy\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.893373 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.891916 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0be51e0a-72b9-42c9-9dd2-4249c560e96b-etc-tuned\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.893373 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.892008 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0be51e0a-72b9-42c9-9dd2-4249c560e96b-tmp\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.893373 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.892843 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/443a9574-ddb3-4b8d-949a-c1fcbb4e7a36-agent-certs\") pod \"konnectivity-agent-4plgp\" (UID: \"443a9574-ddb3-4b8d-949a-c1fcbb4e7a36\") " pod="kube-system/konnectivity-agent-4plgp" Jun 10 14:55:00.904501 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.904474 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7wz2\" (UniqueName: \"kubernetes.io/projected/1328ca2f-86e3-46cf-9a7c-90aa349b46cc-kube-api-access-w7wz2\") pod \"multus-k54c5\" (UID: \"1328ca2f-86e3-46cf-9a7c-90aa349b46cc\") " pod="openshift-multus/multus-k54c5" Jun 10 14:55:00.904592 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.904572 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvwmn\" (UniqueName: \"kubernetes.io/projected/0be51e0a-72b9-42c9-9dd2-4249c560e96b-kube-api-access-nvwmn\") pod \"tuned-9zthd\" (UID: \"0be51e0a-72b9-42c9-9dd2-4249c560e96b\") " pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:00.907094 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.907069 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v4sz\" (UniqueName: \"kubernetes.io/projected/4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a-kube-api-access-5v4sz\") pod \"aws-ebs-csi-driver-node-kb6cq\" (UID: \"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:00.908216 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.908180 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8gh6\" (UniqueName: \"kubernetes.io/projected/2438bf76-f556-4a2f-83c6-dcf98a216432-kube-api-access-w8gh6\") pod \"node-resolver-72c4r\" (UID: \"2438bf76-f556-4a2f-83c6-dcf98a216432\") " pod="openshift-dns/node-resolver-72c4r" Jun 10 14:55:00.909354 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.909329 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfmd8\" (UniqueName: \"kubernetes.io/projected/366482e2-0d37-4e7a-8344-4414bcab48d6-kube-api-access-vfmd8\") pod \"node-ca-dbpgp\" (UID: \"366482e2-0d37-4e7a-8344-4414bcab48d6\") " pod="openshift-image-registry/node-ca-dbpgp" Jun 10 14:55:00.909696 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.909674 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsm2j\" (UniqueName: \"kubernetes.io/projected/96be0e35-f6f4-4074-af48-3c2600372ee9-kube-api-access-wsm2j\") pod \"multus-additional-cni-plugins-hrdbz\" (UID: \"96be0e35-f6f4-4074-af48-3c2600372ee9\") " pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:00.991827 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.991748 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/792f5971-505f-4445-873d-156674dfc5b0-env-overrides\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.991827 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.991793 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-654k2\" (UniqueName: \"kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2\") pod \"network-check-target-b74wj\" (UID: \"3542c9e3-6f7b-4b12-8cfd-7a4cc475080c\") " pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:00.991827 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.991824 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ee837172-4366-4f5e-8aa0-06c0c17f0bca-kubelet-config\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:00.992026 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.991867 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-run-netns\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992026 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.991892 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-kubelet\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992026 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.991923 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/792f5971-505f-4445-873d-156674dfc5b0-ovnkube-script-lib\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992026 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.991955 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-cni-netd\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992026 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.991979 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:00.992026 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992011 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-var-lib-openvswitch\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992257 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-log-socket\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992257 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992059 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a-iptables-alerter-script\") pod \"iptables-alerter-fhh6n\" (UID: \"25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a\") " pod="openshift-network-operator/iptables-alerter-fhh6n" Jun 10 14:55:00.992257 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992087 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh57k\" (UniqueName: \"kubernetes.io/projected/f54ab5dc-d0e0-453e-92f1-968e16b67c00-kube-api-access-rh57k\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:00.992257 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992114 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ee837172-4366-4f5e-8aa0-06c0c17f0bca-dbus\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:00.992257 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992140 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:00.992257 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992163 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-etc-openvswitch\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992257 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992188 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/792f5971-505f-4445-873d-156674dfc5b0-ovn-node-metrics-cert\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992257 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992212 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-systemd-units\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992257 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992233 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-run-systemd\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992585 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992260 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-node-log\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992585 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992300 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992585 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992327 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-run-openvswitch\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992585 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992352 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-cni-bin\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992585 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992376 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992585 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992435 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdbl8\" (UniqueName: \"kubernetes.io/projected/25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a-kube-api-access-hdbl8\") pod \"iptables-alerter-fhh6n\" (UID: \"25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a\") " pod="openshift-network-operator/iptables-alerter-fhh6n" Jun 10 14:55:00.992585 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992465 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-slash\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992585 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992491 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/792f5971-505f-4445-873d-156674dfc5b0-ovnkube-config\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992585 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992517 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-run-ovn\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.992585 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992550 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a-host-slash\") pod \"iptables-alerter-fhh6n\" (UID: \"25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a\") " pod="openshift-network-operator/iptables-alerter-fhh6n" Jun 10 14:55:00.992585 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.992584 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt2r6\" (UniqueName: \"kubernetes.io/projected/792f5971-505f-4445-873d-156674dfc5b0-kube-api-access-lt2r6\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.993425 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993380 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/792f5971-505f-4445-873d-156674dfc5b0-env-overrides\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.993521 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993484 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-systemd-units\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.993578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993521 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-etc-openvswitch\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.993578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993520 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-cni-netd\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.993578 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:00.993560 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:00.993715 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993599 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-run-systemd\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.993715 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993562 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-var-lib-openvswitch\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.993715 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:00.993628 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:00.993715 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:00.993652 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret podName:ee837172-4366-4f5e-8aa0-06c0c17f0bca nodeName:}" failed. No retries permitted until 2026-06-10 14:55:01.49360749 +0000 UTC m=+3.080397194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret") pod "global-pull-secret-syncer-qdpbt" (UID: "ee837172-4366-4f5e-8aa0-06c0c17f0bca") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:00.993715 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993563 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-kubelet\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.993715 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993655 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-node-log\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.993715 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993656 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ee837172-4366-4f5e-8aa0-06c0c17f0bca-dbus\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:00.993715 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993712 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.994074 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:00.993726 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs podName:f54ab5dc-d0e0-453e-92f1-968e16b67c00 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:01.493710306 +0000 UTC m=+3.080500006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs") pod "network-metrics-daemon-nvzzs" (UID: "f54ab5dc-d0e0-453e-92f1-968e16b67c00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:00.994074 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993746 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-log-socket\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.994074 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993752 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-run-openvswitch\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.994074 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993800 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a-host-slash\") pod \"iptables-alerter-fhh6n\" (UID: \"25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a\") " pod="openshift-network-operator/iptables-alerter-fhh6n" Jun 10 14:55:00.994074 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993812 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-cni-bin\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.994074 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993908 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.994074 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.994039 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-run-ovn\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.994421 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.994104 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a-iptables-alerter-script\") pod \"iptables-alerter-fhh6n\" (UID: \"25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a\") " pod="openshift-network-operator/iptables-alerter-fhh6n" Jun 10 14:55:00.994421 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.994190 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ee837172-4366-4f5e-8aa0-06c0c17f0bca-kubelet-config\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:00.994421 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.993520 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-run-netns\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.994421 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.994206 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/792f5971-505f-4445-873d-156674dfc5b0-host-slash\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.994558 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.994417 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/792f5971-505f-4445-873d-156674dfc5b0-ovnkube-script-lib\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.994558 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.994453 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/792f5971-505f-4445-873d-156674dfc5b0-ovnkube-config\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:00.996622 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:00.996599 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/792f5971-505f-4445-873d-156674dfc5b0-ovn-node-metrics-cert\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:01.009545 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.009506 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt2r6\" (UniqueName: \"kubernetes.io/projected/792f5971-505f-4445-873d-156674dfc5b0-kube-api-access-lt2r6\") pod \"ovnkube-node-224fh\" (UID: \"792f5971-505f-4445-873d-156674dfc5b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:01.012380 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:01.012353 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:01.012380 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:01.012377 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:01.012553 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:01.012405 2560 projected.go:196] Error preparing data for projected volume kube-api-access-654k2 for pod openshift-network-diagnostics/network-check-target-b74wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:01.012553 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:01.012464 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2 podName:3542c9e3-6f7b-4b12-8cfd-7a4cc475080c nodeName:}" failed. No retries permitted until 2026-06-10 14:55:01.512445201 +0000 UTC m=+3.099234931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-654k2" (UniqueName: "kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2") pod "network-check-target-b74wj" (UID: "3542c9e3-6f7b-4b12-8cfd-7a4cc475080c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:01.014152 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.014113 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdbl8\" (UniqueName: \"kubernetes.io/projected/25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a-kube-api-access-hdbl8\") pod \"iptables-alerter-fhh6n\" (UID: \"25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a\") " pod="openshift-network-operator/iptables-alerter-fhh6n" Jun 10 14:55:01.015079 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.015058 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh57k\" (UniqueName: \"kubernetes.io/projected/f54ab5dc-d0e0-453e-92f1-968e16b67c00-kube-api-access-rh57k\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:01.081608 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.081571 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" Jun 10 14:55:01.089870 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.089847 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k54c5" Jun 10 14:55:01.099414 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.099382 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hrdbz" Jun 10 14:55:01.103904 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.103886 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-72c4r" Jun 10 14:55:01.109702 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.109684 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dbpgp" Jun 10 14:55:01.116557 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.116530 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4plgp" Jun 10 14:55:01.122268 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.122248 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9zthd" Jun 10 14:55:01.129294 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.129263 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fhh6n" Jun 10 14:55:01.134931 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.134911 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:01.495644 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.495605 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:01.495644 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.495645 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:01.495883 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:01.495753 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:01.495883 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:01.495836 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret podName:ee837172-4366-4f5e-8aa0-06c0c17f0bca nodeName:}" failed. No retries permitted until 2026-06-10 14:55:02.495813761 +0000 UTC m=+4.082603467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret") pod "global-pull-secret-syncer-qdpbt" (UID: "ee837172-4366-4f5e-8aa0-06c0c17f0bca") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:01.495883 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:01.495755 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:01.496000 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:01.495910 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs podName:f54ab5dc-d0e0-453e-92f1-968e16b67c00 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:02.495891803 +0000 UTC m=+4.082681522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs") pod "network-metrics-daemon-nvzzs" (UID: "f54ab5dc-d0e0-453e-92f1-968e16b67c00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:01.596864 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.596833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-654k2\" (UniqueName: \"kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2\") pod \"network-check-target-b74wj\" (UID: \"3542c9e3-6f7b-4b12-8cfd-7a4cc475080c\") " pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:01.597004 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:01.596987 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:01.597069 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:01.597011 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:01.597069 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:01.597024 2560 projected.go:196] Error preparing data for projected volume kube-api-access-654k2 for pod openshift-network-diagnostics/network-check-target-b74wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:01.597155 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:01.597075 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2 podName:3542c9e3-6f7b-4b12-8cfd-7a4cc475080c nodeName:}" failed. No retries permitted until 2026-06-10 14:55:02.597057817 +0000 UTC m=+4.183847520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-654k2" (UniqueName: "kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2") pod "network-check-target-b74wj" (UID: "3542c9e3-6f7b-4b12-8cfd-7a4cc475080c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:01.598644 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:55:01.598619 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792f5971_505f_4445_873d_156674dfc5b0.slice/crio-ffd1561b4df9cffebc8ffaf9710335785a56bba21a9b04f42e36367b907bf38b WatchSource:0}: Error finding container ffd1561b4df9cffebc8ffaf9710335785a56bba21a9b04f42e36367b907bf38b: Status 404 returned error can't find the container with id ffd1561b4df9cffebc8ffaf9710335785a56bba21a9b04f42e36367b907bf38b Jun 10 14:55:01.618238 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:55:01.618136 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2108ce_1ce5_4aca_ae6b_5fa6d109c85a.slice/crio-0f257b9149aea774c83d8ac51daa56422659eec8ab66bceef083e52211ae3708 WatchSource:0}: Error finding container 0f257b9149aea774c83d8ac51daa56422659eec8ab66bceef083e52211ae3708: Status 404 returned error can't find the container with id 0f257b9149aea774c83d8ac51daa56422659eec8ab66bceef083e52211ae3708 Jun 10 14:55:01.620236 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:55:01.620210 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96be0e35_f6f4_4074_af48_3c2600372ee9.slice/crio-b9349af88bb3d5264eba4eb848afe0366ce81ee393f7887ec38081f1250075f6 WatchSource:0}: Error finding container b9349af88bb3d5264eba4eb848afe0366ce81ee393f7887ec38081f1250075f6: Status 404 returned error can't find the container with id b9349af88bb3d5264eba4eb848afe0366ce81ee393f7887ec38081f1250075f6 Jun 10 14:55:01.625506 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:55:01.625486 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1328ca2f_86e3_46cf_9a7c_90aa349b46cc.slice/crio-736ad17b89335c65c48cf2787d4c7bbc2b4d982c5477e4664d1e9e3d9a25116a WatchSource:0}: Error finding container 736ad17b89335c65c48cf2787d4c7bbc2b4d982c5477e4664d1e9e3d9a25116a: Status 404 returned error can't find the container with id 736ad17b89335c65c48cf2787d4c7bbc2b4d982c5477e4664d1e9e3d9a25116a Jun 10 14:55:01.627111 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:55:01.627092 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443a9574_ddb3_4b8d_949a_c1fcbb4e7a36.slice/crio-e8a2eb7c611314b6b0d54a0a97841c2fa7703c53c1a0dd58df1cd6e6613b3abd WatchSource:0}: Error finding container e8a2eb7c611314b6b0d54a0a97841c2fa7703c53c1a0dd58df1cd6e6613b3abd: Status 404 returned error can't find the container with id e8a2eb7c611314b6b0d54a0a97841c2fa7703c53c1a0dd58df1cd6e6613b3abd Jun 10 14:55:01.628631 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:55:01.628561 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2438bf76_f556_4a2f_83c6_dcf98a216432.slice/crio-41c6ccd002a6b288d1165c3077644cc00af6b9c297a645a152f88d11231b755f WatchSource:0}: Error finding container 41c6ccd002a6b288d1165c3077644cc00af6b9c297a645a152f88d11231b755f: Status 404 returned error can't find the container with id 41c6ccd002a6b288d1165c3077644cc00af6b9c297a645a152f88d11231b755f Jun 10 14:55:01.630110 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:55:01.630050 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ce4893_4ae4_45c1_bc62_4a9e91fd3f4a.slice/crio-2d41c7a593d503d041e88334088b45b0fea1b18b5eca7189d5b339eb30998a44 WatchSource:0}: Error finding container 2d41c7a593d503d041e88334088b45b0fea1b18b5eca7189d5b339eb30998a44: Status 404 returned error can't find the container with id 2d41c7a593d503d041e88334088b45b0fea1b18b5eca7189d5b339eb30998a44 Jun 10 14:55:01.631819 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:55:01.631712 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be51e0a_72b9_42c9_9dd2_4249c560e96b.slice/crio-33c53b08c121fe588f9ab0b47e34102c02517ed37a7f18e2bd2dc45d7c913ae5 WatchSource:0}: Error finding container 33c53b08c121fe588f9ab0b47e34102c02517ed37a7f18e2bd2dc45d7c913ae5: Status 404 returned error can't find the container with id 33c53b08c121fe588f9ab0b47e34102c02517ed37a7f18e2bd2dc45d7c913ae5 Jun 10 14:55:01.633759 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:55:01.633685 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod366482e2_0d37_4e7a_8344_4414bcab48d6.slice/crio-9ad7962452ad97cf5d0db3cfef1cd5616cac46da12e78e87895ffba45621f2d9 WatchSource:0}: Error finding container 9ad7962452ad97cf5d0db3cfef1cd5616cac46da12e78e87895ffba45621f2d9: Status 404 returned error can't find the container with id 9ad7962452ad97cf5d0db3cfef1cd5616cac46da12e78e87895ffba45621f2d9 Jun 10 14:55:01.837219 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.836869 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 14:50:00 +0000 UTC" deadline="2028-01-28 09:57:13.943032668 +0000 UTC" Jun 10 14:55:01.837219 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.837085 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14323h2m12.105954256s" Jun 10 14:55:01.846882 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.846859 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:01.846997 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:01.846978 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:01.855706 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.855672 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" event={"ID":"8be6d5f80eb92a9d92719a07fd96bd87","Type":"ContainerStarted","Data":"784e1496dc2402897e93390110bfb643e9d81d0c2dbebc2b62ee2d59624e1ff2"} Jun 10 14:55:01.856980 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.856955 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9zthd" event={"ID":"0be51e0a-72b9-42c9-9dd2-4249c560e96b","Type":"ContainerStarted","Data":"33c53b08c121fe588f9ab0b47e34102c02517ed37a7f18e2bd2dc45d7c913ae5"} Jun 10 14:55:01.858370 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.858345 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-72c4r" event={"ID":"2438bf76-f556-4a2f-83c6-dcf98a216432","Type":"ContainerStarted","Data":"41c6ccd002a6b288d1165c3077644cc00af6b9c297a645a152f88d11231b755f"} Jun 10 14:55:01.859348 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.859328 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4plgp" event={"ID":"443a9574-ddb3-4b8d-949a-c1fcbb4e7a36","Type":"ContainerStarted","Data":"e8a2eb7c611314b6b0d54a0a97841c2fa7703c53c1a0dd58df1cd6e6613b3abd"} Jun 10 14:55:01.860433 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.860411 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrdbz" event={"ID":"96be0e35-f6f4-4074-af48-3c2600372ee9","Type":"ContainerStarted","Data":"b9349af88bb3d5264eba4eb848afe0366ce81ee393f7887ec38081f1250075f6"} Jun 10 14:55:01.861647 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.861618 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" event={"ID":"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a","Type":"ContainerStarted","Data":"0f257b9149aea774c83d8ac51daa56422659eec8ab66bceef083e52211ae3708"} Jun 10 14:55:01.862648 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.862618 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dbpgp" event={"ID":"366482e2-0d37-4e7a-8344-4414bcab48d6","Type":"ContainerStarted","Data":"9ad7962452ad97cf5d0db3cfef1cd5616cac46da12e78e87895ffba45621f2d9"} Jun 10 14:55:01.863658 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.863628 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fhh6n" event={"ID":"25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a","Type":"ContainerStarted","Data":"2d41c7a593d503d041e88334088b45b0fea1b18b5eca7189d5b339eb30998a44"} Jun 10 14:55:01.864701 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.864683 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k54c5" event={"ID":"1328ca2f-86e3-46cf-9a7c-90aa349b46cc","Type":"ContainerStarted","Data":"736ad17b89335c65c48cf2787d4c7bbc2b4d982c5477e4664d1e9e3d9a25116a"} Jun 10 14:55:01.865607 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:01.865591 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" event={"ID":"792f5971-505f-4445-873d-156674dfc5b0","Type":"ContainerStarted","Data":"ffd1561b4df9cffebc8ffaf9710335785a56bba21a9b04f42e36367b907bf38b"} Jun 10 14:55:02.504618 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:02.504575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:02.504789 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:02.504680 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:02.504848 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:02.504805 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:02.504923 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:02.504868 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret podName:ee837172-4366-4f5e-8aa0-06c0c17f0bca nodeName:}" failed. No retries permitted until 2026-06-10 14:55:04.504850452 +0000 UTC m=+6.091640156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret") pod "global-pull-secret-syncer-qdpbt" (UID: "ee837172-4366-4f5e-8aa0-06c0c17f0bca") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:02.505300 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:02.505281 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:02.505408 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:02.505335 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs podName:f54ab5dc-d0e0-453e-92f1-968e16b67c00 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:04.505319962 +0000 UTC m=+6.092109665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs") pod "network-metrics-daemon-nvzzs" (UID: "f54ab5dc-d0e0-453e-92f1-968e16b67c00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:02.605928 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:02.605889 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-654k2\" (UniqueName: \"kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2\") pod \"network-check-target-b74wj\" (UID: \"3542c9e3-6f7b-4b12-8cfd-7a4cc475080c\") " pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:02.606126 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:02.606109 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:02.606186 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:02.606137 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:02.606186 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:02.606150 2560 projected.go:196] Error preparing data for projected volume kube-api-access-654k2 for pod openshift-network-diagnostics/network-check-target-b74wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:02.606288 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:02.606209 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2 podName:3542c9e3-6f7b-4b12-8cfd-7a4cc475080c nodeName:}" failed. No retries permitted until 2026-06-10 14:55:04.606191485 +0000 UTC m=+6.192981189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-654k2" (UniqueName: "kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2") pod "network-check-target-b74wj" (UID: "3542c9e3-6f7b-4b12-8cfd-7a4cc475080c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:02.837806 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:02.837701 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 14:50:00 +0000 UTC" deadline="2028-01-22 11:02:36.348691696 +0000 UTC" Jun 10 14:55:02.837806 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:02.837747 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14180h7m33.510946527s" Jun 10 14:55:02.848114 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:02.847521 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:02.848114 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:02.847653 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:02.848114 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:02.847976 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:02.848114 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:02.848070 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:02.881928 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:02.881890 2560 generic.go:356] "Generic (PLEG): container finished" podID="e251d96f88f737740ad888eb8d094183" containerID="3ff46845549b05974c67d715aa27ba3613f900c9557253a8f71c8dbd8abecfec" exitCode=0 Jun 10 14:55:02.882460 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:02.882433 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" event={"ID":"e251d96f88f737740ad888eb8d094183","Type":"ContainerDied","Data":"3ff46845549b05974c67d715aa27ba3613f900c9557253a8f71c8dbd8abecfec"} Jun 10 14:55:02.899977 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:02.899842 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" podStartSLOduration=2.899823536 podStartE2EDuration="2.899823536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:55:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:01.872634976 +0000 UTC m=+3.459424701" watchObservedRunningTime="2026-06-10 14:55:02.899823536 +0000 UTC m=+4.486613261" Jun 10 14:55:03.846329 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:03.846276 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:03.846833 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:03.846424 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:03.897268 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:03.897210 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" event={"ID":"e251d96f88f737740ad888eb8d094183","Type":"ContainerStarted","Data":"b6263de9ab2a7303641fb6947009a5fc8fdc6811ba3ae4cc88ca8f3c2736fa9a"} Jun 10 14:55:03.914973 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:03.914915 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" podStartSLOduration=3.914863735 podStartE2EDuration="3.914863735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:55:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:03.913930299 +0000 UTC m=+5.500720025" watchObservedRunningTime="2026-06-10 14:55:03.914863735 +0000 UTC m=+5.501653459" Jun 10 14:55:04.522197 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:04.522156 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:04.522383 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:04.522215 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:04.522383 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:04.522354 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:04.522586 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:04.522434 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs podName:f54ab5dc-d0e0-453e-92f1-968e16b67c00 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:08.522415838 +0000 UTC m=+10.109205556 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs") pod "network-metrics-daemon-nvzzs" (UID: "f54ab5dc-d0e0-453e-92f1-968e16b67c00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:04.522586 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:04.522545 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:04.522691 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:04.522602 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret podName:ee837172-4366-4f5e-8aa0-06c0c17f0bca nodeName:}" failed. No retries permitted until 2026-06-10 14:55:08.522587319 +0000 UTC m=+10.109377040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret") pod "global-pull-secret-syncer-qdpbt" (UID: "ee837172-4366-4f5e-8aa0-06c0c17f0bca") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:04.623371 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:04.623326 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-654k2\" (UniqueName: \"kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2\") pod \"network-check-target-b74wj\" (UID: \"3542c9e3-6f7b-4b12-8cfd-7a4cc475080c\") " pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:04.623591 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:04.623558 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:04.623591 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:04.623582 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:04.623692 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:04.623595 2560 projected.go:196] Error preparing data for projected volume kube-api-access-654k2 for pod openshift-network-diagnostics/network-check-target-b74wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:04.623692 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:04.623657 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2 podName:3542c9e3-6f7b-4b12-8cfd-7a4cc475080c nodeName:}" failed. No retries permitted until 2026-06-10 14:55:08.623638325 +0000 UTC m=+10.210428119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-654k2" (UniqueName: "kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2") pod "network-check-target-b74wj" (UID: "3542c9e3-6f7b-4b12-8cfd-7a4cc475080c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:04.848055 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:04.847981 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:04.848494 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:04.848123 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:04.848566 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:04.848514 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:04.848631 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:04.848609 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:05.846795 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:05.846759 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:05.846964 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:05.846893 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:06.846520 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:06.846484 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:06.846879 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:06.846632 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:06.847053 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:06.847038 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:06.847151 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:06.847124 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:07.846567 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:07.846534 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:07.847041 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:07.846661 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:08.557580 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:08.557543 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:08.557758 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:08.557602 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:08.557758 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:08.557731 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:08.557869 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:08.557787 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs podName:f54ab5dc-d0e0-453e-92f1-968e16b67c00 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:16.557769755 +0000 UTC m=+18.144559469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs") pod "network-metrics-daemon-nvzzs" (UID: "f54ab5dc-d0e0-453e-92f1-968e16b67c00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:08.557923 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:08.557884 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:08.557979 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:08.557942 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret podName:ee837172-4366-4f5e-8aa0-06c0c17f0bca nodeName:}" failed. No retries permitted until 2026-06-10 14:55:16.55792607 +0000 UTC m=+18.144715777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret") pod "global-pull-secret-syncer-qdpbt" (UID: "ee837172-4366-4f5e-8aa0-06c0c17f0bca") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:08.658231 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:08.658190 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-654k2\" (UniqueName: \"kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2\") pod \"network-check-target-b74wj\" (UID: \"3542c9e3-6f7b-4b12-8cfd-7a4cc475080c\") " pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:08.658432 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:08.658408 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:08.658432 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:08.658431 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:08.658546 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:08.658443 2560 projected.go:196] Error preparing data for projected volume kube-api-access-654k2 for pod openshift-network-diagnostics/network-check-target-b74wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:08.658546 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:08.658502 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2 podName:3542c9e3-6f7b-4b12-8cfd-7a4cc475080c nodeName:}" failed. No retries permitted until 2026-06-10 14:55:16.65848408 +0000 UTC m=+18.245273786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-654k2" (UniqueName: "kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2") pod "network-check-target-b74wj" (UID: "3542c9e3-6f7b-4b12-8cfd-7a4cc475080c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:08.846940 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:08.846868 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:08.847318 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:08.846955 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:08.847318 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:08.846993 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:08.847318 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:08.847102 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:09.846284 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:09.846241 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:09.846504 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:09.846359 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:10.846252 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:10.846208 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:10.846707 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:10.846345 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:10.846822 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:10.846795 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:10.846941 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:10.846883 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:11.846871 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:11.846834 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:11.847275 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:11.846943 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:12.845872 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:12.845804 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:12.846059 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:12.845943 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:12.846059 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:12.846032 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:12.846174 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:12.846149 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:13.846758 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:13.846728 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:13.847128 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:13.846847 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:14.846695 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:14.846658 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:14.846886 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:14.846712 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:14.846886 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:14.846821 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:14.847242 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:14.846878 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:15.846874 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:15.846368 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:15.846874 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:15.846502 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:16.619616 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:16.619583 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:16.619616 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:16.619631 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:16.619843 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:16.619737 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:16.619843 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:16.619741 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:16.619843 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:16.619809 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs podName:f54ab5dc-d0e0-453e-92f1-968e16b67c00 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:32.619791332 +0000 UTC m=+34.206581053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs") pod "network-metrics-daemon-nvzzs" (UID: "f54ab5dc-d0e0-453e-92f1-968e16b67c00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:16.619843 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:16.619829 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret podName:ee837172-4366-4f5e-8aa0-06c0c17f0bca nodeName:}" failed. No retries permitted until 2026-06-10 14:55:32.619819011 +0000 UTC m=+34.206608718 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret") pod "global-pull-secret-syncer-qdpbt" (UID: "ee837172-4366-4f5e-8aa0-06c0c17f0bca") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:16.720587 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:16.720555 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-654k2\" (UniqueName: \"kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2\") pod \"network-check-target-b74wj\" (UID: \"3542c9e3-6f7b-4b12-8cfd-7a4cc475080c\") " pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:16.720725 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:16.720663 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:16.720725 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:16.720686 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:16.720725 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:16.720701 2560 projected.go:196] Error preparing data for projected volume kube-api-access-654k2 for pod openshift-network-diagnostics/network-check-target-b74wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:16.720868 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:16.720757 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2 podName:3542c9e3-6f7b-4b12-8cfd-7a4cc475080c nodeName:}" failed. No retries permitted until 2026-06-10 14:55:32.720742996 +0000 UTC m=+34.307532700 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-654k2" (UniqueName: "kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2") pod "network-check-target-b74wj" (UID: "3542c9e3-6f7b-4b12-8cfd-7a4cc475080c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:16.846529 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:16.846501 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:16.846702 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:16.846502 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:16.846702 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:16.846639 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:16.846796 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:16.846707 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:17.846792 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:17.846757 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:17.847190 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:17.846873 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:18.847169 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:18.847127 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:18.847643 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:18.847237 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:18.847643 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:18.847284 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:18.847643 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:18.847378 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:19.846170 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:19.846139 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:19.846338 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:19.846241 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:20.846105 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.846080 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:20.846638 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.846120 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:20.846638 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:20.846199 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:20.846638 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:20.846325 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:20.932064 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.932033 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9zthd" event={"ID":"0be51e0a-72b9-42c9-9dd2-4249c560e96b","Type":"ContainerStarted","Data":"fdeb1d93ebea60c714bdf65d4cf076f740a6ca247c710c1f84c375270777b634"} Jun 10 14:55:20.933465 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.933441 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-72c4r" event={"ID":"2438bf76-f556-4a2f-83c6-dcf98a216432","Type":"ContainerStarted","Data":"22af6ec9a7555a83dc26ac2d7885e10e6e96d16f4df69fbc3462629dbc1166d8"} Jun 10 14:55:20.935004 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.934978 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4plgp" event={"ID":"443a9574-ddb3-4b8d-949a-c1fcbb4e7a36","Type":"ContainerStarted","Data":"d8bf580225d5591369fda9a8bf2493405c25b7d1a8a4f002ed8bda42405dd557"} Jun 10 14:55:20.936542 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.936519 2560 generic.go:356] "Generic (PLEG): container finished" podID="96be0e35-f6f4-4074-af48-3c2600372ee9" containerID="8fe9ee3131a88f57a57dfef99542408ea07327eb9906a0e1e31acd6228189322" exitCode=0 Jun 10 14:55:20.936638 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.936588 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrdbz" event={"ID":"96be0e35-f6f4-4074-af48-3c2600372ee9","Type":"ContainerDied","Data":"8fe9ee3131a88f57a57dfef99542408ea07327eb9906a0e1e31acd6228189322"} Jun 10 14:55:20.938202 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.938183 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" event={"ID":"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a","Type":"ContainerStarted","Data":"4cc058859f889773bb4ba0450bc5b5c665143a20df04bb7247712265b5bc5264"} Jun 10 14:55:20.939604 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.939584 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dbpgp" event={"ID":"366482e2-0d37-4e7a-8344-4414bcab48d6","Type":"ContainerStarted","Data":"b09cc5315fbc66fb55b0d1ae049836659bccafe06351cf931acfc33077bf199a"} Jun 10 14:55:20.944186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.941442 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k54c5" event={"ID":"1328ca2f-86e3-46cf-9a7c-90aa349b46cc","Type":"ContainerStarted","Data":"b62c752f2a96e61dec8c2139cb426e592fa763ed235c2c50f25bdf71a646c7c5"} Jun 10 14:55:20.945989 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.945972 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 14:55:20.946346 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.946329 2560 generic.go:356] "Generic (PLEG): container finished" podID="792f5971-505f-4445-873d-156674dfc5b0" containerID="beba00603b3e1f8507978b2afa6cb0f14c25a4a95aaa28afc531b9b800281ae1" exitCode=1 Jun 10 14:55:20.946441 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.946357 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" event={"ID":"792f5971-505f-4445-873d-156674dfc5b0","Type":"ContainerDied","Data":"beba00603b3e1f8507978b2afa6cb0f14c25a4a95aaa28afc531b9b800281ae1"} Jun 10 14:55:20.946481 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.946436 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" event={"ID":"792f5971-505f-4445-873d-156674dfc5b0","Type":"ContainerStarted","Data":"7a59cc81588da09c9178a57cfd2dac9d6c040402cb38a6f8f321cb4f90089c1f"} Jun 10 14:55:20.954798 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.954757 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9zthd" podStartSLOduration=3.104715532 podStartE2EDuration="21.954729859s" totalImagesPullingTime="18.850014327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:20.954032263 +0000 UTC m=+22.540821985" watchObservedRunningTime="2026-06-10 14:55:20.954729859 +0000 UTC m=+22.541519572" Jun 10 14:55:20.978442 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:20.978402 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-72c4r" podStartSLOduration=3.1232025820000002 podStartE2EDuration="21.978370526s" totalImagesPullingTime="18.855167944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:20.978164062 +0000 UTC m=+22.564953786" watchObservedRunningTime="2026-06-10 14:55:20.978370526 +0000 UTC m=+22.565160254" Jun 10 14:55:21.002645 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:21.002590 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k54c5" podStartSLOduration=4.091406542 podStartE2EDuration="23.002569676s" totalImagesPullingTime="18.911163134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:21.001726114 +0000 UTC m=+22.588515836" watchObservedRunningTime="2026-06-10 14:55:21.002569676 +0000 UTC m=+22.589359471" Jun 10 14:55:21.053374 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:21.053242 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dbpgp" podStartSLOduration=3.202877739 podStartE2EDuration="22.053226305s" totalImagesPullingTime="18.850348566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:21.053038383 +0000 UTC m=+22.639828106" watchObservedRunningTime="2026-06-10 14:55:21.053226305 +0000 UTC m=+22.640016027" Jun 10 14:55:21.075650 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:21.075612 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4plgp" podStartSLOduration=3.218875162 podStartE2EDuration="22.075596266s" totalImagesPullingTime="18.856721104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:21.075325276 +0000 UTC m=+22.662115002" watchObservedRunningTime="2026-06-10 14:55:21.075596266 +0000 UTC m=+22.662385988" Jun 10 14:55:21.846484 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:21.846438 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:21.847020 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:21.846575 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:21.950036 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:21.950007 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fhh6n" event={"ID":"25ce4893-4ae4-45c1-bc62-4a9e91fd3f4a","Type":"ContainerStarted","Data":"47688c5db1c25959c4bb829f724d0a27e5bd0caf25d23bec196e120a70b76b0f"} Jun 10 14:55:21.953166 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:21.953148 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 14:55:21.953703 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:21.953676 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" event={"ID":"792f5971-505f-4445-873d-156674dfc5b0","Type":"ContainerStarted","Data":"2a29d6217e4989577574420ce2d91929cdf04f61ee2b7bd63af4c2bb6aa218a5"} Jun 10 14:55:21.953804 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:21.953750 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" event={"ID":"792f5971-505f-4445-873d-156674dfc5b0","Type":"ContainerStarted","Data":"f881f22716b130a102d5c17b10928f4f3189390af36c0ab5864e01ca72a7ab42"} Jun 10 14:55:21.953804 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:21.953796 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" event={"ID":"792f5971-505f-4445-873d-156674dfc5b0","Type":"ContainerStarted","Data":"8b598bca1fda4ce83cf66b1373245e4d4311bb1e79a194e55ea48f4a1c4d577f"} Jun 10 14:55:21.953916 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:21.953826 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" event={"ID":"792f5971-505f-4445-873d-156674dfc5b0","Type":"ContainerStarted","Data":"824770caaf8929313fcc434ca6c98a0e13b79d81f6c52a4ab62f123c66c3b5ba"} Jun 10 14:55:21.972286 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:21.972234 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fhh6n" podStartSLOduration=4.095853833 podStartE2EDuration="22.972215711s" totalImagesPullingTime="18.876361878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:21.971664083 +0000 UTC m=+23.558453807" watchObservedRunningTime="2026-06-10 14:55:21.972215711 +0000 UTC m=+23.559005436" Jun 10 14:55:22.071759 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:22.071732 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 14:55:22.844162 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:22.844070 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T14:55:22.071755676Z","UUID":"63c19f6c-d3eb-4c31-a549-ccb7a07e43b7","Handler":null,"Name":"","Endpoint":""} Jun 10 14:55:22.845824 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:22.845800 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 14:55:22.845955 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:22.845844 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 14:55:22.846196 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:22.846168 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:22.846344 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:22.846211 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:22.846344 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:22.846311 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:22.846482 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:22.846408 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:22.957430 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:22.957375 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" event={"ID":"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a","Type":"ContainerStarted","Data":"72bd30ceb99e40aeba1f7f877413b571db41e5f82db6927e83fffb4472975ce6"} Jun 10 14:55:23.224973 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:23.224944 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4plgp" Jun 10 14:55:23.846202 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:23.845993 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:23.846383 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:23.846284 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:23.962201 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:23.962158 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" event={"ID":"4d2108ce-1ce5-4aca-ae6b-5fa6d109c85a","Type":"ContainerStarted","Data":"7498e53541aba6f44e89e18ddd6e7fd898577ca2cf3a0d18c4f1332c7402b83f"} Jun 10 14:55:23.965311 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:23.965291 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 14:55:23.965693 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:23.965670 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" event={"ID":"792f5971-505f-4445-873d-156674dfc5b0","Type":"ContainerStarted","Data":"0ca03d8c9e8eed765e8bd7cf546eb0132cdee1bb014edf6318c10536701e6312"} Jun 10 14:55:24.846265 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:24.846229 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:24.846515 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:24.846370 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:24.846515 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:24.846452 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:24.846641 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:24.846567 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:25.585577 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:25.585544 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4plgp" Jun 10 14:55:25.586331 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:25.586171 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4plgp" Jun 10 14:55:25.603414 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:25.603328 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kb6cq" podStartSLOduration=6.689120101 podStartE2EDuration="27.603314437s" totalImagesPullingTime="20.914194336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:54:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:24.000813537 +0000 UTC m=+25.587603298" watchObservedRunningTime="2026-06-10 14:55:25.603314437 +0000 UTC m=+27.190104170" Jun 10 14:55:25.846378 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:25.846343 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:25.846553 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:25.846474 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:25.971063 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:25.971042 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4plgp" Jun 10 14:55:26.847000 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:26.846787 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:26.847555 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:26.846805 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:26.847555 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:26.847103 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:26.847555 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:26.847170 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:26.974246 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:26.974206 2560 generic.go:356] "Generic (PLEG): container finished" podID="96be0e35-f6f4-4074-af48-3c2600372ee9" containerID="8c7b288af675bf9c070bba188f7b2cbfc15fc53326d3127c9bc9534dde1340a6" exitCode=0 Jun 10 14:55:26.974378 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:26.974266 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrdbz" event={"ID":"96be0e35-f6f4-4074-af48-3c2600372ee9","Type":"ContainerDied","Data":"8c7b288af675bf9c070bba188f7b2cbfc15fc53326d3127c9bc9534dde1340a6"} Jun 10 14:55:26.977849 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:26.977831 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 14:55:26.978239 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:26.978211 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" event={"ID":"792f5971-505f-4445-873d-156674dfc5b0","Type":"ContainerStarted","Data":"a667c74c1f7ab8047adb3e5a626019bf624a0c57b46b83b292ec15cca307555a"} Jun 10 14:55:26.978490 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:26.978456 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:26.978604 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:26.978512 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:26.978604 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:26.978575 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:26.978690 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:26.978651 2560 scope.go:117] "RemoveContainer" containerID="beba00603b3e1f8507978b2afa6cb0f14c25a4a95aaa28afc531b9b800281ae1" Jun 10 14:55:26.994877 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:26.994858 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:26.995497 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:26.995479 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:27.846323 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:27.846227 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:27.846517 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:27.846364 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:27.983891 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:27.983749 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 14:55:27.984292 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:27.984266 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" event={"ID":"792f5971-505f-4445-873d-156674dfc5b0","Type":"ContainerStarted","Data":"3df43c3173990f25b7f1cc3e447f68b0cd1227b350d9b7a443be27cb2d405867"} Jun 10 14:55:27.986184 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:27.986162 2560 generic.go:356] "Generic (PLEG): container finished" podID="96be0e35-f6f4-4074-af48-3c2600372ee9" containerID="fc4c74dbf60d79875b4c70f1ea3432d5d59e7bf279ec750b818b166701830176" exitCode=0 Jun 10 14:55:27.986297 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:27.986191 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrdbz" event={"ID":"96be0e35-f6f4-4074-af48-3c2600372ee9","Type":"ContainerDied","Data":"fc4c74dbf60d79875b4c70f1ea3432d5d59e7bf279ec750b818b166701830176"} Jun 10 14:55:28.018494 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:28.018456 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" podStartSLOduration=10.069100715 podStartE2EDuration="29.018443356s" totalImagesPullingTime="18.949342641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:28.017135372 +0000 UTC m=+29.603925095" watchObservedRunningTime="2026-06-10 14:55:28.018443356 +0000 UTC m=+29.605233079" Jun 10 14:55:28.144142 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:28.144106 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b74wj"] Jun 10 14:55:28.144275 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:28.144203 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:28.144316 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:28.144292 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:28.146173 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:28.146001 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nvzzs"] Jun 10 14:55:28.146173 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:28.146129 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:28.146421 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:28.146232 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:28.146710 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:28.146679 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qdpbt"] Jun 10 14:55:28.146811 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:28.146777 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:28.146892 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:28.146872 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:28.990292 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:28.990209 2560 generic.go:356] "Generic (PLEG): container finished" podID="96be0e35-f6f4-4074-af48-3c2600372ee9" containerID="b97891fbf580f5c6fd08e083bd4d5a58e06ee5e0212a41e86091b326d61ea24b" exitCode=0 Jun 10 14:55:28.990292 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:28.990261 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrdbz" event={"ID":"96be0e35-f6f4-4074-af48-3c2600372ee9","Type":"ContainerDied","Data":"b97891fbf580f5c6fd08e083bd4d5a58e06ee5e0212a41e86091b326d61ea24b"} Jun 10 14:55:29.846626 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:29.846550 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:29.846626 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:29.846581 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:29.846626 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:29.846594 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:29.846808 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:29.846670 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:29.846808 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:29.846793 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:29.846883 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:29.846863 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:30.042162 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:30.042118 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:30.132681 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:30.132647 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:31.846002 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:31.845975 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:31.846489 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:31.845975 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:31.846489 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:31.846084 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:55:31.846489 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:31.846136 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b74wj" podUID="3542c9e3-6f7b-4b12-8cfd-7a4cc475080c" Jun 10 14:55:31.846489 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:31.845974 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:31.846489 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:31.846195 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdpbt" podUID="ee837172-4366-4f5e-8aa0-06c0c17f0bca" Jun 10 14:55:32.642000 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:32.641963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:32.642000 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:32.642010 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:32.642308 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:32.642120 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:32.642308 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:32.642119 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:32.642308 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:32.642178 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs podName:f54ab5dc-d0e0-453e-92f1-968e16b67c00 nodeName:}" failed. No retries permitted until 2026-06-10 14:56:04.642160027 +0000 UTC m=+66.228949743 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs") pod "network-metrics-daemon-nvzzs" (UID: "f54ab5dc-d0e0-453e-92f1-968e16b67c00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 14:55:32.642308 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:32.642197 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret podName:ee837172-4366-4f5e-8aa0-06c0c17f0bca nodeName:}" failed. No retries permitted until 2026-06-10 14:56:04.642188447 +0000 UTC m=+66.228978149 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret") pod "global-pull-secret-syncer-qdpbt" (UID: "ee837172-4366-4f5e-8aa0-06c0c17f0bca") : object "kube-system"/"original-pull-secret" not registered Jun 10 14:55:32.727231 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:32.727193 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:32.742383 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:32.742330 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-654k2\" (UniqueName: \"kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2\") pod \"network-check-target-b74wj\" (UID: \"3542c9e3-6f7b-4b12-8cfd-7a4cc475080c\") " pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:32.742547 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:32.742487 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 14:55:32.742547 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:32.742510 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 14:55:32.742547 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:32.742523 2560 projected.go:196] Error preparing data for projected volume kube-api-access-654k2 for pod openshift-network-diagnostics/network-check-target-b74wj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:32.742720 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:32.742610 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2 podName:3542c9e3-6f7b-4b12-8cfd-7a4cc475080c nodeName:}" failed. No retries permitted until 2026-06-10 14:56:04.742592005 +0000 UTC m=+66.329381713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-654k2" (UniqueName: "kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2") pod "network-check-target-b74wj" (UID: "3542c9e3-6f7b-4b12-8cfd-7a4cc475080c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 14:55:32.826556 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:32.826523 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:33.250875 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.250843 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeReady" Jun 10 14:55:33.251369 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.250986 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 14:55:33.313440 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.313407 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kckpq"] Jun 10 14:55:33.336041 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.336009 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z7hgb"] Jun 10 14:55:33.336520 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.336496 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:33.340929 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.340910 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 14:55:33.341305 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.341283 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 14:55:33.341433 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.341311 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lpmmf\"" Jun 10 14:55:33.356548 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.356515 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kckpq"] Jun 10 14:55:33.356665 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.356592 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z7hgb" Jun 10 14:55:33.356726 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.356597 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z7hgb"] Jun 10 14:55:33.359496 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.359476 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 14:55:33.359768 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.359755 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 14:55:33.360096 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.360080 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x42f2\"" Jun 10 14:55:33.360196 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.360112 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 14:55:33.416992 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.416906 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:33.447930 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.447892 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcf06589-00b6-4e3d-a60c-9023441c29b5-tmp-dir\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:33.448080 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.447939 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/349051fb-b35b-4493-b8c0-821175071eae-cert\") pod \"ingress-canary-z7hgb\" (UID: \"349051fb-b35b-4493-b8c0-821175071eae\") " pod="openshift-ingress-canary/ingress-canary-z7hgb" Jun 10 14:55:33.448080 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.447968 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcf06589-00b6-4e3d-a60c-9023441c29b5-config-volume\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:33.448080 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.447995 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwf5t\" (UniqueName: \"kubernetes.io/projected/349051fb-b35b-4493-b8c0-821175071eae-kube-api-access-rwf5t\") pod \"ingress-canary-z7hgb\" (UID: \"349051fb-b35b-4493-b8c0-821175071eae\") " pod="openshift-ingress-canary/ingress-canary-z7hgb" Jun 10 14:55:33.448080 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.448035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmp7n\" (UniqueName: \"kubernetes.io/projected/fcf06589-00b6-4e3d-a60c-9023441c29b5-kube-api-access-qmp7n\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:33.448220 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.448127 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:33.517247 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.517211 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:33.549307 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.549271 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcf06589-00b6-4e3d-a60c-9023441c29b5-tmp-dir\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:33.549485 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.549318 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/349051fb-b35b-4493-b8c0-821175071eae-cert\") pod \"ingress-canary-z7hgb\" (UID: \"349051fb-b35b-4493-b8c0-821175071eae\") " pod="openshift-ingress-canary/ingress-canary-z7hgb" Jun 10 14:55:33.549485 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.549350 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcf06589-00b6-4e3d-a60c-9023441c29b5-config-volume\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:33.549485 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.549376 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwf5t\" (UniqueName: \"kubernetes.io/projected/349051fb-b35b-4493-b8c0-821175071eae-kube-api-access-rwf5t\") pod \"ingress-canary-z7hgb\" (UID: \"349051fb-b35b-4493-b8c0-821175071eae\") " pod="openshift-ingress-canary/ingress-canary-z7hgb" Jun 10 14:55:33.549485 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.549423 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmp7n\" (UniqueName: \"kubernetes.io/projected/fcf06589-00b6-4e3d-a60c-9023441c29b5-kube-api-access-qmp7n\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:33.549485 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.549471 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:33.549743 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:33.549563 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:55:33.549743 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:33.549620 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls podName:fcf06589-00b6-4e3d-a60c-9023441c29b5 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:34.049600815 +0000 UTC m=+35.636390537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls") pod "dns-default-kckpq" (UID: "fcf06589-00b6-4e3d-a60c-9023441c29b5") : secret "dns-default-metrics-tls" not found Jun 10 14:55:33.549743 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.549690 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcf06589-00b6-4e3d-a60c-9023441c29b5-tmp-dir\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:33.550422 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.550382 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcf06589-00b6-4e3d-a60c-9023441c29b5-config-volume\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:33.554493 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.554336 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/349051fb-b35b-4493-b8c0-821175071eae-cert\") pod \"ingress-canary-z7hgb\" (UID: \"349051fb-b35b-4493-b8c0-821175071eae\") " pod="openshift-ingress-canary/ingress-canary-z7hgb" Jun 10 14:55:33.560723 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.560697 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmp7n\" (UniqueName: \"kubernetes.io/projected/fcf06589-00b6-4e3d-a60c-9023441c29b5-kube-api-access-qmp7n\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:33.561306 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.561286 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwf5t\" (UniqueName: \"kubernetes.io/projected/349051fb-b35b-4493-b8c0-821175071eae-kube-api-access-rwf5t\") pod \"ingress-canary-z7hgb\" (UID: \"349051fb-b35b-4493-b8c0-821175071eae\") " pod="openshift-ingress-canary/ingress-canary-z7hgb" Jun 10 14:55:33.666405 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.666354 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z7hgb" Jun 10 14:55:33.845924 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.845897 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:55:33.846081 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.845894 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:55:33.846145 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.845894 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:55:33.848779 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.848762 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 14:55:33.849555 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.849538 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xgr9p\"" Jun 10 14:55:33.849630 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.849544 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hk4k4\"" Jun 10 14:55:33.849668 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.849549 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 14:55:33.849717 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.849692 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 14:55:33.850125 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:33.850108 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 14:55:34.053321 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:34.053288 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:34.053480 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:34.053460 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:55:34.053541 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:34.053531 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls podName:fcf06589-00b6-4e3d-a60c-9023441c29b5 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:35.053512438 +0000 UTC m=+36.640302142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls") pod "dns-default-kckpq" (UID: "fcf06589-00b6-4e3d-a60c-9023441c29b5") : secret "dns-default-metrics-tls" not found Jun 10 14:55:34.060303 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:34.060276 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z7hgb"] Jun 10 14:55:34.171050 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:55:34.171024 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349051fb_b35b_4493_b8c0_821175071eae.slice/crio-e2fc5f3b4d21b924a70e62ec0372b76f8070317079fe800fe5d34d6e21004858 WatchSource:0}: Error finding container e2fc5f3b4d21b924a70e62ec0372b76f8070317079fe800fe5d34d6e21004858: Status 404 returned error can't find the container with id e2fc5f3b4d21b924a70e62ec0372b76f8070317079fe800fe5d34d6e21004858 Jun 10 14:55:34.339464 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:34.339443 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:34.439500 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:34.439476 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:35.008187 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:35.008147 2560 generic.go:356] "Generic (PLEG): container finished" podID="96be0e35-f6f4-4074-af48-3c2600372ee9" containerID="3c8311fdef3c397107b4f9591acc80847869e880e895be0968dde5d05dba8c2f" exitCode=0 Jun 10 14:55:35.008357 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:35.008233 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrdbz" event={"ID":"96be0e35-f6f4-4074-af48-3c2600372ee9","Type":"ContainerDied","Data":"3c8311fdef3c397107b4f9591acc80847869e880e895be0968dde5d05dba8c2f"} Jun 10 14:55:35.009476 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:35.009443 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z7hgb" event={"ID":"349051fb-b35b-4493-b8c0-821175071eae","Type":"ContainerStarted","Data":"e2fc5f3b4d21b924a70e62ec0372b76f8070317079fe800fe5d34d6e21004858"} Jun 10 14:55:35.060192 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:35.060160 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:35.060359 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:35.060343 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:55:35.060443 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:35.060426 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls podName:fcf06589-00b6-4e3d-a60c-9023441c29b5 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:37.060407574 +0000 UTC m=+38.647197290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls") pod "dns-default-kckpq" (UID: "fcf06589-00b6-4e3d-a60c-9023441c29b5") : secret "dns-default-metrics-tls" not found Jun 10 14:55:36.014255 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:36.014224 2560 generic.go:356] "Generic (PLEG): container finished" podID="96be0e35-f6f4-4074-af48-3c2600372ee9" containerID="4ca8bc979a06b61640e70f5dce1e8bd1b22ecf849bfd1d4e445e5b5679c14bf4" exitCode=0 Jun 10 14:55:36.014676 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:36.014265 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrdbz" event={"ID":"96be0e35-f6f4-4074-af48-3c2600372ee9","Type":"ContainerDied","Data":"4ca8bc979a06b61640e70f5dce1e8bd1b22ecf849bfd1d4e445e5b5679c14bf4"} Jun 10 14:55:37.019656 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:37.019458 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hrdbz" event={"ID":"96be0e35-f6f4-4074-af48-3c2600372ee9","Type":"ContainerStarted","Data":"b94d29100b69bfe6d59eac1aaea24e504bbc7fc4c0209616c22da3f6969806a1"} Jun 10 14:55:37.020792 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:37.020773 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z7hgb" event={"ID":"349051fb-b35b-4493-b8c0-821175071eae","Type":"ContainerStarted","Data":"7e9f25ec2966a8a7e566f328dbdd0b46b1589c33603665779987fc4096af00cf"} Jun 10 14:55:37.063025 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:37.062980 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z7hgb" podStartSLOduration=2.206154257 podStartE2EDuration="4.062967176s" totalImagesPullingTime="1.856812919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:37.062818425 +0000 UTC m=+38.649608159" watchObservedRunningTime="2026-06-10 14:55:37.062967176 +0000 UTC m=+38.649756899" Jun 10 14:55:37.063233 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:37.063209 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hrdbz" podStartSLOduration=7.735878211 podStartE2EDuration="38.063202094s" totalImagesPullingTime="30.327323883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:54:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:55:37.047582455 +0000 UTC m=+38.634372178" watchObservedRunningTime="2026-06-10 14:55:37.063202094 +0000 UTC m=+38.649991817" Jun 10 14:55:37.075151 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:37.075131 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:37.075251 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:37.075239 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:55:37.075297 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:37.075287 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls podName:fcf06589-00b6-4e3d-a60c-9023441c29b5 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:41.075275841 +0000 UTC m=+42.662065541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls") pod "dns-default-kckpq" (UID: "fcf06589-00b6-4e3d-a60c-9023441c29b5") : secret "dns-default-metrics-tls" not found Jun 10 14:55:37.184076 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:37.184015 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:37.253110 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:37.253083 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:39.032096 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:39.032070 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:39.132483 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:39.132452 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:41.103685 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:41.103649 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:41.104026 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:41.103765 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:55:41.104026 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:41.103817 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls podName:fcf06589-00b6-4e3d-a60c-9023441c29b5 nodeName:}" failed. No retries permitted until 2026-06-10 14:55:49.103802988 +0000 UTC m=+50.690592689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls") pod "dns-default-kckpq" (UID: "fcf06589-00b6-4e3d-a60c-9023441c29b5") : secret "dns-default-metrics-tls" not found Jun 10 14:55:42.579201 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:42.579164 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:42.720845 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:42.718558 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:42.844632 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:42.844521 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:43.649274 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:43.649236 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:43.754105 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:43.754076 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:44.528190 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:44.528160 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:46.287516 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:46.287483 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:46.387360 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:46.387330 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:49.161460 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:49.161428 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:55:49.161842 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:49.161543 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:55:49.161842 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:55:49.161607 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls podName:fcf06589-00b6-4e3d-a60c-9023441c29b5 nodeName:}" failed. No retries permitted until 2026-06-10 14:56:05.161594449 +0000 UTC m=+66.748384151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls") pod "dns-default-kckpq" (UID: "fcf06589-00b6-4e3d-a60c-9023441c29b5") : secret "dns-default-metrics-tls" not found Jun 10 14:55:54.874049 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:54.874011 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:54.930538 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:54.930507 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:55.753983 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:55.753952 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:55.852619 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:55.852592 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:55.954960 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:55.954935 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:56.642741 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:56.642712 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:56.742545 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:56.742515 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:59.000789 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:59.000764 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-224fh" Jun 10 14:55:59.179138 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:59.179100 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:59.235845 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:59.235814 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:59.886147 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:59.886115 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:55:59.986734 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:55:59.986705 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:56:04.663452 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:04.663384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:56:04.663831 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:04.663502 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:56:04.665972 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:04.665949 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 14:56:04.666099 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:04.666069 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 14:56:04.673960 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:56:04.673938 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 14:56:04.674021 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:56:04.674003 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs podName:f54ab5dc-d0e0-453e-92f1-968e16b67c00 nodeName:}" failed. No retries permitted until 2026-06-10 14:57:08.673989214 +0000 UTC m=+130.260778915 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs") pod "network-metrics-daemon-nvzzs" (UID: "f54ab5dc-d0e0-453e-92f1-968e16b67c00") : secret "metrics-daemon-secret" not found Jun 10 14:56:04.677649 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:04.677633 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee837172-4366-4f5e-8aa0-06c0c17f0bca-original-pull-secret\") pod \"global-pull-secret-syncer-qdpbt\" (UID: \"ee837172-4366-4f5e-8aa0-06c0c17f0bca\") " pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:56:04.765227 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:04.765193 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-654k2\" (UniqueName: \"kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2\") pod \"network-check-target-b74wj\" (UID: \"3542c9e3-6f7b-4b12-8cfd-7a4cc475080c\") " pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:56:04.765971 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:04.765947 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdpbt" Jun 10 14:56:04.768111 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:04.768088 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 14:56:04.778086 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:04.778067 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 14:56:04.789667 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:04.789649 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-654k2\" (UniqueName: \"kubernetes.io/projected/3542c9e3-6f7b-4b12-8cfd-7a4cc475080c-kube-api-access-654k2\") pod \"network-check-target-b74wj\" (UID: \"3542c9e3-6f7b-4b12-8cfd-7a4cc475080c\") " pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:56:04.903881 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:04.903848 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qdpbt"] Jun 10 14:56:04.906585 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:56:04.906559 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee837172_4366_4f5e_8aa0_06c0c17f0bca.slice/crio-a0cecf8249a36bd601a7b4e2cdc5563b5f1e1147db43a82f08637dbf6ac01bc0 WatchSource:0}: Error finding container a0cecf8249a36bd601a7b4e2cdc5563b5f1e1147db43a82f08637dbf6ac01bc0: Status 404 returned error can't find the container with id a0cecf8249a36bd601a7b4e2cdc5563b5f1e1147db43a82f08637dbf6ac01bc0 Jun 10 14:56:05.063542 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:05.063466 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hk4k4\"" Jun 10 14:56:05.071769 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:05.071748 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:56:05.085984 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:05.085951 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qdpbt" event={"ID":"ee837172-4366-4f5e-8aa0-06c0c17f0bca","Type":"ContainerStarted","Data":"a0cecf8249a36bd601a7b4e2cdc5563b5f1e1147db43a82f08637dbf6ac01bc0"} Jun 10 14:56:05.169002 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:05.168973 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:56:05.169163 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:56:05.169119 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:56:05.169201 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:56:05.169173 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls podName:fcf06589-00b6-4e3d-a60c-9023441c29b5 nodeName:}" failed. No retries permitted until 2026-06-10 14:56:37.169159599 +0000 UTC m=+98.755949299 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls") pod "dns-default-kckpq" (UID: "fcf06589-00b6-4e3d-a60c-9023441c29b5") : secret "dns-default-metrics-tls" not found Jun 10 14:56:05.194574 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:05.194531 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b74wj"] Jun 10 14:56:05.197665 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:56:05.197640 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3542c9e3_6f7b_4b12_8cfd_7a4cc475080c.slice/crio-806ace13c89e69949eb090cdf991eea6aa48a69eb086ba52910a057485cd006f WatchSource:0}: Error finding container 806ace13c89e69949eb090cdf991eea6aa48a69eb086ba52910a057485cd006f: Status 404 returned error can't find the container with id 806ace13c89e69949eb090cdf991eea6aa48a69eb086ba52910a057485cd006f Jun 10 14:56:06.090557 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:06.090413 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b74wj" event={"ID":"3542c9e3-6f7b-4b12-8cfd-7a4cc475080c","Type":"ContainerStarted","Data":"806ace13c89e69949eb090cdf991eea6aa48a69eb086ba52910a057485cd006f"} Jun 10 14:56:10.102622 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:10.102583 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b74wj" event={"ID":"3542c9e3-6f7b-4b12-8cfd-7a4cc475080c","Type":"ContainerStarted","Data":"ee27ac9505e464487aa798cb82e807d15501586e84d39295bccb21141484b343"} Jun 10 14:56:10.103038 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:10.102690 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:56:10.103972 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:10.103947 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qdpbt" event={"ID":"ee837172-4366-4f5e-8aa0-06c0c17f0bca","Type":"ContainerStarted","Data":"8108e5b7200b9964fd668c79f300513e88f3fff785b0e62b81750e61fc810684"} Jun 10 14:56:10.121031 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:10.120988 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b74wj" podStartSLOduration=66.946360598 podStartE2EDuration="1m11.120976151s" totalImagesPullingTime="4.174615553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:56:10.119910624 +0000 UTC m=+71.706700346" watchObservedRunningTime="2026-06-10 14:56:10.120976151 +0000 UTC m=+71.707765852" Jun 10 14:56:10.140452 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:10.140412 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qdpbt" podStartSLOduration=66.670065983 podStartE2EDuration="1m11.14038041s" totalImagesPullingTime="4.470314427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:56:10.139674879 +0000 UTC m=+71.726464603" watchObservedRunningTime="2026-06-10 14:56:10.14038041 +0000 UTC m=+71.727170180" Jun 10 14:56:21.860678 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:21.860592 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:56:21.961137 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:21.961104 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:56:37.182411 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:37.182357 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:56:37.182853 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:56:37.182528 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:56:37.182853 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:56:37.182613 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls podName:fcf06589-00b6-4e3d-a60c-9023441c29b5 nodeName:}" failed. No retries permitted until 2026-06-10 14:57:41.182596954 +0000 UTC m=+162.769386657 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls") pod "dns-default-kckpq" (UID: "fcf06589-00b6-4e3d-a60c-9023441c29b5") : secret "dns-default-metrics-tls" not found Jun 10 14:56:39.390565 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:39.390532 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:56:41.109041 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:56:41.109011 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b74wj" Jun 10 14:57:08.684894 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:57:08.684846 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:57:08.685360 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:57:08.684980 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 14:57:08.685360 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:57:08.685033 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs podName:f54ab5dc-d0e0-453e-92f1-968e16b67c00 nodeName:}" failed. No retries permitted until 2026-06-10 14:59:10.68501982 +0000 UTC m=+252.271809521 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs") pod "network-metrics-daemon-nvzzs" (UID: "f54ab5dc-d0e0-453e-92f1-968e16b67c00") : secret "metrics-daemon-secret" not found Jun 10 14:57:15.067618 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:57:15.067582 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:57:36.348649 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:57:36.348563 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kckpq" podUID="fcf06589-00b6-4e3d-a60c-9023441c29b5" Jun 10 14:57:36.856288 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:57:36.856253 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nvzzs" podUID="f54ab5dc-d0e0-453e-92f1-968e16b67c00" Jun 10 14:57:37.310003 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:57:37.309972 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kckpq" Jun 10 14:57:41.198240 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:57:41.198206 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:57:41.198685 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:57:41.198341 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 14:57:41.198685 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:57:41.198438 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls podName:fcf06589-00b6-4e3d-a60c-9023441c29b5 nodeName:}" failed. No retries permitted until 2026-06-10 14:59:43.198380379 +0000 UTC m=+284.785170081 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls") pod "dns-default-kckpq" (UID: "fcf06589-00b6-4e3d-a60c-9023441c29b5") : secret "dns-default-metrics-tls" not found Jun 10 14:57:48.847750 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:57:48.847719 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:58:23.216824 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:23.216778 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:23.299225 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:23.299169 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:24.101888 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.101857 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-4pvg5"] Jun 10 14:58:24.104535 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.104516 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn"] Jun 10 14:58:24.104661 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.104645 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.107255 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.107218 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" Jun 10 14:58:24.107727 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.107706 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-86kq9\"" Jun 10 14:58:24.107814 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.107745 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 14:58:24.107814 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.107773 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 14:58:24.107900 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.107778 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 14:58:24.107900 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.107748 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 14:58:24.110548 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.110533 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 10 14:58:24.111427 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.111113 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 10 14:58:24.111733 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.111715 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-b7k2l\"" Jun 10 14:58:24.111917 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.111902 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 10 14:58:24.112854 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.112836 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 10 14:58:24.114779 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.114762 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 14:58:24.128712 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.128694 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn"] Jun 10 14:58:24.136922 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.136903 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-4pvg5"] Jun 10 14:58:24.201236 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.201203 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt"] Jun 10 14:58:24.203804 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.203783 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:24.206841 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.206823 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vglxj\"" Jun 10 14:58:24.207054 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.207041 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 14:58:24.208786 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.208769 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 14:58:24.208877 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.208795 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 14:58:24.213214 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.213198 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 14:58:24.215849 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.215829 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hbt98"] Jun 10 14:58:24.218380 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.218362 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hbt98" Jun 10 14:58:24.220891 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.220873 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2"] Jun 10 14:58:24.223347 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.223327 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" Jun 10 14:58:24.229430 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.229411 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz"] Jun 10 14:58:24.231833 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.231815 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" Jun 10 14:58:24.233239 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.233221 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7gfjm\"" Jun 10 14:58:24.233778 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.233761 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mmmc2"] Jun 10 14:58:24.233878 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.233863 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 14:58:24.234080 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.234066 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 14:58:24.235494 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.234955 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 14:58:24.235494 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.234978 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4xkgx\"" Jun 10 14:58:24.235655 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.235579 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 14:58:24.237065 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.235746 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 14:58:24.237065 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.235893 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 14:58:24.237065 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.236473 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 14:58:24.237065 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.236758 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hrjdc\"" Jun 10 14:58:24.239415 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.239377 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt"] Jun 10 14:58:24.239505 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.239475 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.243420 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.243404 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 14:58:24.246167 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.246141 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 14:58:24.247545 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.247485 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 14:58:24.247655 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.247565 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 14:58:24.247882 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.247863 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 14:58:24.247882 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.247879 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 14:58:24.248248 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.248230 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lgjq6\"" Jun 10 14:58:24.248531 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.248509 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz"] Jun 10 14:58:24.249307 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.249290 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hbt98"] Jun 10 14:58:24.252971 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.252950 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2"] Jun 10 14:58:24.253607 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.253592 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mmmc2"] Jun 10 14:58:24.257721 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.257703 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 14:58:24.274082 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.274060 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc"] Jun 10 14:58:24.276820 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.276807 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.280585 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.280569 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 10 14:58:24.280666 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.280600 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 14:58:24.281107 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.281090 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 10 14:58:24.281191 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.281113 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 10 14:58:24.281250 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.281114 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 14:58:24.281305 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.281097 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 10 14:58:24.281421 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.281377 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 14:58:24.283002 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.282981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-snapshots\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.283101 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.283020 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-service-ca-bundle\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.283101 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.283047 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-serving-cert\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.283101 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.283071 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1392c32a-c09c-4879-b8c4-5d9cf4d12905-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jqgxn\" (UID: \"1392c32a-c09c-4879-b8c4-5d9cf4d12905\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" Jun 10 14:58:24.283239 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.283100 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-trusted-ca-bundle\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.283239 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.283133 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9rqg\" (UniqueName: \"kubernetes.io/projected/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-kube-api-access-z9rqg\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.283239 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.283178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-tmp\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.283239 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.283202 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1392c32a-c09c-4879-b8c4-5d9cf4d12905-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jqgxn\" (UID: \"1392c32a-c09c-4879-b8c4-5d9cf4d12905\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" Jun 10 14:58:24.283239 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.283223 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wmsb\" (UniqueName: \"kubernetes.io/projected/1392c32a-c09c-4879-b8c4-5d9cf4d12905-kube-api-access-6wmsb\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jqgxn\" (UID: \"1392c32a-c09c-4879-b8c4-5d9cf4d12905\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" Jun 10 14:58:24.318277 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.318257 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc"] Jun 10 14:58:24.384178 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384151 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rm7g\" (UniqueName: \"kubernetes.io/projected/91c7173f-835f-4f26-aada-060529587c6b-kube-api-access-5rm7g\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:24.384296 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384196 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-snapshots\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.384296 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384222 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ca31ff9-7a7e-487b-8bc7-8eaf539900ad-config\") pod \"service-ca-operator-6bc5ff68f5-79cpz\" (UID: \"0ca31ff9-7a7e-487b-8bc7-8eaf539900ad\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" Jun 10 14:58:24.384296 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384246 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4x6z2\" (UID: \"7e88b44b-58d6-454e-8cc2-09bc526791ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" Jun 10 14:58:24.384296 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384273 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-service-ca-bundle\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.384527 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1392c32a-c09c-4879-b8c4-5d9cf4d12905-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jqgxn\" (UID: \"1392c32a-c09c-4879-b8c4-5d9cf4d12905\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" Jun 10 14:58:24.384527 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384341 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-trusted-ca-bundle\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.384527 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384405 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.384527 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384437 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-ca\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.384527 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384469 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1392c32a-c09c-4879-b8c4-5d9cf4d12905-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jqgxn\" (UID: \"1392c32a-c09c-4879-b8c4-5d9cf4d12905\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" Jun 10 14:58:24.384527 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384495 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.384527 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384520 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee1a077b-2c76-4f92-9194-a3f262e4ace8-trusted-ca\") pod \"console-operator-668fdbf85c-mmmc2\" (UID: \"ee1a077b-2c76-4f92-9194-a3f262e4ace8\") " pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.384859 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384570 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:24.384859 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384594 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkkqz\" (UniqueName: \"kubernetes.io/projected/7e88b44b-58d6-454e-8cc2-09bc526791ab-kube-api-access-zkkqz\") pod \"cluster-samples-operator-854f8b96b6-4x6z2\" (UID: \"7e88b44b-58d6-454e-8cc2-09bc526791ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" Jun 10 14:58:24.384859 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384670 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee1a077b-2c76-4f92-9194-a3f262e4ace8-config\") pod \"console-operator-668fdbf85c-mmmc2\" (UID: \"ee1a077b-2c76-4f92-9194-a3f262e4ace8\") " pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.384859 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384693 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee1a077b-2c76-4f92-9194-a3f262e4ace8-serving-cert\") pod \"console-operator-668fdbf85c-mmmc2\" (UID: \"ee1a077b-2c76-4f92-9194-a3f262e4ace8\") " pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.384859 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384716 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-hub\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.384859 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384742 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6hpc\" (UniqueName: \"kubernetes.io/projected/0ca31ff9-7a7e-487b-8bc7-8eaf539900ad-kube-api-access-q6hpc\") pod \"service-ca-operator-6bc5ff68f5-79cpz\" (UID: \"0ca31ff9-7a7e-487b-8bc7-8eaf539900ad\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" Jun 10 14:58:24.384859 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-serving-cert\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.385165 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ca31ff9-7a7e-487b-8bc7-8eaf539900ad-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-79cpz\" (UID: \"0ca31ff9-7a7e-487b-8bc7-8eaf539900ad\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" Jun 10 14:58:24.385165 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384919 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-service-ca-bundle\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.385165 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384872 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-snapshots\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.385165 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.384922 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.385165 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.385009 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fg7j\" (UniqueName: \"kubernetes.io/projected/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-kube-api-access-8fg7j\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.385165 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.385011 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1392c32a-c09c-4879-b8c4-5d9cf4d12905-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jqgxn\" (UID: \"1392c32a-c09c-4879-b8c4-5d9cf4d12905\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" Jun 10 14:58:24.385165 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.385078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9rqg\" (UniqueName: \"kubernetes.io/projected/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-kube-api-access-z9rqg\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.385439 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.385307 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-tmp\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.385439 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.385345 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wmsb\" (UniqueName: \"kubernetes.io/projected/1392c32a-c09c-4879-b8c4-5d9cf4d12905-kube-api-access-6wmsb\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jqgxn\" (UID: \"1392c32a-c09c-4879-b8c4-5d9cf4d12905\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" Jun 10 14:58:24.385439 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.385377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvfdw\" (UniqueName: \"kubernetes.io/projected/6376fa5f-76da-4313-b051-e01d213189cc-kube-api-access-bvfdw\") pod \"volume-data-source-validator-78dd696465-hbt98\" (UID: \"6376fa5f-76da-4313-b051-e01d213189cc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hbt98" Jun 10 14:58:24.385439 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.385424 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcvlg\" (UniqueName: \"kubernetes.io/projected/ee1a077b-2c76-4f92-9194-a3f262e4ace8-kube-api-access-qcvlg\") pod \"console-operator-668fdbf85c-mmmc2\" (UID: \"ee1a077b-2c76-4f92-9194-a3f262e4ace8\") " pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.385647 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.385456 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/91c7173f-835f-4f26-aada-060529587c6b-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:24.385647 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.385618 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-tmp\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.385715 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.385704 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-trusted-ca-bundle\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.386822 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.386806 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1392c32a-c09c-4879-b8c4-5d9cf4d12905-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jqgxn\" (UID: \"1392c32a-c09c-4879-b8c4-5d9cf4d12905\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" Jun 10 14:58:24.387244 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.387225 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-serving-cert\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.397731 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.397703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wmsb\" (UniqueName: \"kubernetes.io/projected/1392c32a-c09c-4879-b8c4-5d9cf4d12905-kube-api-access-6wmsb\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jqgxn\" (UID: \"1392c32a-c09c-4879-b8c4-5d9cf4d12905\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" Jun 10 14:58:24.398112 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.398095 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9rqg\" (UniqueName: \"kubernetes.io/projected/b122c82e-bb9c-4ed6-8530-0b47dbc230b8-kube-api-access-z9rqg\") pod \"insights-operator-896549976-4pvg5\" (UID: \"b122c82e-bb9c-4ed6-8530-0b47dbc230b8\") " pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.415486 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.415464 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-4pvg5" Jun 10 14:58:24.420048 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.420030 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" Jun 10 14:58:24.486502 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486470 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:24.486645 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486515 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkqz\" (UniqueName: \"kubernetes.io/projected/7e88b44b-58d6-454e-8cc2-09bc526791ab-kube-api-access-zkkqz\") pod \"cluster-samples-operator-854f8b96b6-4x6z2\" (UID: \"7e88b44b-58d6-454e-8cc2-09bc526791ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" Jun 10 14:58:24.486645 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486558 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee1a077b-2c76-4f92-9194-a3f262e4ace8-config\") pod \"console-operator-668fdbf85c-mmmc2\" (UID: \"ee1a077b-2c76-4f92-9194-a3f262e4ace8\") " pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.486645 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486582 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee1a077b-2c76-4f92-9194-a3f262e4ace8-serving-cert\") pod \"console-operator-668fdbf85c-mmmc2\" (UID: \"ee1a077b-2c76-4f92-9194-a3f262e4ace8\") " pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.486645 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486610 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-hub\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.486645 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486636 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6hpc\" (UniqueName: \"kubernetes.io/projected/0ca31ff9-7a7e-487b-8bc7-8eaf539900ad-kube-api-access-q6hpc\") pod \"service-ca-operator-6bc5ff68f5-79cpz\" (UID: \"0ca31ff9-7a7e-487b-8bc7-8eaf539900ad\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" Jun 10 14:58:24.486916 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:24.486645 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 14:58:24.486916 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486671 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ca31ff9-7a7e-487b-8bc7-8eaf539900ad-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-79cpz\" (UID: \"0ca31ff9-7a7e-487b-8bc7-8eaf539900ad\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" Jun 10 14:58:24.486916 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486696 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.486916 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:24.486731 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls podName:91c7173f-835f-4f26-aada-060529587c6b nodeName:}" failed. No retries permitted until 2026-06-10 14:58:24.986711008 +0000 UTC m=+206.573500710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-cx5zt" (UID: "91c7173f-835f-4f26-aada-060529587c6b") : secret "cluster-monitoring-operator-tls" not found Jun 10 14:58:24.486916 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486756 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fg7j\" (UniqueName: \"kubernetes.io/projected/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-kube-api-access-8fg7j\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.486916 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486815 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvfdw\" (UniqueName: \"kubernetes.io/projected/6376fa5f-76da-4313-b051-e01d213189cc-kube-api-access-bvfdw\") pod \"volume-data-source-validator-78dd696465-hbt98\" (UID: \"6376fa5f-76da-4313-b051-e01d213189cc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hbt98" Jun 10 14:58:24.486916 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486839 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcvlg\" (UniqueName: \"kubernetes.io/projected/ee1a077b-2c76-4f92-9194-a3f262e4ace8-kube-api-access-qcvlg\") pod \"console-operator-668fdbf85c-mmmc2\" (UID: \"ee1a077b-2c76-4f92-9194-a3f262e4ace8\") " pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.486916 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486864 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/91c7173f-835f-4f26-aada-060529587c6b-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:24.486916 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486894 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rm7g\" (UniqueName: \"kubernetes.io/projected/91c7173f-835f-4f26-aada-060529587c6b-kube-api-access-5rm7g\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:24.487352 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486936 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ca31ff9-7a7e-487b-8bc7-8eaf539900ad-config\") pod \"service-ca-operator-6bc5ff68f5-79cpz\" (UID: \"0ca31ff9-7a7e-487b-8bc7-8eaf539900ad\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" Jun 10 14:58:24.487352 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486959 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4x6z2\" (UID: \"7e88b44b-58d6-454e-8cc2-09bc526791ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" Jun 10 14:58:24.487352 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.486999 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.487352 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.487023 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-ca\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.487352 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.487056 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.487707 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:24.487526 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 14:58:24.487707 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:24.487585 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls podName:7e88b44b-58d6-454e-8cc2-09bc526791ab nodeName:}" failed. No retries permitted until 2026-06-10 14:58:24.987567222 +0000 UTC m=+206.574356925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4x6z2" (UID: "7e88b44b-58d6-454e-8cc2-09bc526791ab") : secret "samples-operator-tls" not found Jun 10 14:58:24.487809 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.487782 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/91c7173f-835f-4f26-aada-060529587c6b-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:24.487862 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.487824 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee1a077b-2c76-4f92-9194-a3f262e4ace8-trusted-ca\") pod \"console-operator-668fdbf85c-mmmc2\" (UID: \"ee1a077b-2c76-4f92-9194-a3f262e4ace8\") " pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.487914 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.487880 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee1a077b-2c76-4f92-9194-a3f262e4ace8-config\") pod \"console-operator-668fdbf85c-mmmc2\" (UID: \"ee1a077b-2c76-4f92-9194-a3f262e4ace8\") " pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.489260 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.488249 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ca31ff9-7a7e-487b-8bc7-8eaf539900ad-config\") pod \"service-ca-operator-6bc5ff68f5-79cpz\" (UID: \"0ca31ff9-7a7e-487b-8bc7-8eaf539900ad\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" Jun 10 14:58:24.489260 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.488910 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.490168 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.489937 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee1a077b-2c76-4f92-9194-a3f262e4ace8-trusted-ca\") pod \"console-operator-668fdbf85c-mmmc2\" (UID: \"ee1a077b-2c76-4f92-9194-a3f262e4ace8\") " pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.492154 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.492059 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.492154 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.492097 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.492546 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.492522 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-ca\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.492878 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.492851 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee1a077b-2c76-4f92-9194-a3f262e4ace8-serving-cert\") pod \"console-operator-668fdbf85c-mmmc2\" (UID: \"ee1a077b-2c76-4f92-9194-a3f262e4ace8\") " pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.493023 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.493003 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-hub\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.494042 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.494016 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ca31ff9-7a7e-487b-8bc7-8eaf539900ad-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-79cpz\" (UID: \"0ca31ff9-7a7e-487b-8bc7-8eaf539900ad\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" Jun 10 14:58:24.495791 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.495770 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6hpc\" (UniqueName: \"kubernetes.io/projected/0ca31ff9-7a7e-487b-8bc7-8eaf539900ad-kube-api-access-q6hpc\") pod \"service-ca-operator-6bc5ff68f5-79cpz\" (UID: \"0ca31ff9-7a7e-487b-8bc7-8eaf539900ad\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" Jun 10 14:58:24.498560 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.498536 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rm7g\" (UniqueName: \"kubernetes.io/projected/91c7173f-835f-4f26-aada-060529587c6b-kube-api-access-5rm7g\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:24.502208 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.501965 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcvlg\" (UniqueName: \"kubernetes.io/projected/ee1a077b-2c76-4f92-9194-a3f262e4ace8-kube-api-access-qcvlg\") pod \"console-operator-668fdbf85c-mmmc2\" (UID: \"ee1a077b-2c76-4f92-9194-a3f262e4ace8\") " pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.505041 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.505018 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fg7j\" (UniqueName: \"kubernetes.io/projected/e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4-kube-api-access-8fg7j\") pod \"cluster-proxy-proxy-agent-559cb487b4-cbzgc\" (UID: \"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.505946 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.505922 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkkqz\" (UniqueName: \"kubernetes.io/projected/7e88b44b-58d6-454e-8cc2-09bc526791ab-kube-api-access-zkkqz\") pod \"cluster-samples-operator-854f8b96b6-4x6z2\" (UID: \"7e88b44b-58d6-454e-8cc2-09bc526791ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" Jun 10 14:58:24.507105 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.507069 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvfdw\" (UniqueName: \"kubernetes.io/projected/6376fa5f-76da-4313-b051-e01d213189cc-kube-api-access-bvfdw\") pod \"volume-data-source-validator-78dd696465-hbt98\" (UID: \"6376fa5f-76da-4313-b051-e01d213189cc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hbt98" Jun 10 14:58:24.526690 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.526664 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hbt98" Jun 10 14:58:24.542544 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.542525 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" Jun 10 14:58:24.542957 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.542929 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:24.550635 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.550611 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:24.561050 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.561000 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-4pvg5"] Jun 10 14:58:24.564725 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:58:24.564695 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb122c82e_bb9c_4ed6_8530_0b47dbc230b8.slice/crio-681ea7bbb0c5f453957a2abe7413968a87d724c001ccfcbec0bcd040429ea9f3 WatchSource:0}: Error finding container 681ea7bbb0c5f453957a2abe7413968a87d724c001ccfcbec0bcd040429ea9f3: Status 404 returned error can't find the container with id 681ea7bbb0c5f453957a2abe7413968a87d724c001ccfcbec0bcd040429ea9f3 Jun 10 14:58:24.574029 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.573957 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn"] Jun 10 14:58:24.579056 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:58:24.579028 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1392c32a_c09c_4879_b8c4_5d9cf4d12905.slice/crio-7bee133d7e329f34e7e08a8014c30f19fc102d36cec73ea21a094153cc675fb1 WatchSource:0}: Error finding container 7bee133d7e329f34e7e08a8014c30f19fc102d36cec73ea21a094153cc675fb1: Status 404 returned error can't find the container with id 7bee133d7e329f34e7e08a8014c30f19fc102d36cec73ea21a094153cc675fb1 Jun 10 14:58:24.597334 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.597267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 14:58:24.639423 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.639330 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:24.690754 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.690731 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hbt98"] Jun 10 14:58:24.693786 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:58:24.693758 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6376fa5f_76da_4313_b051_e01d213189cc.slice/crio-24b9b9316b09438db1be471aa2b4647e16c0e84c9a7e81377ca0eb5eaee5f60e WatchSource:0}: Error finding container 24b9b9316b09438db1be471aa2b4647e16c0e84c9a7e81377ca0eb5eaee5f60e: Status 404 returned error can't find the container with id 24b9b9316b09438db1be471aa2b4647e16c0e84c9a7e81377ca0eb5eaee5f60e Jun 10 14:58:24.748948 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.748910 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc"] Jun 10 14:58:24.751670 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:58:24.751645 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode315b3ed_e65a_4ce4_9e4a_c90d1cbb55b4.slice/crio-a8a859f5e14c05313797d49d388f938dcb7e6ee741f02225a935de74528e9261 WatchSource:0}: Error finding container a8a859f5e14c05313797d49d388f938dcb7e6ee741f02225a935de74528e9261: Status 404 returned error can't find the container with id a8a859f5e14c05313797d49d388f938dcb7e6ee741f02225a935de74528e9261 Jun 10 14:58:24.913636 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.913558 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz"] Jun 10 14:58:24.916081 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:58:24.916042 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca31ff9_7a7e_487b_8bc7_8eaf539900ad.slice/crio-673d2671f6ff600dc6e677fee6a0c849115315333723ff011f37bba056988f35 WatchSource:0}: Error finding container 673d2671f6ff600dc6e677fee6a0c849115315333723ff011f37bba056988f35: Status 404 returned error can't find the container with id 673d2671f6ff600dc6e677fee6a0c849115315333723ff011f37bba056988f35 Jun 10 14:58:24.917261 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.917236 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mmmc2"] Jun 10 14:58:24.920038 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:58:24.920019 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee1a077b_2c76_4f92_9194_a3f262e4ace8.slice/crio-be8bbbc67501ae3dfaf242a404b28e54de17d624cb9ac1aa8257baf5231b4e97 WatchSource:0}: Error finding container be8bbbc67501ae3dfaf242a404b28e54de17d624cb9ac1aa8257baf5231b4e97: Status 404 returned error can't find the container with id be8bbbc67501ae3dfaf242a404b28e54de17d624cb9ac1aa8257baf5231b4e97 Jun 10 14:58:24.991671 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.991641 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4x6z2\" (UID: \"7e88b44b-58d6-454e-8cc2-09bc526791ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" Jun 10 14:58:24.991779 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:24.991704 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:24.991779 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:24.991751 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 14:58:24.991847 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:24.991804 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls podName:7e88b44b-58d6-454e-8cc2-09bc526791ab nodeName:}" failed. No retries permitted until 2026-06-10 14:58:25.991785756 +0000 UTC m=+207.578575457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4x6z2" (UID: "7e88b44b-58d6-454e-8cc2-09bc526791ab") : secret "samples-operator-tls" not found Jun 10 14:58:24.991847 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:24.991813 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 14:58:24.991913 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:24.991856 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls podName:91c7173f-835f-4f26-aada-060529587c6b nodeName:}" failed. No retries permitted until 2026-06-10 14:58:25.991845052 +0000 UTC m=+207.578634753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-cx5zt" (UID: "91c7173f-835f-4f26-aada-060529587c6b") : secret "cluster-monitoring-operator-tls" not found Jun 10 14:58:25.430826 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:25.430749 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" event={"ID":"0ca31ff9-7a7e-487b-8bc7-8eaf539900ad","Type":"ContainerStarted","Data":"673d2671f6ff600dc6e677fee6a0c849115315333723ff011f37bba056988f35"} Jun 10 14:58:25.436284 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:25.436230 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hbt98" event={"ID":"6376fa5f-76da-4313-b051-e01d213189cc","Type":"ContainerStarted","Data":"24b9b9316b09438db1be471aa2b4647e16c0e84c9a7e81377ca0eb5eaee5f60e"} Jun 10 14:58:25.438583 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:25.438527 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" event={"ID":"ee1a077b-2c76-4f92-9194-a3f262e4ace8","Type":"ContainerStarted","Data":"be8bbbc67501ae3dfaf242a404b28e54de17d624cb9ac1aa8257baf5231b4e97"} Jun 10 14:58:25.440121 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:25.440071 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4pvg5" event={"ID":"b122c82e-bb9c-4ed6-8530-0b47dbc230b8","Type":"ContainerStarted","Data":"681ea7bbb0c5f453957a2abe7413968a87d724c001ccfcbec0bcd040429ea9f3"} Jun 10 14:58:25.443238 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:25.443194 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" event={"ID":"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4","Type":"ContainerStarted","Data":"a8a859f5e14c05313797d49d388f938dcb7e6ee741f02225a935de74528e9261"} Jun 10 14:58:25.445128 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:25.445104 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" event={"ID":"1392c32a-c09c-4879-b8c4-5d9cf4d12905","Type":"ContainerStarted","Data":"7bee133d7e329f34e7e08a8014c30f19fc102d36cec73ea21a094153cc675fb1"} Jun 10 14:58:26.000832 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:26.000711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4x6z2\" (UID: \"7e88b44b-58d6-454e-8cc2-09bc526791ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" Jun 10 14:58:26.000832 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:26.000787 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:26.001000 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:26.000971 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 14:58:26.001067 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:26.001032 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls podName:91c7173f-835f-4f26-aada-060529587c6b nodeName:}" failed. No retries permitted until 2026-06-10 14:58:28.001012246 +0000 UTC m=+209.587801990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-cx5zt" (UID: "91c7173f-835f-4f26-aada-060529587c6b") : secret "cluster-monitoring-operator-tls" not found Jun 10 14:58:26.001129 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:26.001095 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 14:58:26.001129 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:26.001127 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls podName:7e88b44b-58d6-454e-8cc2-09bc526791ab nodeName:}" failed. No retries permitted until 2026-06-10 14:58:28.001117211 +0000 UTC m=+209.587906915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4x6z2" (UID: "7e88b44b-58d6-454e-8cc2-09bc526791ab") : secret "samples-operator-tls" not found Jun 10 14:58:26.450583 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:26.450438 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hbt98" event={"ID":"6376fa5f-76da-4313-b051-e01d213189cc","Type":"ContainerStarted","Data":"2e22becd175cb2d7a875f9e72e3fdb7203e5f0537df68947f1fa6f98e68971cb"} Jun 10 14:58:26.467753 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:26.467699 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hbt98" podStartSLOduration=1.2259504350000001 podStartE2EDuration="2.467678377s" totalImagesPullingTime="1.241727942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:58:26.46650683 +0000 UTC m=+208.053296553" watchObservedRunningTime="2026-06-10 14:58:26.467678377 +0000 UTC m=+208.054468080" Jun 10 14:58:26.560161 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:26.560113 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:28.015813 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:28.015754 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4x6z2\" (UID: \"7e88b44b-58d6-454e-8cc2-09bc526791ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" Jun 10 14:58:28.016563 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:28.015828 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:28.016563 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:28.015940 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 14:58:28.016563 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:28.015979 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 14:58:28.016563 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:28.016017 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls podName:7e88b44b-58d6-454e-8cc2-09bc526791ab nodeName:}" failed. No retries permitted until 2026-06-10 14:58:32.01599464 +0000 UTC m=+213.602784347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4x6z2" (UID: "7e88b44b-58d6-454e-8cc2-09bc526791ab") : secret "samples-operator-tls" not found Jun 10 14:58:28.016563 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:28.016042 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls podName:91c7173f-835f-4f26-aada-060529587c6b nodeName:}" failed. No retries permitted until 2026-06-10 14:58:32.01602482 +0000 UTC m=+213.602814526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-cx5zt" (UID: "91c7173f-835f-4f26-aada-060529587c6b") : secret "cluster-monitoring-operator-tls" not found Jun 10 14:58:31.469768 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.469732 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" event={"ID":"0ca31ff9-7a7e-487b-8bc7-8eaf539900ad","Type":"ContainerStarted","Data":"d69fd2661420940ae799397868fc0d3ff9c18da1b1196f45932480f32124ae9a"} Jun 10 14:58:31.471446 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.471421 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/0.log" Jun 10 14:58:31.471570 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.471464 2560 generic.go:356] "Generic (PLEG): container finished" podID="ee1a077b-2c76-4f92-9194-a3f262e4ace8" containerID="5182bad9602f63153546cf3ae4cefbeae2cbcb71e63204ee103221e36a4c196a" exitCode=255 Jun 10 14:58:31.471570 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.471536 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" event={"ID":"ee1a077b-2c76-4f92-9194-a3f262e4ace8","Type":"ContainerDied","Data":"5182bad9602f63153546cf3ae4cefbeae2cbcb71e63204ee103221e36a4c196a"} Jun 10 14:58:31.471772 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.471752 2560 scope.go:117] "RemoveContainer" containerID="5182bad9602f63153546cf3ae4cefbeae2cbcb71e63204ee103221e36a4c196a" Jun 10 14:58:31.473276 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.473254 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4pvg5" event={"ID":"b122c82e-bb9c-4ed6-8530-0b47dbc230b8","Type":"ContainerStarted","Data":"9568704a4e2c85d16a04bd248dea1e7076e6c4720057f5cf2ac75bc8d865d658"} Jun 10 14:58:31.475440 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.475418 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" event={"ID":"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4","Type":"ContainerStarted","Data":"22308f2315aede453fa1a338b2fe7118a80cc40bed791b1bf9de3dd09826f64d"} Jun 10 14:58:31.475532 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.475455 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" event={"ID":"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4","Type":"ContainerStarted","Data":"cd11a1bb07672b539c36b673d5b866adb2c45a6323cad50f0cf231e9b547ec24"} Jun 10 14:58:31.475532 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.475472 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" event={"ID":"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4","Type":"ContainerStarted","Data":"5f377038079b3c0988b0b6bfa9c9bfb34a78254971cb929966f560c24fd6e515"} Jun 10 14:58:31.477590 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.477570 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" event={"ID":"1392c32a-c09c-4879-b8c4-5d9cf4d12905","Type":"ContainerStarted","Data":"504ae59cb594306b9c15afe354747a5492af3aed005e22ede4d27d8d14c08506"} Jun 10 14:58:31.491382 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.491343 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" podStartSLOduration=1.87813879 podStartE2EDuration="7.491330895s" totalImagesPullingTime="5.613192105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:58:31.490060331 +0000 UTC m=+213.076850057" watchObservedRunningTime="2026-06-10 14:58:31.491330895 +0000 UTC m=+213.078120618" Jun 10 14:58:31.511323 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.510887 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" podStartSLOduration=1.7269862900000001 podStartE2EDuration="7.510871581s" totalImagesPullingTime="5.783885291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:58:31.51017952 +0000 UTC m=+213.096969253" watchObservedRunningTime="2026-06-10 14:58:31.510871581 +0000 UTC m=+213.097661305" Jun 10 14:58:31.550734 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.550369 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" podStartSLOduration=1.608958222 podStartE2EDuration="7.550350348s" totalImagesPullingTime="5.941392126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:58:31.529313339 +0000 UTC m=+213.116103066" watchObservedRunningTime="2026-06-10 14:58:31.550350348 +0000 UTC m=+213.137140070" Jun 10 14:58:31.551747 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:31.551694 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-4pvg5" podStartSLOduration=1.597334491 podStartE2EDuration="7.551685577s" totalImagesPullingTime="5.954351086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:58:31.549663632 +0000 UTC m=+213.136453356" watchObservedRunningTime="2026-06-10 14:58:31.551685577 +0000 UTC m=+213.138475301" Jun 10 14:58:32.046660 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.046621 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:32.046812 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.046710 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4x6z2\" (UID: \"7e88b44b-58d6-454e-8cc2-09bc526791ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" Jun 10 14:58:32.046812 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:32.046797 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 14:58:32.046883 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:32.046864 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls podName:91c7173f-835f-4f26-aada-060529587c6b nodeName:}" failed. No retries permitted until 2026-06-10 14:58:40.046848403 +0000 UTC m=+221.633638104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-cx5zt" (UID: "91c7173f-835f-4f26-aada-060529587c6b") : secret "cluster-monitoring-operator-tls" not found Jun 10 14:58:32.046883 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:32.046797 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 14:58:32.046955 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:32.046925 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls podName:7e88b44b-58d6-454e-8cc2-09bc526791ab nodeName:}" failed. No retries permitted until 2026-06-10 14:58:40.046914196 +0000 UTC m=+221.633703901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4x6z2" (UID: "7e88b44b-58d6-454e-8cc2-09bc526791ab") : secret "samples-operator-tls" not found Jun 10 14:58:32.078916 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.078871 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:32.180950 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.180906 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:32.420033 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.420003 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:32.481974 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.481947 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/1.log" Jun 10 14:58:32.482414 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.482375 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/0.log" Jun 10 14:58:32.482492 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.482430 2560 generic.go:356] "Generic (PLEG): container finished" podID="ee1a077b-2c76-4f92-9194-a3f262e4ace8" containerID="b38c72855cbdcf89fb7a3e08b6b47c5286bbe9a2407845e98f6dc44ac81676c9" exitCode=255 Jun 10 14:58:32.482492 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.482462 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" event={"ID":"ee1a077b-2c76-4f92-9194-a3f262e4ace8","Type":"ContainerDied","Data":"b38c72855cbdcf89fb7a3e08b6b47c5286bbe9a2407845e98f6dc44ac81676c9"} Jun 10 14:58:32.482579 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.482532 2560 scope.go:117] "RemoveContainer" containerID="5182bad9602f63153546cf3ae4cefbeae2cbcb71e63204ee103221e36a4c196a" Jun 10 14:58:32.483050 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.483030 2560 scope.go:117] "RemoveContainer" containerID="b38c72855cbdcf89fb7a3e08b6b47c5286bbe9a2407845e98f6dc44ac81676c9" Jun 10 14:58:32.483197 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:32.483177 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mmmc2_openshift-console-operator(ee1a077b-2c76-4f92-9194-a3f262e4ace8)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" podUID="ee1a077b-2c76-4f92-9194-a3f262e4ace8" Jun 10 14:58:32.508429 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.508409 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:32.714722 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.714641 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:32.818964 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.818928 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:32.982091 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:32.981984 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:33.212045 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:33.212014 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:33.364227 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:33.364135 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:33.487227 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:33.487203 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/1.log" Jun 10 14:58:33.487578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:33.487504 2560 scope.go:117] "RemoveContainer" containerID="b38c72855cbdcf89fb7a3e08b6b47c5286bbe9a2407845e98f6dc44ac81676c9" Jun 10 14:58:33.487657 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:33.487640 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mmmc2_openshift-console-operator(ee1a077b-2c76-4f92-9194-a3f262e4ace8)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" podUID="ee1a077b-2c76-4f92-9194-a3f262e4ace8" Jun 10 14:58:33.804332 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:33.804306 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-72c4r_2438bf76-f556-4a2f-83c6-dcf98a216432/dns-node-resolver/0.log" Jun 10 14:58:34.404014 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:34.403982 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:34.500306 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:34.500277 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:34.551331 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:34.551288 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:34.551493 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:34.551356 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:34.551733 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:34.551720 2560 scope.go:117] "RemoveContainer" containerID="b38c72855cbdcf89fb7a3e08b6b47c5286bbe9a2407845e98f6dc44ac81676c9" Jun 10 14:58:34.551879 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:34.551862 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mmmc2_openshift-console-operator(ee1a077b-2c76-4f92-9194-a3f262e4ace8)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" podUID="ee1a077b-2c76-4f92-9194-a3f262e4ace8" Jun 10 14:58:35.193836 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:35.193807 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dbpgp_366482e2-0d37-4e7a-8344-4414bcab48d6/node-ca/0.log" Jun 10 14:58:35.463296 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:35.463212 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:35.995379 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:35.995353 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z7hgb_349051fb-b35b-4493-b8c0-821175071eae/serve-healthcheck-canary/0.log" Jun 10 14:58:38.035241 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:38.035196 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:38.231999 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:38.231969 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:38.326131 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:38.326048 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:38.466056 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:38.466025 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:38.564462 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:38.564422 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:38.747001 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:38.746969 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:39.365485 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:39.365449 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:39.956001 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:39.955964 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:40.109276 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:40.109241 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4x6z2\" (UID: \"7e88b44b-58d6-454e-8cc2-09bc526791ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" Jun 10 14:58:40.109464 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:40.109302 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:40.109464 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:40.109416 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 14:58:40.109549 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:40.109491 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls podName:91c7173f-835f-4f26-aada-060529587c6b nodeName:}" failed. No retries permitted until 2026-06-10 14:58:56.109475379 +0000 UTC m=+237.696265080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-cx5zt" (UID: "91c7173f-835f-4f26-aada-060529587c6b") : secret "cluster-monitoring-operator-tls" not found Jun 10 14:58:40.111729 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:40.111703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e88b44b-58d6-454e-8cc2-09bc526791ab-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4x6z2\" (UID: \"7e88b44b-58d6-454e-8cc2-09bc526791ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" Jun 10 14:58:40.133483 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:40.133461 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" Jun 10 14:58:40.243064 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:40.243033 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:40.274918 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:40.274890 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2"] Jun 10 14:58:40.389895 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:40.389864 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:40.513020 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:40.512931 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" event={"ID":"7e88b44b-58d6-454e-8cc2-09bc526791ab","Type":"ContainerStarted","Data":"f0523e1164a2009f63ca137d4067e9c49ac79ba3e20cef3b564967fffc5fe74d"} Jun 10 14:58:40.763322 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:40.763221 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:41.208066 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:41.208041 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:41.387270 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:41.387236 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:41.745564 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:41.745506 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:41.930695 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:41.930664 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:42.137235 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:42.137212 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:42.238261 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:42.238235 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:42.522346 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:42.522272 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" event={"ID":"7e88b44b-58d6-454e-8cc2-09bc526791ab","Type":"ContainerStarted","Data":"4012953e4c7891b60eca9feddd3b1aea4cad315d3c9639fad72acc442bbb1dd9"} Jun 10 14:58:42.522346 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:42.522330 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" event={"ID":"7e88b44b-58d6-454e-8cc2-09bc526791ab","Type":"ContainerStarted","Data":"11deba0c77aebbb60e10cacc0340aef93adec3efb0dbb6f9c6aaad0963e9187a"} Jun 10 14:58:42.542110 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:42.542065 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4x6z2" podStartSLOduration=16.676603019 podStartE2EDuration="18.542050989s" totalImagesPullingTime="1.86544797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:58:42.541561884 +0000 UTC m=+224.128351609" watchObservedRunningTime="2026-06-10 14:58:42.542050989 +0000 UTC m=+224.128840712" Jun 10 14:58:42.733262 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:42.733230 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:43.326504 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:43.326466 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:43.530832 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:43.530799 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:43.737559 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:43.737525 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:44.128474 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:44.128380 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:44.571456 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:44.571366 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:44.730972 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:44.730940 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:45.133561 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:45.133526 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:45.196909 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:45.196876 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:45.545233 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:45.545141 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:45.846757 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:45.846674 2560 scope.go:117] "RemoveContainer" containerID="b38c72855cbdcf89fb7a3e08b6b47c5286bbe9a2407845e98f6dc44ac81676c9" Jun 10 14:58:45.939589 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:45.939490 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:46.537007 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:46.536982 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 14:58:46.537366 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:46.537352 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/1.log" Jun 10 14:58:46.537441 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:46.537384 2560 generic.go:356] "Generic (PLEG): container finished" podID="ee1a077b-2c76-4f92-9194-a3f262e4ace8" containerID="ab4c225858d560f2ca33008fa88e18373cb0baffd6dbe80a89286caa9f708e4a" exitCode=255 Jun 10 14:58:46.537441 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:46.537414 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" event={"ID":"ee1a077b-2c76-4f92-9194-a3f262e4ace8","Type":"ContainerDied","Data":"ab4c225858d560f2ca33008fa88e18373cb0baffd6dbe80a89286caa9f708e4a"} Jun 10 14:58:46.537511 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:46.537468 2560 scope.go:117] "RemoveContainer" containerID="b38c72855cbdcf89fb7a3e08b6b47c5286bbe9a2407845e98f6dc44ac81676c9" Jun 10 14:58:46.537826 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:46.537806 2560 scope.go:117] "RemoveContainer" containerID="ab4c225858d560f2ca33008fa88e18373cb0baffd6dbe80a89286caa9f708e4a" Jun 10 14:58:46.537991 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:46.537958 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mmmc2_openshift-console-operator(ee1a077b-2c76-4f92-9194-a3f262e4ace8)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" podUID="ee1a077b-2c76-4f92-9194-a3f262e4ace8" Jun 10 14:58:47.000666 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:47.000633 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:47.265171 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:47.265072 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:47.536027 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:47.535922 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:47.541468 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:47.541448 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 14:58:48.145306 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:48.145273 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:48.331135 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:48.331090 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:48.525765 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:48.525660 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:48.738161 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:48.738127 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:49.348780 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:49.348747 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:49.413404 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:49.413373 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:54.550918 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:54.550885 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:54.550918 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:54.550928 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:58:54.551356 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:54.551177 2560 scope.go:117] "RemoveContainer" containerID="ab4c225858d560f2ca33008fa88e18373cb0baffd6dbe80a89286caa9f708e4a" Jun 10 14:58:54.551356 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:58:54.551305 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mmmc2_openshift-console-operator(ee1a077b-2c76-4f92-9194-a3f262e4ace8)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" podUID="ee1a077b-2c76-4f92-9194-a3f262e4ace8" Jun 10 14:58:56.134429 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.134371 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:56.136921 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.136890 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c7173f-835f-4f26-aada-060529587c6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-cx5zt\" (UID: \"91c7173f-835f-4f26-aada-060529587c6b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:56.312904 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.312870 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" Jun 10 14:58:56.505027 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.504995 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt"] Jun 10 14:58:56.507855 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:58:56.507817 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c7173f_835f_4f26_aada_060529587c6b.slice/crio-1d6c982f59c771fcb8e54936bf10dca3962cd0d86e277328a17c2ad0a540eb43 WatchSource:0}: Error finding container 1d6c982f59c771fcb8e54936bf10dca3962cd0d86e277328a17c2ad0a540eb43: Status 404 returned error can't find the container with id 1d6c982f59c771fcb8e54936bf10dca3962cd0d86e277328a17c2ad0a540eb43 Jun 10 14:58:56.570089 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.570059 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" event={"ID":"91c7173f-835f-4f26-aada-060529587c6b","Type":"ContainerStarted","Data":"1d6c982f59c771fcb8e54936bf10dca3962cd0d86e277328a17c2ad0a540eb43"} Jun 10 14:58:56.806423 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.806321 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mbzgk"] Jun 10 14:58:56.835035 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.835006 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mbzgk"] Jun 10 14:58:56.835178 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.835126 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:56.837780 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.837756 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8zk2n\"" Jun 10 14:58:56.838659 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.838633 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 14:58:56.838760 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.838678 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 14:58:56.940341 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.940307 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06392e9b-65cd-4364-9c4c-14e46521b44a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:56.940341 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.940343 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06392e9b-65cd-4364-9c4c-14e46521b44a-data-volume\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:56.940548 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.940381 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06392e9b-65cd-4364-9c4c-14e46521b44a-crio-socket\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:56.940548 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.940437 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06392e9b-65cd-4364-9c4c-14e46521b44a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:56.940548 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.940471 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h4gs\" (UniqueName: \"kubernetes.io/projected/06392e9b-65cd-4364-9c4c-14e46521b44a-kube-api-access-2h4gs\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:56.962288 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:56.962260 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:57.041465 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.041436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06392e9b-65cd-4364-9c4c-14e46521b44a-crio-socket\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:57.041639 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.041482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06392e9b-65cd-4364-9c4c-14e46521b44a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:57.041639 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.041530 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h4gs\" (UniqueName: \"kubernetes.io/projected/06392e9b-65cd-4364-9c4c-14e46521b44a-kube-api-access-2h4gs\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:57.041639 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.041580 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06392e9b-65cd-4364-9c4c-14e46521b44a-crio-socket\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:57.041639 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.041589 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06392e9b-65cd-4364-9c4c-14e46521b44a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:57.041849 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.041654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06392e9b-65cd-4364-9c4c-14e46521b44a-data-volume\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:57.042038 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.042010 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06392e9b-65cd-4364-9c4c-14e46521b44a-data-volume\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:57.042178 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.042156 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06392e9b-65cd-4364-9c4c-14e46521b44a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:57.044120 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.044099 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06392e9b-65cd-4364-9c4c-14e46521b44a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:57.046852 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.046829 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:57.050510 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.050471 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h4gs\" (UniqueName: \"kubernetes.io/projected/06392e9b-65cd-4364-9c4c-14e46521b44a-kube-api-access-2h4gs\") pod \"insights-runtime-extractor-mbzgk\" (UID: \"06392e9b-65cd-4364-9c4c-14e46521b44a\") " pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:57.145234 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.145208 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mbzgk" Jun 10 14:58:57.312598 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.312572 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mbzgk"] Jun 10 14:58:57.315656 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:58:57.315606 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06392e9b_65cd_4364_9c4c_14e46521b44a.slice/crio-29f0a740a937b6b3de1c706ffb7514d501ff81e8d19c20a687951fb050becaac WatchSource:0}: Error finding container 29f0a740a937b6b3de1c706ffb7514d501ff81e8d19c20a687951fb050becaac: Status 404 returned error can't find the container with id 29f0a740a937b6b3de1c706ffb7514d501ff81e8d19c20a687951fb050becaac Jun 10 14:58:57.575425 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.575375 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbzgk" event={"ID":"06392e9b-65cd-4364-9c4c-14e46521b44a","Type":"ContainerStarted","Data":"e6ee4906c5849dfe62039fa116f702750df087cf097c28d7ca811326e40b462a"} Jun 10 14:58:57.575586 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:57.575476 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbzgk" event={"ID":"06392e9b-65cd-4364-9c4c-14e46521b44a","Type":"ContainerStarted","Data":"29f0a740a937b6b3de1c706ffb7514d501ff81e8d19c20a687951fb050becaac"} Jun 10 14:58:58.245820 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:58.245780 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:58.345062 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:58.345020 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:58.424893 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:58.424860 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:59.133222 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:59.133195 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:59.233066 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:59.233035 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:59.334733 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:59.334699 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:59.486266 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:59.486244 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:58:59.582793 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:59.582769 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" event={"ID":"91c7173f-835f-4f26-aada-060529587c6b","Type":"ContainerStarted","Data":"d02776c181ef3c5e1189da1026ae66c7c4c08f8c8638aaed5b3012385006a023"} Jun 10 14:58:59.584654 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:59.584632 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbzgk" event={"ID":"06392e9b-65cd-4364-9c4c-14e46521b44a","Type":"ContainerStarted","Data":"5f4ce83fb586ddd285503e6bd313bfd201512bf68359b8b716f9ae16c0f8572a"} Jun 10 14:58:59.610351 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:58:59.610310 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-cx5zt" podStartSLOduration=33.384575438 podStartE2EDuration="35.610293655s" totalImagesPullingTime="2.225718217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:58:59.609085225 +0000 UTC m=+241.195874948" watchObservedRunningTime="2026-06-10 14:58:59.610293655 +0000 UTC m=+241.197083377" Jun 10 14:59:01.377552 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:01.377499 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:01.502499 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:01.502471 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:01.593747 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:01.593672 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mbzgk" event={"ID":"06392e9b-65cd-4364-9c4c-14e46521b44a","Type":"ContainerStarted","Data":"5f73776be8d3d89568480413b21a3dda9ea3ea8861619dfdbcafb775b806cfe4"} Jun 10 14:59:01.626276 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:01.626229 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mbzgk" podStartSLOduration=1.8875322749999999 podStartE2EDuration="5.62621551s" totalImagesPullingTime="3.738683235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 14:58:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:59:01.62608032 +0000 UTC m=+243.212870055" watchObservedRunningTime="2026-06-10 14:59:01.62621551 +0000 UTC m=+243.213005233" Jun 10 14:59:01.699375 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:01.699350 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:03.361564 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:03.361532 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:04.846602 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:04.846576 2560 scope.go:117] "RemoveContainer" containerID="ab4c225858d560f2ca33008fa88e18373cb0baffd6dbe80a89286caa9f708e4a" Jun 10 14:59:04.847004 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:59:04.846725 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mmmc2_openshift-console-operator(ee1a077b-2c76-4f92-9194-a3f262e4ace8)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" podUID="ee1a077b-2c76-4f92-9194-a3f262e4ace8" Jun 10 14:59:05.529582 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:05.529555 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:05.697054 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:05.697025 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:05.798862 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:05.798787 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:05.889719 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:05.889683 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vm928"] Jun 10 14:59:05.892988 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:05.892964 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:05.899697 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:05.899676 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8rqml\"" Jun 10 14:59:05.900003 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:05.899984 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 14:59:05.900551 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:05.900534 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 14:59:05.900662 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:05.900640 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 14:59:05.901539 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:05.901519 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 14:59:05.958401 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:05.958364 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:06.015724 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.015697 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c90a0ad5-a2af-48ac-afd6-9823f609846f-root\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.015858 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.015728 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vgn6\" (UniqueName: \"kubernetes.io/projected/c90a0ad5-a2af-48ac-afd6-9823f609846f-kube-api-access-5vgn6\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.015858 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.015775 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c90a0ad5-a2af-48ac-afd6-9823f609846f-metrics-client-ca\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.015858 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.015810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-textfile\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.015966 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.015857 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c90a0ad5-a2af-48ac-afd6-9823f609846f-sys\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.015966 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.015897 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.015966 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.015924 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-wtmp\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.016071 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.015979 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-tls\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.016071 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.016016 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-accelerators-collector-config\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.049192 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.049134 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:06.116438 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.116359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c90a0ad5-a2af-48ac-afd6-9823f609846f-sys\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.116547 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.116437 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.116547 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.116472 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c90a0ad5-a2af-48ac-afd6-9823f609846f-sys\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.116547 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.116472 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-wtmp\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.116547 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.116511 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-tls\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.116547 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.116533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-accelerators-collector-config\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.116799 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.116552 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c90a0ad5-a2af-48ac-afd6-9823f609846f-root\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.116799 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.116568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgn6\" (UniqueName: \"kubernetes.io/projected/c90a0ad5-a2af-48ac-afd6-9823f609846f-kube-api-access-5vgn6\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.116799 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.116595 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-wtmp\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.116799 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.116598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c90a0ad5-a2af-48ac-afd6-9823f609846f-metrics-client-ca\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.116799 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.116693 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-textfile\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.116799 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.116702 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c90a0ad5-a2af-48ac-afd6-9823f609846f-root\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.117090 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.117072 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-textfile\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.117248 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.117231 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-accelerators-collector-config\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.117468 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.117450 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c90a0ad5-a2af-48ac-afd6-9823f609846f-metrics-client-ca\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.118908 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.118889 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-tls\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.118980 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.118933 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c90a0ad5-a2af-48ac-afd6-9823f609846f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.125003 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.124985 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vgn6\" (UniqueName: \"kubernetes.io/projected/c90a0ad5-a2af-48ac-afd6-9823f609846f-kube-api-access-5vgn6\") pod \"node-exporter-vm928\" (UID: \"c90a0ad5-a2af-48ac-afd6-9823f609846f\") " pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.143057 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.143018 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:06.201932 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.201906 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vm928" Jun 10 14:59:06.212174 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:59:06.212152 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90a0ad5_a2af_48ac_afd6_9823f609846f.slice/crio-756a727e15a24343082dd9afa90e0bd96e411330a3c6a48b79c10c51e4ea75f1 WatchSource:0}: Error finding container 756a727e15a24343082dd9afa90e0bd96e411330a3c6a48b79c10c51e4ea75f1: Status 404 returned error can't find the container with id 756a727e15a24343082dd9afa90e0bd96e411330a3c6a48b79c10c51e4ea75f1 Jun 10 14:59:06.243533 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.243508 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:06.446269 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.446241 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:06.551743 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.551708 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:06.614087 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.614039 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vm928" event={"ID":"c90a0ad5-a2af-48ac-afd6-9823f609846f","Type":"ContainerStarted","Data":"756a727e15a24343082dd9afa90e0bd96e411330a3c6a48b79c10c51e4ea75f1"} Jun 10 14:59:06.826716 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.826644 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:06.949377 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:06.949341 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:07.153598 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:07.153562 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:07.619152 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:07.619120 2560 generic.go:356] "Generic (PLEG): container finished" podID="c90a0ad5-a2af-48ac-afd6-9823f609846f" containerID="ca50d4da27ead19b07021e9584dc5ef3e0cbe42901cb8ee3b8d7f09ef6274761" exitCode=0 Jun 10 14:59:07.619309 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:07.619208 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vm928" event={"ID":"c90a0ad5-a2af-48ac-afd6-9823f609846f","Type":"ContainerDied","Data":"ca50d4da27ead19b07021e9584dc5ef3e0cbe42901cb8ee3b8d7f09ef6274761"} Jun 10 14:59:08.360975 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:08.360944 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:08.458776 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:08.458746 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:08.624047 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:08.623977 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vm928" event={"ID":"c90a0ad5-a2af-48ac-afd6-9823f609846f","Type":"ContainerStarted","Data":"fff2463861c68ae88793a34dc74306adb38a2fb72cb341e7c383ad27ac9c1d9e"} Jun 10 14:59:08.624047 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:08.624022 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vm928" event={"ID":"c90a0ad5-a2af-48ac-afd6-9823f609846f","Type":"ContainerStarted","Data":"945307bb4f8a8991c494ed4fdd5aff34e5d7cd2c625c555adaa9ccefb2f34e2d"} Jun 10 14:59:08.646175 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:08.646133 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vm928" podStartSLOduration=2.7566940620000002 podStartE2EDuration="3.64612044s" totalImagesPullingTime="814.937786ms" totalInitContainerRuntime="74.488592ms" isStatefulPod=true podCreationTimestamp="2026-06-10 14:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:59:08.645372591 +0000 UTC m=+250.232162327" watchObservedRunningTime="2026-06-10 14:59:08.64612044 +0000 UTC m=+250.232910163" Jun 10 14:59:08.788459 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:08.788435 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:08.891317 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:08.891276 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:09.025037 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:09.025008 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:09.144888 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:09.144821 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:10.569433 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:10.569375 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:10.753226 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:10.753192 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:59:10.755611 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:10.755580 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f54ab5dc-d0e0-453e-92f1-968e16b67c00-metrics-certs\") pod \"network-metrics-daemon-nvzzs\" (UID: \"f54ab5dc-d0e0-453e-92f1-968e16b67c00\") " pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:59:10.827036 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:10.826971 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:11.051251 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:11.051222 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xgr9p\"" Jun 10 14:59:11.059537 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:11.059514 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvzzs" Jun 10 14:59:11.200041 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:11.200017 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nvzzs"] Jun 10 14:59:11.202000 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:59:11.201974 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54ab5dc_d0e0_453e_92f1_968e16b67c00.slice/crio-88baeaa10c575de2009ba198b1fa4dbe2802be95cdd24e9117a5c4b619b842c0 WatchSource:0}: Error finding container 88baeaa10c575de2009ba198b1fa4dbe2802be95cdd24e9117a5c4b619b842c0: Status 404 returned error can't find the container with id 88baeaa10c575de2009ba198b1fa4dbe2802be95cdd24e9117a5c4b619b842c0 Jun 10 14:59:11.635176 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:11.635130 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nvzzs" event={"ID":"f54ab5dc-d0e0-453e-92f1-968e16b67c00","Type":"ContainerStarted","Data":"88baeaa10c575de2009ba198b1fa4dbe2802be95cdd24e9117a5c4b619b842c0"} Jun 10 14:59:12.157680 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.157657 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:12.170843 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.170820 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 14:59:12.174189 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.174170 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.179753 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.179731 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 14:59:12.179857 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.179731 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 14:59:12.179857 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.179779 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 14:59:12.180008 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.179864 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 14:59:12.180598 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.180579 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 14:59:12.180719 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.180648 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 14:59:12.180719 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.180702 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 14:59:12.180832 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.180660 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 14:59:12.180832 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.180820 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 14:59:12.180943 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.180845 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 14:59:12.180943 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.180904 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 14:59:12.180943 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.180846 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 14:59:12.181085 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.180945 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5r0tlcq9kkqes\"" Jun 10 14:59:12.181260 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.181244 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 14:59:12.181331 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.181275 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lld4g\"" Jun 10 14:59:12.182940 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.182920 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 14:59:12.190450 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.190428 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 14:59:12.204286 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.204247 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 14:59:12.265965 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.265943 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266072 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.265978 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266072 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.265999 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266072 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266019 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266072 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266039 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266072 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266067 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266226 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266095 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266226 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-config-out\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266226 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266127 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266226 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266210 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266367 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266246 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbx7m\" (UniqueName: \"kubernetes.io/projected/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-kube-api-access-zbx7m\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266367 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266309 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266367 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266334 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266367 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266358 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266592 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266592 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266592 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266500 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266592 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266535 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-web-config\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266592 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266565 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-config\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.266771 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.266617 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.367758 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.367669 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.367758 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.367719 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.367758 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.367750 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368019 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.367773 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368019 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.367804 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368019 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.367831 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368019 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.367854 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368019 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.367893 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368019 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.367920 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-config-out\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368019 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.367942 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368019 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.367975 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368019 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.368001 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbx7m\" (UniqueName: \"kubernetes.io/projected/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-kube-api-access-zbx7m\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368498 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.368036 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368498 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.368065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368498 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.368090 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368498 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.368117 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368498 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.368153 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368498 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.368176 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368783 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.368749 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.368979 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.368871 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.370609 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.369473 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.370609 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.369828 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-web-config\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.370609 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.369871 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-config\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.370609 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.370224 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.370919 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.370898 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.371332 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.371308 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.371630 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.371605 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.371725 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.371630 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-config-out\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.371801 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.371776 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.372220 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.371851 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.372343 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.371859 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.372470 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.372282 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.373173 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.373151 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.373667 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.373645 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.374068 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.374046 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.374334 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.374316 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.374737 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.374720 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.374796 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.374787 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-web-config\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.374841 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.374829 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-config\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.382768 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.382743 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbx7m\" (UniqueName: \"kubernetes.io/projected/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-kube-api-access-zbx7m\") pod \"prometheus-k8s-0\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.492157 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.492117 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:12.640443 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.640409 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nvzzs" event={"ID":"f54ab5dc-d0e0-453e-92f1-968e16b67c00","Type":"ContainerStarted","Data":"773453025b7d3be4e915aae9d6bd13c9825f69671b5891c70060f8dba247bbfd"} Jun 10 14:59:12.640786 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.640473 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nvzzs" event={"ID":"f54ab5dc-d0e0-453e-92f1-968e16b67c00","Type":"ContainerStarted","Data":"d10d142dfb8214ec2721e56ced04ebe384ff4fef38911efadfc902239e0fc27a"} Jun 10 14:59:12.647565 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.647544 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 14:59:12.648046 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:59:12.648024 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c5e162_60ec_4c55_b9f4_bb04c42a1094.slice/crio-717bd78afd4f9685f9630b99c7270e4d3c3becbb956d616e70d55141145ddd50 WatchSource:0}: Error finding container 717bd78afd4f9685f9630b99c7270e4d3c3becbb956d616e70d55141145ddd50: Status 404 returned error can't find the container with id 717bd78afd4f9685f9630b99c7270e4d3c3becbb956d616e70d55141145ddd50 Jun 10 14:59:12.662698 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.662655 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nvzzs" podStartSLOduration=252.785792896 podStartE2EDuration="4m13.662640978s" totalImagesPullingTime="876.848082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:59:12.660696271 +0000 UTC m=+254.247486005" watchObservedRunningTime="2026-06-10 14:59:12.662640978 +0000 UTC m=+254.249430701" Jun 10 14:59:12.778499 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.778472 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:12.872701 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:12.872671 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:13.646448 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:13.646422 2560 generic.go:356] "Generic (PLEG): container finished" podID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerID="17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467" exitCode=0 Jun 10 14:59:13.646728 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:13.646500 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerDied","Data":"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467"} Jun 10 14:59:13.646728 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:13.646573 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerStarted","Data":"717bd78afd4f9685f9630b99c7270e4d3c3becbb956d616e70d55141145ddd50"} Jun 10 14:59:17.666172 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:17.666133 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerStarted","Data":"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c"} Jun 10 14:59:17.666578 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:17.666218 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerStarted","Data":"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356"} Jun 10 14:59:17.847010 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:17.846980 2560 scope.go:117] "RemoveContainer" containerID="ab4c225858d560f2ca33008fa88e18373cb0baffd6dbe80a89286caa9f708e4a" Jun 10 14:59:18.672684 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:18.672650 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerStarted","Data":"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938"} Jun 10 14:59:18.674846 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:18.674811 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 14:59:18.674938 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:18.674892 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" event={"ID":"ee1a077b-2c76-4f92-9194-a3f262e4ace8","Type":"ContainerStarted","Data":"e2d0321f3fcf7df5c8db1135b16e13c58c43eb06feb9483ca3119c2bf1d43af7"} Jun 10 14:59:18.675568 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:18.675429 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:59:18.701285 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:18.701233 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" podStartSLOduration=49.100595417 podStartE2EDuration="54.701204094s" totalImagesPullingTime="5.600608677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:59:18.699829858 +0000 UTC m=+260.286619600" watchObservedRunningTime="2026-06-10 14:59:18.701204094 +0000 UTC m=+260.287993817" Jun 10 14:59:18.827405 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:18.827351 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-mmmc2" Jun 10 14:59:19.125136 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:19.125105 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:19.221737 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:19.221709 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:19.330010 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:19.329981 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:19.423221 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:19.423138 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:19.681727 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:19.681643 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerStarted","Data":"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd"} Jun 10 14:59:19.681727 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:19.681716 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerStarted","Data":"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071"} Jun 10 14:59:19.682219 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:19.681751 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerStarted","Data":"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee"} Jun 10 14:59:19.725176 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:19.725147 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:19.799636 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:19.799603 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:20.509083 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:20.509052 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:20.723587 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:20.723552 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:20.808606 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:20.808522 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:20.911553 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:20.911510 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:21.175432 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:21.175383 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:22.493220 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:22.493178 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 14:59:23.123234 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:23.123190 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:23.196633 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:23.196606 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:28.148583 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:28.148538 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:28.211897 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:28.211872 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:28.326941 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:28.326911 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:28.387841 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:28.387819 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:34.349820 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:34.349787 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:34.423147 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:34.423120 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:37.748540 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:37.748510 2560 generic.go:356] "Generic (PLEG): container finished" podID="1392c32a-c09c-4879-b8c4-5d9cf4d12905" containerID="504ae59cb594306b9c15afe354747a5492af3aed005e22ede4d27d8d14c08506" exitCode=0 Jun 10 14:59:37.748905 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:37.748584 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" event={"ID":"1392c32a-c09c-4879-b8c4-5d9cf4d12905","Type":"ContainerDied","Data":"504ae59cb594306b9c15afe354747a5492af3aed005e22ede4d27d8d14c08506"} Jun 10 14:59:37.748905 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:37.748879 2560 scope.go:117] "RemoveContainer" containerID="504ae59cb594306b9c15afe354747a5492af3aed005e22ede4d27d8d14c08506" Jun 10 14:59:37.769624 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:37.769582 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=20.054634881 podStartE2EDuration="25.76956673s" totalImagesPullingTime="5.698505377s" totalInitContainerRuntime="16.426472ms" isStatefulPod=false podCreationTimestamp="2026-06-10 14:59:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:59:19.720634791 +0000 UTC m=+261.307424514" watchObservedRunningTime="2026-06-10 14:59:37.76956673 +0000 UTC m=+279.356356452" Jun 10 14:59:37.845192 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:37.845164 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:38.753349 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:38.753319 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jqgxn" event={"ID":"1392c32a-c09c-4879-b8c4-5d9cf4d12905","Type":"ContainerStarted","Data":"6e4694a078dd07a0c26f21d9f3b2ce4952ab5e635e92581fb76f9d68f273f182"} Jun 10 14:59:40.310687 ip-10-0-130-107 kubenswrapper[2560]: E0610 14:59:40.310642 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kckpq" podUID="fcf06589-00b6-4e3d-a60c-9023441c29b5" Jun 10 14:59:40.760672 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:40.760636 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kckpq" Jun 10 14:59:42.285002 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:42.284973 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:42.363810 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:42.363750 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:43.221094 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:43.221056 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:59:43.223525 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:43.223506 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcf06589-00b6-4e3d-a60c-9023441c29b5-metrics-tls\") pod \"dns-default-kckpq\" (UID: \"fcf06589-00b6-4e3d-a60c-9023441c29b5\") " pod="openshift-dns/dns-default-kckpq" Jun 10 14:59:43.464475 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:43.464442 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lpmmf\"" Jun 10 14:59:43.472680 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:43.472622 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kckpq" Jun 10 14:59:43.609026 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:43.608984 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kckpq"] Jun 10 14:59:43.613341 ip-10-0-130-107 kubenswrapper[2560]: W0610 14:59:43.613312 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf06589_00b6_4e3d_a60c_9023441c29b5.slice/crio-6c691ba426831359894198a4a28bd52946c760ee80e86335181fa08c050c4076 WatchSource:0}: Error finding container 6c691ba426831359894198a4a28bd52946c760ee80e86335181fa08c050c4076: Status 404 returned error can't find the container with id 6c691ba426831359894198a4a28bd52946c760ee80e86335181fa08c050c4076 Jun 10 14:59:43.775872 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:43.775780 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kckpq" event={"ID":"fcf06589-00b6-4e3d-a60c-9023441c29b5","Type":"ContainerStarted","Data":"6c691ba426831359894198a4a28bd52946c760ee80e86335181fa08c050c4076"} Jun 10 14:59:44.361560 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:44.361523 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:44.448213 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:44.448172 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:45.784777 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:45.784745 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kckpq" event={"ID":"fcf06589-00b6-4e3d-a60c-9023441c29b5","Type":"ContainerStarted","Data":"a5f7dfc3f54daecda71dd96106a4220b3fb402e0a551aa92799a64784e973c35"} Jun 10 14:59:45.785211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:45.784799 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kckpq" event={"ID":"fcf06589-00b6-4e3d-a60c-9023441c29b5","Type":"ContainerStarted","Data":"ec168806d08af6c8da0bbca40d5fe2d0def36c1bc258d7b42936a60fd5fc6ba7"} Jun 10 14:59:45.785211 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:45.784906 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kckpq" Jun 10 14:59:45.805486 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:45.805446 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kckpq" podStartSLOduration=251.390970072 podStartE2EDuration="4m12.805432468s" totalImagesPullingTime="1.414462396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 14:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 14:59:45.804291796 +0000 UTC m=+287.391081518" watchObservedRunningTime="2026-06-10 14:59:45.805432468 +0000 UTC m=+287.392222190" Jun 10 14:59:46.790404 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:46.790352 2560 generic.go:356] "Generic (PLEG): container finished" podID="b122c82e-bb9c-4ed6-8530-0b47dbc230b8" containerID="9568704a4e2c85d16a04bd248dea1e7076e6c4720057f5cf2ac75bc8d865d658" exitCode=0 Jun 10 14:59:46.790847 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:46.790432 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4pvg5" event={"ID":"b122c82e-bb9c-4ed6-8530-0b47dbc230b8","Type":"ContainerDied","Data":"9568704a4e2c85d16a04bd248dea1e7076e6c4720057f5cf2ac75bc8d865d658"} Jun 10 14:59:46.790912 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:46.790900 2560 scope.go:117] "RemoveContainer" containerID="9568704a4e2c85d16a04bd248dea1e7076e6c4720057f5cf2ac75bc8d865d658" Jun 10 14:59:47.796372 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:47.796340 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4pvg5" event={"ID":"b122c82e-bb9c-4ed6-8530-0b47dbc230b8","Type":"ContainerStarted","Data":"80918003757e9a361ecf40251a354485c806880e5758333522bc5dd8c6517535"} Jun 10 14:59:50.839503 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:50.839473 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-cx5zt_91c7173f-835f-4f26-aada-060529587c6b/cluster-monitoring-operator/0.log" Jun 10 14:59:51.752560 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:51.752527 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:51.825114 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:51.825082 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:53.236562 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:53.236533 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vm928_c90a0ad5-a2af-48ac-afd6-9823f609846f/init-textfile/0.log" Jun 10 14:59:53.438612 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:53.438586 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vm928_c90a0ad5-a2af-48ac-afd6-9823f609846f/node-exporter/0.log" Jun 10 14:59:53.636291 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:53.636267 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vm928_c90a0ad5-a2af-48ac-afd6-9823f609846f/kube-rbac-proxy/0.log" Jun 10 14:59:54.436186 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:54.436162 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0c5e162-60ec-4c55-b9f4-bb04c42a1094/init-config-reloader/0.log" Jun 10 14:59:54.598512 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:54.598470 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" podUID="e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 14:59:54.639798 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:54.639771 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0c5e162-60ec-4c55-b9f4-bb04c42a1094/prometheus/0.log" Jun 10 14:59:54.835983 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:54.835913 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0c5e162-60ec-4c55-b9f4-bb04c42a1094/config-reloader/0.log" Jun 10 14:59:55.036921 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:55.036894 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0c5e162-60ec-4c55-b9f4-bb04c42a1094/thanos-sidecar/0.log" Jun 10 14:59:55.235863 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:55.235839 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0c5e162-60ec-4c55-b9f4-bb04c42a1094/kube-rbac-proxy-web/0.log" Jun 10 14:59:55.435888 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:55.435849 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0c5e162-60ec-4c55-b9f4-bb04c42a1094/kube-rbac-proxy/0.log" Jun 10 14:59:55.636532 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:55.636503 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0c5e162-60ec-4c55-b9f4-bb04c42a1094/kube-rbac-proxy-thanos/0.log" Jun 10 14:59:55.793147 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:55.793117 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kckpq" Jun 10 14:59:58.436525 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:58.436492 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 14:59:58.640147 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:58.640120 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/3.log" Jun 10 14:59:58.788915 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:58.788838 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 14:59:58.789620 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:58.789587 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 14:59:58.798777 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:58.798759 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 14:59:58.799135 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:58.799115 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 14:59:58.801427 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:58.801409 2560 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 14:59:59.252629 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:59.252592 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:59.349959 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:59.349927 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 14:59:59.838418 ip-10-0-130-107 kubenswrapper[2560]: I0610 14:59:59.837862 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kckpq_fcf06589-00b6-4e3d-a60c-9023441c29b5/dns/0.log" Jun 10 15:00:00.037726 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:00.037696 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kckpq_fcf06589-00b6-4e3d-a60c-9023441c29b5/kube-rbac-proxy/0.log" Jun 10 15:00:00.647589 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:00.647565 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-72c4r_2438bf76-f556-4a2f-83c6-dcf98a216432/dns-node-resolver/0.log" Jun 10 15:00:01.708133 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:01.708095 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:01.848717 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:01.848686 2560 generic.go:356] "Generic (PLEG): container finished" podID="0ca31ff9-7a7e-487b-8bc7-8eaf539900ad" containerID="d69fd2661420940ae799397868fc0d3ff9c18da1b1196f45932480f32124ae9a" exitCode=0 Jun 10 15:00:01.848891 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:01.848765 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" event={"ID":"0ca31ff9-7a7e-487b-8bc7-8eaf539900ad","Type":"ContainerDied","Data":"d69fd2661420940ae799397868fc0d3ff9c18da1b1196f45932480f32124ae9a"} Jun 10 15:00:01.849116 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:01.849100 2560 scope.go:117] "RemoveContainer" containerID="d69fd2661420940ae799397868fc0d3ff9c18da1b1196f45932480f32124ae9a" Jun 10 15:00:01.867555 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:01.867528 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:02.099018 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:02.098942 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dbpgp_366482e2-0d37-4e7a-8344-4414bcab48d6/node-ca/0.log" Jun 10 15:00:02.588984 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:02.588947 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:02.687858 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:02.687826 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:02.836861 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:02.836833 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z7hgb_349051fb-b35b-4493-b8c0-821175071eae/serve-healthcheck-canary/0.log" Jun 10 15:00:02.854739 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:02.854660 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-79cpz" event={"ID":"0ca31ff9-7a7e-487b-8bc7-8eaf539900ad","Type":"ContainerStarted","Data":"55e9111fe2264d5a7524918230f5f4efab0786177a44e458e640934050ee1dad"} Jun 10 15:00:04.381423 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:04.381373 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:04.468465 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:04.468369 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:04.598941 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:04.598906 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" podUID="e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 15:00:05.237092 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:05.237055 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:05.321350 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:05.321314 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:05.626887 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:05.626863 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:05.762079 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:05.762051 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:11.831806 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:11.831739 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:12.027068 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:12.027033 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:12.132945 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:12.132911 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:12.492637 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:12.492559 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:12.513085 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:12.513059 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:12.906454 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:12.906426 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:14.599207 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:14.599171 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" podUID="e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 15:00:14.599612 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:14.599237 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" Jun 10 15:00:14.599745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:14.599716 2560 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"22308f2315aede453fa1a338b2fe7118a80cc40bed791b1bf9de3dd09826f64d"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 10 15:00:14.599781 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:14.599766 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" podUID="e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4" containerName="service-proxy" containerID="cri-o://22308f2315aede453fa1a338b2fe7118a80cc40bed791b1bf9de3dd09826f64d" gracePeriod=30 Jun 10 15:00:14.803407 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:14.803364 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:14.900520 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:14.900488 2560 generic.go:356] "Generic (PLEG): container finished" podID="e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4" containerID="22308f2315aede453fa1a338b2fe7118a80cc40bed791b1bf9de3dd09826f64d" exitCode=2 Jun 10 15:00:14.900684 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:14.900552 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" event={"ID":"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4","Type":"ContainerDied","Data":"22308f2315aede453fa1a338b2fe7118a80cc40bed791b1bf9de3dd09826f64d"} Jun 10 15:00:14.900684 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:14.900597 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-559cb487b4-cbzgc" event={"ID":"e315b3ed-e65a-4ce4-9e4a-c90d1cbb55b4","Type":"ContainerStarted","Data":"d085778efd740db63f628d7b3ba60f6dfc10ab2754647b17164dba3cc2a0aa6c"} Jun 10 15:00:15.027958 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:15.027925 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:19.387131 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:19.387098 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:19.517584 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:19.517551 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:21.979190 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:21.979156 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:22.047411 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:22.047363 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:25.581813 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:25.581785 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:25.697832 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:25.697805 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:25.814964 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:25.814927 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:27.829559 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:27.829524 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:28.026544 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:28.026508 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:28.167355 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:28.167327 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:28.586651 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:28.586574 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:28.757911 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:28.757879 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:30.605960 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.605929 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 15:00:30.606628 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.606231 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="kube-rbac-proxy" containerID="cri-o://ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071" gracePeriod=600 Jun 10 15:00:30.606628 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.606257 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="kube-rbac-proxy-web" containerID="cri-o://84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee" gracePeriod=600 Jun 10 15:00:30.606628 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.606266 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="thanos-sidecar" containerID="cri-o://61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938" gracePeriod=600 Jun 10 15:00:30.606628 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.606213 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="prometheus" containerID="cri-o://69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356" gracePeriod=600 Jun 10 15:00:30.606628 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.606240 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd" gracePeriod=600 Jun 10 15:00:30.606628 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.606267 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="config-reloader" containerID="cri-o://37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c" gracePeriod=600 Jun 10 15:00:30.857329 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.857273 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:30.911566 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911531 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-metrics-client-ca\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.911745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911579 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-2\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.911745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911616 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-config-out\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.911745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911645 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-trusted-ca-bundle\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.911745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911672 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-web-config\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.911745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911698 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-db\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.911745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911739 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-thanos-prometheus-http-client-file\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912056 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911766 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912056 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911798 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-0\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912056 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911824 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbx7m\" (UniqueName: \"kubernetes.io/projected/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-kube-api-access-zbx7m\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912056 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911850 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-kube-rbac-proxy\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912056 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911879 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-1\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912056 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911917 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-tls\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912056 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911942 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-metrics-client-certs\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912056 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.911969 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-serving-certs-ca-bundle\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912056 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.912004 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-grpc-tls\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912056 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.912019 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:00:30.912056 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.912045 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912613 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.912072 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-kubelet-serving-ca-bundle\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912613 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.912101 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-config\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912613 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.912133 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-tls-assets\") pod \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\" (UID: \"c0c5e162-60ec-4c55-b9f4-bb04c42a1094\") " Jun 10 15:00:30.912613 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.912262 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:00:30.912613 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.912366 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:00:30.912613 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.912418 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-metrics-client-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:30.912613 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.912437 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:30.913664 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.913363 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:00:30.913664 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.913541 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:00:30.914640 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.914543 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:00:30.915420 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.915366 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:00:30.915747 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.915715 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:00:30.915984 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.915957 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:30.916363 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.916327 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:30.916481 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.916459 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-kube-api-access-zbx7m" (OuterVolumeSpecName: "kube-api-access-zbx7m") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "kube-api-access-zbx7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:00:30.916740 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.916696 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:00:30.918223 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.918197 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:30.918677 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.918654 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-config-out" (OuterVolumeSpecName: "config-out") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:00:30.918765 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.918710 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:30.918765 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.918727 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:30.919059 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.919040 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-config" (OuterVolumeSpecName: "config") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:30.919303 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.919260 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:30.919863 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.919841 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:30.928163 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.928143 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-web-config" (OuterVolumeSpecName: "web-config") pod "c0c5e162-60ec-4c55-b9f4-bb04c42a1094" (UID: "c0c5e162-60ec-4c55-b9f4-bb04c42a1094"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 15:00:30.960493 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960468 2560 generic.go:356] "Generic (PLEG): container finished" podID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerID="9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd" exitCode=0 Jun 10 15:00:30.960493 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960488 2560 generic.go:356] "Generic (PLEG): container finished" podID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerID="ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071" exitCode=0 Jun 10 15:00:30.960493 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960496 2560 generic.go:356] "Generic (PLEG): container finished" podID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerID="84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee" exitCode=0 Jun 10 15:00:30.960745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960501 2560 generic.go:356] "Generic (PLEG): container finished" podID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerID="61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938" exitCode=0 Jun 10 15:00:30.960745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960507 2560 generic.go:356] "Generic (PLEG): container finished" podID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerID="37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c" exitCode=0 Jun 10 15:00:30.960745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960511 2560 generic.go:356] "Generic (PLEG): container finished" podID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerID="69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356" exitCode=0 Jun 10 15:00:30.960745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960541 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:30.960745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960557 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerDied","Data":"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd"} Jun 10 15:00:30.960745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960642 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerDied","Data":"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071"} Jun 10 15:00:30.960745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960688 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerDied","Data":"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee"} Jun 10 15:00:30.960745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960708 2560 scope.go:117] "RemoveContainer" containerID="9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd" Jun 10 15:00:30.960745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960731 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerDied","Data":"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938"} Jun 10 15:00:30.961146 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960771 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerDied","Data":"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c"} Jun 10 15:00:30.961146 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960814 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerDied","Data":"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356"} Jun 10 15:00:30.961146 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.960855 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0c5e162-60ec-4c55-b9f4-bb04c42a1094","Type":"ContainerDied","Data":"717bd78afd4f9685f9630b99c7270e4d3c3becbb956d616e70d55141145ddd50"} Jun 10 15:00:30.968334 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.968306 2560 scope.go:117] "RemoveContainer" containerID="ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071" Jun 10 15:00:30.975029 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.975013 2560 scope.go:117] "RemoveContainer" containerID="84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee" Jun 10 15:00:30.982080 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.982065 2560 scope.go:117] "RemoveContainer" containerID="61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938" Jun 10 15:00:30.988527 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.988512 2560 scope.go:117] "RemoveContainer" containerID="37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c" Jun 10 15:00:30.995113 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.995093 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 15:00:30.995284 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:30.995269 2560 scope.go:117] "RemoveContainer" containerID="69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356" Jun 10 15:00:31.002125 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.002108 2560 scope.go:117] "RemoveContainer" containerID="17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467" Jun 10 15:00:31.008636 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.008620 2560 scope.go:117] "RemoveContainer" containerID="9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd" Jun 10 15:00:31.008952 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:00:31.008925 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd\": container with ID starting with 9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd not found: ID does not exist" containerID="9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd" Jun 10 15:00:31.009009 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.008959 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd"} err="failed to get container status \"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd\": rpc error: code = NotFound desc = could not find container \"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd\": container with ID starting with 9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd not found: ID does not exist" Jun 10 15:00:31.009009 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.008975 2560 scope.go:117] "RemoveContainer" containerID="ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071" Jun 10 15:00:31.009207 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:00:31.009188 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071\": container with ID starting with ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071 not found: ID does not exist" containerID="ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071" Jun 10 15:00:31.009250 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.009210 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071"} err="failed to get container status \"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071\": rpc error: code = NotFound desc = could not find container \"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071\": container with ID starting with ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071 not found: ID does not exist" Jun 10 15:00:31.009250 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.009224 2560 scope.go:117] "RemoveContainer" containerID="84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee" Jun 10 15:00:31.009512 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:00:31.009481 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee\": container with ID starting with 84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee not found: ID does not exist" containerID="84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee" Jun 10 15:00:31.009563 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.009518 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee"} err="failed to get container status \"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee\": rpc error: code = NotFound desc = could not find container \"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee\": container with ID starting with 84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee not found: ID does not exist" Jun 10 15:00:31.009563 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.009538 2560 scope.go:117] "RemoveContainer" containerID="61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938" Jun 10 15:00:31.009763 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:00:31.009739 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938\": container with ID starting with 61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938 not found: ID does not exist" containerID="61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938" Jun 10 15:00:31.009807 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.009763 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938"} err="failed to get container status \"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938\": rpc error: code = NotFound desc = could not find container \"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938\": container with ID starting with 61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938 not found: ID does not exist" Jun 10 15:00:31.009807 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.009779 2560 scope.go:117] "RemoveContainer" containerID="37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c" Jun 10 15:00:31.010051 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:00:31.010033 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c\": container with ID starting with 37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c not found: ID does not exist" containerID="37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c" Jun 10 15:00:31.010223 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.010053 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c"} err="failed to get container status \"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c\": rpc error: code = NotFound desc = could not find container \"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c\": container with ID starting with 37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c not found: ID does not exist" Jun 10 15:00:31.010223 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.010068 2560 scope.go:117] "RemoveContainer" containerID="69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356" Jun 10 15:00:31.010426 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:00:31.010346 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356\": container with ID starting with 69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356 not found: ID does not exist" containerID="69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356" Jun 10 15:00:31.010522 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.010374 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356"} err="failed to get container status \"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356\": rpc error: code = NotFound desc = could not find container \"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356\": container with ID starting with 69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356 not found: ID does not exist" Jun 10 15:00:31.010623 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.010526 2560 scope.go:117] "RemoveContainer" containerID="17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467" Jun 10 15:00:31.010965 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:00:31.010866 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467\": container with ID starting with 17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467 not found: ID does not exist" containerID="17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467" Jun 10 15:00:31.010965 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.010918 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467"} err="failed to get container status \"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467\": rpc error: code = NotFound desc = could not find container \"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467\": container with ID starting with 17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467 not found: ID does not exist" Jun 10 15:00:31.011132 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.010975 2560 scope.go:117] "RemoveContainer" containerID="9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd" Jun 10 15:00:31.011231 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.011206 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd"} err="failed to get container status \"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd\": rpc error: code = NotFound desc = could not find container \"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd\": container with ID starting with 9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd not found: ID does not exist" Jun 10 15:00:31.011276 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.011234 2560 scope.go:117] "RemoveContainer" containerID="ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071" Jun 10 15:00:31.011507 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.011486 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071"} err="failed to get container status \"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071\": rpc error: code = NotFound desc = could not find container \"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071\": container with ID starting with ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071 not found: ID does not exist" Jun 10 15:00:31.011564 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.011507 2560 scope.go:117] "RemoveContainer" containerID="84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee" Jun 10 15:00:31.011724 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.011707 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee"} err="failed to get container status \"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee\": rpc error: code = NotFound desc = could not find container \"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee\": container with ID starting with 84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee not found: ID does not exist" Jun 10 15:00:31.011765 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.011725 2560 scope.go:117] "RemoveContainer" containerID="61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938" Jun 10 15:00:31.011960 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.011940 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938"} err="failed to get container status \"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938\": rpc error: code = NotFound desc = could not find container \"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938\": container with ID starting with 61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938 not found: ID does not exist" Jun 10 15:00:31.012025 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.011960 2560 scope.go:117] "RemoveContainer" containerID="37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c" Jun 10 15:00:31.012201 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012185 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c"} err="failed to get container status \"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c\": rpc error: code = NotFound desc = could not find container \"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c\": container with ID starting with 37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c not found: ID does not exist" Jun 10 15:00:31.012246 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012201 2560 scope.go:117] "RemoveContainer" containerID="69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356" Jun 10 15:00:31.012491 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012459 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356"} err="failed to get container status \"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356\": rpc error: code = NotFound desc = could not find container \"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356\": container with ID starting with 69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356 not found: ID does not exist" Jun 10 15:00:31.012556 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012492 2560 scope.go:117] "RemoveContainer" containerID="17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467" Jun 10 15:00:31.012727 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012710 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467"} err="failed to get container status \"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467\": rpc error: code = NotFound desc = could not find container \"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467\": container with ID starting with 17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467 not found: ID does not exist" Jun 10 15:00:31.012800 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012727 2560 scope.go:117] "RemoveContainer" containerID="9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd" Jun 10 15:00:31.012886 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012865 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.012975 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012892 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.012975 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012909 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.012975 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012915 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd"} err="failed to get container status \"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd\": rpc error: code = NotFound desc = could not find container \"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd\": container with ID starting with 9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd not found: ID does not exist" Jun 10 15:00:31.012975 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012946 2560 scope.go:117] "RemoveContainer" containerID="ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071" Jun 10 15:00:31.012975 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012963 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 15:00:31.012975 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012922 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbx7m\" (UniqueName: \"kubernetes.io/projected/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-kube-api-access-zbx7m\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.012992 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-kube-rbac-proxy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013003 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013012 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013025 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-metrics-client-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013035 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013043 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-grpc-tls\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013051 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013065 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013079 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-config\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013092 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-tls-assets\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013101 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-config-out\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013109 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013136 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-web-config\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013149 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c0c5e162-60ec-4c55-b9f4-bb04c42a1094-prometheus-k8s-db\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013169 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071"} err="failed to get container status \"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071\": rpc error: code = NotFound desc = could not find container \"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071\": container with ID starting with ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071 not found: ID does not exist" Jun 10 15:00:31.013241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013182 2560 scope.go:117] "RemoveContainer" containerID="84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee" Jun 10 15:00:31.013802 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013476 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee"} err="failed to get container status \"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee\": rpc error: code = NotFound desc = could not find container \"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee\": container with ID starting with 84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee not found: ID does not exist" Jun 10 15:00:31.013802 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013494 2560 scope.go:117] "RemoveContainer" containerID="61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938" Jun 10 15:00:31.013802 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013697 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938"} err="failed to get container status \"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938\": rpc error: code = NotFound desc = could not find container \"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938\": container with ID starting with 61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938 not found: ID does not exist" Jun 10 15:00:31.013802 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013709 2560 scope.go:117] "RemoveContainer" containerID="37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c" Jun 10 15:00:31.013920 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013901 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c"} err="failed to get container status \"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c\": rpc error: code = NotFound desc = could not find container \"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c\": container with ID starting with 37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c not found: ID does not exist" Jun 10 15:00:31.013952 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.013922 2560 scope.go:117] "RemoveContainer" containerID="69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356" Jun 10 15:00:31.014149 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.014130 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356"} err="failed to get container status \"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356\": rpc error: code = NotFound desc = could not find container \"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356\": container with ID starting with 69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356 not found: ID does not exist" Jun 10 15:00:31.014203 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.014150 2560 scope.go:117] "RemoveContainer" containerID="17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467" Jun 10 15:00:31.014344 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.014327 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467"} err="failed to get container status \"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467\": rpc error: code = NotFound desc = could not find container \"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467\": container with ID starting with 17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467 not found: ID does not exist" Jun 10 15:00:31.014407 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.014345 2560 scope.go:117] "RemoveContainer" containerID="9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd" Jun 10 15:00:31.014580 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.014562 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd"} err="failed to get container status \"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd\": rpc error: code = NotFound desc = could not find container \"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd\": container with ID starting with 9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd not found: ID does not exist" Jun 10 15:00:31.014580 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.014580 2560 scope.go:117] "RemoveContainer" containerID="ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071" Jun 10 15:00:31.014788 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.014771 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071"} err="failed to get container status \"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071\": rpc error: code = NotFound desc = could not find container \"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071\": container with ID starting with ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071 not found: ID does not exist" Jun 10 15:00:31.014833 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.014791 2560 scope.go:117] "RemoveContainer" containerID="84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee" Jun 10 15:00:31.014989 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.014972 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee"} err="failed to get container status \"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee\": rpc error: code = NotFound desc = could not find container \"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee\": container with ID starting with 84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee not found: ID does not exist" Jun 10 15:00:31.015025 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.014988 2560 scope.go:117] "RemoveContainer" containerID="61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938" Jun 10 15:00:31.015181 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.015165 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938"} err="failed to get container status \"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938\": rpc error: code = NotFound desc = could not find container \"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938\": container with ID starting with 61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938 not found: ID does not exist" Jun 10 15:00:31.015231 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.015182 2560 scope.go:117] "RemoveContainer" containerID="37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c" Jun 10 15:00:31.015368 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.015345 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c"} err="failed to get container status \"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c\": rpc error: code = NotFound desc = could not find container \"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c\": container with ID starting with 37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c not found: ID does not exist" Jun 10 15:00:31.015368 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.015367 2560 scope.go:117] "RemoveContainer" containerID="69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356" Jun 10 15:00:31.015586 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.015572 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356"} err="failed to get container status \"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356\": rpc error: code = NotFound desc = could not find container \"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356\": container with ID starting with 69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356 not found: ID does not exist" Jun 10 15:00:31.015628 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.015587 2560 scope.go:117] "RemoveContainer" containerID="17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467" Jun 10 15:00:31.015790 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.015769 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467"} err="failed to get container status \"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467\": rpc error: code = NotFound desc = could not find container \"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467\": container with ID starting with 17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467 not found: ID does not exist" Jun 10 15:00:31.015790 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.015790 2560 scope.go:117] "RemoveContainer" containerID="9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd" Jun 10 15:00:31.016010 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.015993 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd"} err="failed to get container status \"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd\": rpc error: code = NotFound desc = could not find container \"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd\": container with ID starting with 9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd not found: ID does not exist" Jun 10 15:00:31.016066 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.016010 2560 scope.go:117] "RemoveContainer" containerID="ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071" Jun 10 15:00:31.016229 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.016215 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071"} err="failed to get container status \"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071\": rpc error: code = NotFound desc = could not find container \"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071\": container with ID starting with ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071 not found: ID does not exist" Jun 10 15:00:31.016276 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.016230 2560 scope.go:117] "RemoveContainer" containerID="84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee" Jun 10 15:00:31.016455 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.016438 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee"} err="failed to get container status \"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee\": rpc error: code = NotFound desc = could not find container \"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee\": container with ID starting with 84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee not found: ID does not exist" Jun 10 15:00:31.016518 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.016456 2560 scope.go:117] "RemoveContainer" containerID="61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938" Jun 10 15:00:31.016643 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.016627 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938"} err="failed to get container status \"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938\": rpc error: code = NotFound desc = could not find container \"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938\": container with ID starting with 61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938 not found: ID does not exist" Jun 10 15:00:31.016643 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.016642 2560 scope.go:117] "RemoveContainer" containerID="37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c" Jun 10 15:00:31.016848 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.016830 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c"} err="failed to get container status \"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c\": rpc error: code = NotFound desc = could not find container \"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c\": container with ID starting with 37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c not found: ID does not exist" Jun 10 15:00:31.016896 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.016849 2560 scope.go:117] "RemoveContainer" containerID="69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356" Jun 10 15:00:31.017028 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.017011 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356"} err="failed to get container status \"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356\": rpc error: code = NotFound desc = could not find container \"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356\": container with ID starting with 69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356 not found: ID does not exist" Jun 10 15:00:31.017076 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.017035 2560 scope.go:117] "RemoveContainer" containerID="17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467" Jun 10 15:00:31.017249 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.017228 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467"} err="failed to get container status \"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467\": rpc error: code = NotFound desc = could not find container \"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467\": container with ID starting with 17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467 not found: ID does not exist" Jun 10 15:00:31.017287 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.017250 2560 scope.go:117] "RemoveContainer" containerID="9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd" Jun 10 15:00:31.017460 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.017445 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd"} err="failed to get container status \"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd\": rpc error: code = NotFound desc = could not find container \"9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd\": container with ID starting with 9d4b59607e1b2ec168a86e48c50d62b7bbc9a857fa6aba32b2c67b317f9044dd not found: ID does not exist" Jun 10 15:00:31.017460 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.017459 2560 scope.go:117] "RemoveContainer" containerID="ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071" Jun 10 15:00:31.017660 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.017643 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071"} err="failed to get container status \"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071\": rpc error: code = NotFound desc = could not find container \"ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071\": container with ID starting with ad74c85e17cf3c9d9009431cbd7d69df8659abfa0f806c2297d5cb184d59c071 not found: ID does not exist" Jun 10 15:00:31.017707 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.017661 2560 scope.go:117] "RemoveContainer" containerID="84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee" Jun 10 15:00:31.017885 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.017865 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee"} err="failed to get container status \"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee\": rpc error: code = NotFound desc = could not find container \"84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee\": container with ID starting with 84df49b8683f439316fde09293073ea36f067276d2c8b0e04a750b6c2a0bddee not found: ID does not exist" Jun 10 15:00:31.017885 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.017884 2560 scope.go:117] "RemoveContainer" containerID="61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938" Jun 10 15:00:31.018093 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.018077 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938"} err="failed to get container status \"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938\": rpc error: code = NotFound desc = could not find container \"61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938\": container with ID starting with 61ed029528fccf2ecd57bdb4950049815203834dc1d7be9c5d8079b3d5d5f938 not found: ID does not exist" Jun 10 15:00:31.018138 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.018094 2560 scope.go:117] "RemoveContainer" containerID="37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c" Jun 10 15:00:31.018276 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.018259 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c"} err="failed to get container status \"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c\": rpc error: code = NotFound desc = could not find container \"37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c\": container with ID starting with 37edfa20eb7a80d618e595933eea6868646474689185012927efab0738bf8b1c not found: ID does not exist" Jun 10 15:00:31.018320 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.018276 2560 scope.go:117] "RemoveContainer" containerID="69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356" Jun 10 15:00:31.018502 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.018486 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356"} err="failed to get container status \"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356\": rpc error: code = NotFound desc = could not find container \"69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356\": container with ID starting with 69866e283f98394adf3fdcf427aea55375b5aec1e6db5be3c1c4c9ebabd41356 not found: ID does not exist" Jun 10 15:00:31.018560 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.018502 2560 scope.go:117] "RemoveContainer" containerID="17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467" Jun 10 15:00:31.018711 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.018690 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467"} err="failed to get container status \"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467\": rpc error: code = NotFound desc = could not find container \"17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467\": container with ID starting with 17b5fbc6feef1aabff152c45f013d6d5b914c98659f49fde89221b0d8c5fb467 not found: ID does not exist" Jun 10 15:00:31.061228 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061192 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 15:00:31.061524 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061508 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="thanos-sidecar" Jun 10 15:00:31.061607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061527 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="thanos-sidecar" Jun 10 15:00:31.061607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061540 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="kube-rbac-proxy-web" Jun 10 15:00:31.061607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061549 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="kube-rbac-proxy-web" Jun 10 15:00:31.061607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061559 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="kube-rbac-proxy-thanos" Jun 10 15:00:31.061607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061568 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="kube-rbac-proxy-thanos" Jun 10 15:00:31.061607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061586 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="init-config-reloader" Jun 10 15:00:31.061607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061594 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="init-config-reloader" Jun 10 15:00:31.061607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061605 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="prometheus" Jun 10 15:00:31.062020 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061613 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="prometheus" Jun 10 15:00:31.062020 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061622 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="config-reloader" Jun 10 15:00:31.062020 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061631 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="config-reloader" Jun 10 15:00:31.062020 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061653 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="kube-rbac-proxy" Jun 10 15:00:31.062020 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061662 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="kube-rbac-proxy" Jun 10 15:00:31.062020 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061730 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="prometheus" Jun 10 15:00:31.062020 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061746 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="config-reloader" Jun 10 15:00:31.062020 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061757 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="kube-rbac-proxy" Jun 10 15:00:31.062020 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061766 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="kube-rbac-proxy-thanos" Jun 10 15:00:31.062020 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061776 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="thanos-sidecar" Jun 10 15:00:31.062020 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.061784 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" containerName="kube-rbac-proxy-web" Jun 10 15:00:31.067304 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.067286 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.071432 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.071417 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 15:00:31.071716 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.071699 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 15:00:31.071716 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.071711 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 15:00:31.071882 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.071804 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 15:00:31.071966 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.071950 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lld4g\"" Jun 10 15:00:31.072309 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.072294 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5r0tlcq9kkqes\"" Jun 10 15:00:31.082467 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.082448 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 15:00:31.082901 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.082887 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 15:00:31.082947 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.082910 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 15:00:31.082947 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.082922 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 15:00:31.090582 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.090563 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 15:00:31.092644 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.092629 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 15:00:31.092725 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.092631 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 15:00:31.092725 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.092652 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 15:00:31.094752 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.094734 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 15:00:31.101645 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.101625 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 15:00:31.102897 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.102884 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 15:00:31.108003 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.107938 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 15:00:31.114526 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114609 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114549 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114609 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114681 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114606 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-config\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114681 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114636 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114741 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114684 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114741 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114715 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114741 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114733 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz2z9\" (UniqueName: \"kubernetes.io/projected/9a8b8792-df4e-4729-be10-794dc9b63017-kube-api-access-gz2z9\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114867 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114758 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114867 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114794 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114867 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114817 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114867 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114842 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a8b8792-df4e-4729-be10-794dc9b63017-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114985 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114897 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a8b8792-df4e-4729-be10-794dc9b63017-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114985 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114925 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114985 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114954 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.114985 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.114975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.115094 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.115026 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.115094 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.115042 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.115094 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.115079 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.115182 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.115103 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216067 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216037 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216067 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216068 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216262 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216090 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216262 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216113 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz2z9\" (UniqueName: \"kubernetes.io/projected/9a8b8792-df4e-4729-be10-794dc9b63017-kube-api-access-gz2z9\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216262 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216163 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216262 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216194 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216262 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216224 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216262 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216254 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a8b8792-df4e-4729-be10-794dc9b63017-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216599 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a8b8792-df4e-4729-be10-794dc9b63017-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216599 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216599 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216332 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216599 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216362 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216599 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216418 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216599 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216442 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216599 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216468 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216599 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216499 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216599 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216531 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216599 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216571 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.216599 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216596 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.217268 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216621 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-config\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.217268 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216736 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.217268 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216770 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.217268 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.216954 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.217512 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.217323 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.217512 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.217504 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.217898 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.217737 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.219611 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.219584 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.219871 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.219756 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-config\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.220753 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.220331 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.220753 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.220410 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.220753 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.220445 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a8b8792-df4e-4729-be10-794dc9b63017-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.220753 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.220702 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.221010 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.220885 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a8b8792-df4e-4729-be10-794dc9b63017-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.221067 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.221008 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.221729 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.221706 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a8b8792-df4e-4729-be10-794dc9b63017-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.222029 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.222008 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.222099 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.222066 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.222547 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.222530 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.223187 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.223170 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a8b8792-df4e-4729-be10-794dc9b63017-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.230939 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.230917 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz2z9\" (UniqueName: \"kubernetes.io/projected/9a8b8792-df4e-4729-be10-794dc9b63017-kube-api-access-gz2z9\") pod \"prometheus-k8s-0\" (UID: \"9a8b8792-df4e-4729-be10-794dc9b63017\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.376426 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.376375 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:31.536050 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.536014 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 15:00:31.540323 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:00:31.540300 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a8b8792_df4e_4729_be10_794dc9b63017.slice/crio-4eb8d3a91b1773f1fd5c70dac027cf8a33f885b3ab041b687d0a65940de3ba77 WatchSource:0}: Error finding container 4eb8d3a91b1773f1fd5c70dac027cf8a33f885b3ab041b687d0a65940de3ba77: Status 404 returned error can't find the container with id 4eb8d3a91b1773f1fd5c70dac027cf8a33f885b3ab041b687d0a65940de3ba77 Jun 10 15:00:31.966072 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.965988 2560 generic.go:356] "Generic (PLEG): container finished" podID="9a8b8792-df4e-4729-be10-794dc9b63017" containerID="f8738feff4105ed1150cbf395a54e3df4f49907d8dbb32f8aba454c30fc15b1c" exitCode=0 Jun 10 15:00:31.966498 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.966076 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a8b8792-df4e-4729-be10-794dc9b63017","Type":"ContainerDied","Data":"f8738feff4105ed1150cbf395a54e3df4f49907d8dbb32f8aba454c30fc15b1c"} Jun 10 15:00:31.966498 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:31.966174 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a8b8792-df4e-4729-be10-794dc9b63017","Type":"ContainerStarted","Data":"4eb8d3a91b1773f1fd5c70dac027cf8a33f885b3ab041b687d0a65940de3ba77"} Jun 10 15:00:32.852095 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:32.852062 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0c5e162-60ec-4c55-b9f4-bb04c42a1094" path="/var/lib/kubelet/pods/c0c5e162-60ec-4c55-b9f4-bb04c42a1094/volumes" Jun 10 15:00:32.974346 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:32.974317 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a8b8792-df4e-4729-be10-794dc9b63017","Type":"ContainerStarted","Data":"58a722ae4a54f79ba3f1ce6ffca86cbe38a140b9068e3fe225759eb364fbe85a"} Jun 10 15:00:32.974720 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:32.974377 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a8b8792-df4e-4729-be10-794dc9b63017","Type":"ContainerStarted","Data":"c2526ccdbdc9725e524c569da642cb9dd7b43923cb97a7a4e76eddb4e9d35fed"} Jun 10 15:00:32.974720 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:32.974432 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a8b8792-df4e-4729-be10-794dc9b63017","Type":"ContainerStarted","Data":"b13981e31cfb1299e2254ceb811f8c8da124518702355910d20f7a2b5bdb6f72"} Jun 10 15:00:32.974720 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:32.974457 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a8b8792-df4e-4729-be10-794dc9b63017","Type":"ContainerStarted","Data":"c82705fbbf3e89ebc56470cc228d17fec573ebbfd65f5d1a5b57ea64e68666c7"} Jun 10 15:00:32.974720 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:32.974490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a8b8792-df4e-4729-be10-794dc9b63017","Type":"ContainerStarted","Data":"c1e016315dc399c811906ab8a35d16c93c2cb5d84b69db96c0a2ce0baf1ef277"} Jun 10 15:00:32.974720 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:32.974514 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a8b8792-df4e-4729-be10-794dc9b63017","Type":"ContainerStarted","Data":"03fa7c81ef5a4da66920a6185c5d7b2af959a7520d12b0c6e77fee68bd28b958"} Jun 10 15:00:33.029808 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:33.029751 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.006455019 podStartE2EDuration="2.029730652s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.275633ms" isStatefulPod=false podCreationTimestamp="2026-06-10 15:00:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:00:33.027523016 +0000 UTC m=+334.614312750" watchObservedRunningTime="2026-06-10 15:00:33.029730652 +0000 UTC m=+334.616520375" Jun 10 15:00:34.388310 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:34.388279 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:34.613948 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:34.613918 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:34.827090 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:34.827015 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:34.955895 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:34.955866 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:36.377269 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:36.377188 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:00:38.610541 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:38.610510 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:38.711854 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:38.711824 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:38.816064 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:38.816033 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:49.355109 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:49.355077 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:00:49.455659 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:00:49.455624 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:01:17.445929 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:01:17.445892 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:01:17.547036 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:01:17.547001 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:01:31.376904 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:01:31.376855 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:01:31.392675 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:01:31.392650 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:01:32.211455 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:01:32.211420 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 15:01:52.106116 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:01:52.106083 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:01:55.322833 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:01:55.322801 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:01:55.420747 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:01:55.420719 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:27.172770 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:27.172741 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:28.213560 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:28.213528 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:30.781411 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:30.781361 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:30.882007 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:30.881975 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:32.221440 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:32.221406 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:32.319382 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:32.319352 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:32.466311 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:32.466286 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:32.666504 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:32.666474 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:35.523735 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:35.523692 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:36.105908 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:36.105878 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:37.557541 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:37.557511 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:37.616243 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:37.616215 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:40.144625 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:40.144569 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:40.257855 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:40.257824 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:44.119554 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:44.119521 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:48.976467 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:48.976434 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:49.076423 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:49.076374 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:54.888980 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:54.888952 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:54.995309 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:54.995275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:02:56.907451 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:02:56.907407 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:01.295521 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.295486 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:01.386725 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.386689 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr"] Jun 10 15:03:01.390157 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.390135 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.392863 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.392845 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fm4p7\"" Jun 10 15:03:01.393718 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.393697 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 15:03:01.393845 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.393717 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 15:03:01.393845 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.393742 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 15:03:01.393845 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.393755 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 15:03:01.394452 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.394433 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 15:03:01.396988 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.396964 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:01.403208 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.403187 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr"] Jun 10 15:03:01.424922 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.424902 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2bafdf5-f34b-478e-9bcf-24fb5e5caa08-cert\") pod \"lws-controller-manager-7776b7cdb6-j2dbr\" (UID: \"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.425037 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.424941 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2bafdf5-f34b-478e-9bcf-24fb5e5caa08-metrics-cert\") pod \"lws-controller-manager-7776b7cdb6-j2dbr\" (UID: \"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.425037 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.424964 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f2bafdf5-f34b-478e-9bcf-24fb5e5caa08-manager-config\") pod \"lws-controller-manager-7776b7cdb6-j2dbr\" (UID: \"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.425037 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.425010 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kwpq\" (UniqueName: \"kubernetes.io/projected/f2bafdf5-f34b-478e-9bcf-24fb5e5caa08-kube-api-access-5kwpq\") pod \"lws-controller-manager-7776b7cdb6-j2dbr\" (UID: \"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.525526 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.525492 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2bafdf5-f34b-478e-9bcf-24fb5e5caa08-metrics-cert\") pod \"lws-controller-manager-7776b7cdb6-j2dbr\" (UID: \"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.525704 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.525539 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f2bafdf5-f34b-478e-9bcf-24fb5e5caa08-manager-config\") pod \"lws-controller-manager-7776b7cdb6-j2dbr\" (UID: \"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.525704 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.525558 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kwpq\" (UniqueName: \"kubernetes.io/projected/f2bafdf5-f34b-478e-9bcf-24fb5e5caa08-kube-api-access-5kwpq\") pod \"lws-controller-manager-7776b7cdb6-j2dbr\" (UID: \"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.525704 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.525606 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2bafdf5-f34b-478e-9bcf-24fb5e5caa08-cert\") pod \"lws-controller-manager-7776b7cdb6-j2dbr\" (UID: \"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.526171 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.526149 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f2bafdf5-f34b-478e-9bcf-24fb5e5caa08-manager-config\") pod \"lws-controller-manager-7776b7cdb6-j2dbr\" (UID: \"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.528153 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.528132 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2bafdf5-f34b-478e-9bcf-24fb5e5caa08-cert\") pod \"lws-controller-manager-7776b7cdb6-j2dbr\" (UID: \"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.528238 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.528215 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2bafdf5-f34b-478e-9bcf-24fb5e5caa08-metrics-cert\") pod \"lws-controller-manager-7776b7cdb6-j2dbr\" (UID: \"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.536973 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.536953 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kwpq\" (UniqueName: \"kubernetes.io/projected/f2bafdf5-f34b-478e-9bcf-24fb5e5caa08-kube-api-access-5kwpq\") pod \"lws-controller-manager-7776b7cdb6-j2dbr\" (UID: \"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08\") " pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.699640 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.699600 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:01.856724 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.856692 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr"] Jun 10 15:03:01.859744 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:03:01.859711 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2bafdf5_f34b_478e_9bcf_24fb5e5caa08.slice/crio-8e90c769065ab8e47ff35518989d17691096c1d9f67e9810a4f4b61d9b12081c WatchSource:0}: Error finding container 8e90c769065ab8e47ff35518989d17691096c1d9f67e9810a4f4b61d9b12081c: Status 404 returned error can't find the container with id 8e90c769065ab8e47ff35518989d17691096c1d9f67e9810a4f4b61d9b12081c Jun 10 15:03:01.861602 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:01.861586 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 15:03:02.529356 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:02.529314 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" event={"ID":"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08","Type":"ContainerStarted","Data":"8e90c769065ab8e47ff35518989d17691096c1d9f67e9810a4f4b61d9b12081c"} Jun 10 15:03:05.542230 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:05.542193 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" event={"ID":"f2bafdf5-f34b-478e-9bcf-24fb5e5caa08","Type":"ContainerStarted","Data":"71a64a1d31787d593f192a1e742dbe5eb3d1e0db70c85c09026559f082cf0777"} Jun 10 15:03:05.542636 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:05.542322 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:05.562051 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:05.562000 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" podStartSLOduration=1.924803008 podStartE2EDuration="4.56198359s" totalImagesPullingTime="2.637180582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:03:05.560719878 +0000 UTC m=+487.147509593" watchObservedRunningTime="2026-06-10 15:03:05.56198359 +0000 UTC m=+487.148773312" Jun 10 15:03:13.574638 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:13.574584 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:13.673308 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:13.673265 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:14.041452 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.041422 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:14.349738 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.349648 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:14.445000 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.444964 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:14.520806 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.520776 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb"] Jun 10 15:03:14.524321 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.524306 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.526922 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.526897 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xnmmp\"" Jun 10 15:03:14.527154 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.527139 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 15:03:14.527237 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.527147 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 15:03:14.527237 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.527140 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 15:03:14.527317 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.527286 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 15:03:14.542115 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.542088 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb"] Jun 10 15:03:14.619631 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.619555 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-manifests\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.619631 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.619591 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.619983 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.619659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.619983 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.619683 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msf7g\" (UniqueName: \"kubernetes.io/projected/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-kube-api-access-msf7g\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.619983 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.619712 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-tmp\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.664501 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.664476 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:14.720676 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.720643 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.720676 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.720689 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msf7g\" (UniqueName: \"kubernetes.io/projected/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-kube-api-access-msf7g\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.720899 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.720709 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-tmp\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.720899 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.720744 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-manifests\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.720899 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.720766 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.721264 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.721242 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-manifests\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.723198 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.723179 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-tmp\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.723435 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.723418 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.723486 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.723415 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.732199 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.732175 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msf7g\" (UniqueName: \"kubernetes.io/projected/d4ee39f9-7106-4c2f-a654-e70ffc4f86eb-kube-api-access-msf7g\") pod \"opendatahub-operator-controller-manager-b55bf6875-s7kqb\" (UID: \"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb\") " pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.764700 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.764678 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:14.833625 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.833596 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:14.867421 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.867381 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:14.987524 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.987500 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb"] Jun 10 15:03:14.989237 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:03:14.989211 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ee39f9_7106_4c2f_a654_e70ffc4f86eb.slice/crio-2b3c7885f18d726eb8d1f8ec9d1579078ee486acc30a631a29ed01afc660f948 WatchSource:0}: Error finding container 2b3c7885f18d726eb8d1f8ec9d1579078ee486acc30a631a29ed01afc660f948: Status 404 returned error can't find the container with id 2b3c7885f18d726eb8d1f8ec9d1579078ee486acc30a631a29ed01afc660f948 Jun 10 15:03:14.999245 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:14.999226 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:15.112376 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:15.112347 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:15.305663 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:15.305565 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:15.407316 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:15.407291 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:15.579081 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:15.579003 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" event={"ID":"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb","Type":"ContainerStarted","Data":"2b3c7885f18d726eb8d1f8ec9d1579078ee486acc30a631a29ed01afc660f948"} Jun 10 15:03:16.548671 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:16.548626 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7776b7cdb6-j2dbr" Jun 10 15:03:18.594758 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:18.594722 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" event={"ID":"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb","Type":"ContainerStarted","Data":"67535e70ab738bb2b93547b3319325401ec0630fbbed17ba305be83b79ab7532"} Jun 10 15:03:19.600400 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:19.600364 2560 generic.go:356] "Generic (PLEG): container finished" podID="d4ee39f9-7106-4c2f-a654-e70ffc4f86eb" containerID="67535e70ab738bb2b93547b3319325401ec0630fbbed17ba305be83b79ab7532" exitCode=0 Jun 10 15:03:19.600851 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:19.600438 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" event={"ID":"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb","Type":"ContainerDied","Data":"67535e70ab738bb2b93547b3319325401ec0630fbbed17ba305be83b79ab7532"} Jun 10 15:03:20.607539 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:20.607508 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" event={"ID":"d4ee39f9-7106-4c2f-a654-e70ffc4f86eb","Type":"ContainerStarted","Data":"a01762a2d00e265b2b31c04d2ca9dc49d58f8c843f9343097d8e4c5d95735234"} Jun 10 15:03:20.607966 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:20.607634 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:20.649551 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:20.649507 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" podStartSLOduration=2.016600556 podStartE2EDuration="6.649491018s" totalImagesPullingTime="3.721294264s" totalInitContainerRuntime="911.596198ms" isStatefulPod=false podCreationTimestamp="2026-06-10 15:03:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:03:20.648754116 +0000 UTC m=+502.235543840" watchObservedRunningTime="2026-06-10 15:03:20.649491018 +0000 UTC m=+502.236280740" Jun 10 15:03:24.992579 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:24.992545 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:25.086927 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:25.086890 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:31.613811 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:31.613781 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b55bf6875-s7kqb" Jun 10 15:03:33.568455 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:33.568419 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:33.759427 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:33.759380 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:33.991707 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:33.991672 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:34.164499 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:34.164461 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:34.353165 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:34.353094 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:34.526831 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:34.526803 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:34.645037 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:34.645010 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:34.857951 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:34.857916 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:35.172924 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:35.172881 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:35.403178 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:35.403140 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:35.859629 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:35.859596 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:37.854482 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:37.854407 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:37.954586 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:37.954555 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:40.010199 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:40.010167 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:46.325999 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:46.325964 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:46.450913 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:46.450879 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:46.913101 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:46.913072 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:48.488243 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:48.488214 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:50.031861 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:50.031833 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:57.704287 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:57.704249 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:57.841226 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:57.841184 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:58.811770 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:58.811741 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:58.997870 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:58.997834 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:03:59.768107 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:03:59.768073 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:01.598603 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:01.598572 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:02.002906 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:02.002872 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:02.122191 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:02.122159 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:02.221757 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:02.221712 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:04.177678 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:04.177645 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:05.042947 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.042920 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5d48895b7f-xxbb2"] Jun 10 15:04:05.046456 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.046434 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5d48895b7f-xxbb2" Jun 10 15:04:05.049685 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.049662 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-f4dls\"" Jun 10 15:04:05.050522 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.050506 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 15:04:05.056450 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.056427 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5d48895b7f-xxbb2"] Jun 10 15:04:05.085371 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.085344 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:05.133596 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.133564 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c8975d6d-0342-42a3-8ff0-53be1216b5af-redirect-config\") pod \"dashboard-redirect-5d48895b7f-xxbb2\" (UID: \"c8975d6d-0342-42a3-8ff0-53be1216b5af\") " pod="opendatahub/dashboard-redirect-5d48895b7f-xxbb2" Jun 10 15:04:05.133719 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.133630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66hpb\" (UniqueName: \"kubernetes.io/projected/c8975d6d-0342-42a3-8ff0-53be1216b5af-kube-api-access-66hpb\") pod \"dashboard-redirect-5d48895b7f-xxbb2\" (UID: \"c8975d6d-0342-42a3-8ff0-53be1216b5af\") " pod="opendatahub/dashboard-redirect-5d48895b7f-xxbb2" Jun 10 15:04:05.234443 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.234416 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c8975d6d-0342-42a3-8ff0-53be1216b5af-redirect-config\") pod \"dashboard-redirect-5d48895b7f-xxbb2\" (UID: \"c8975d6d-0342-42a3-8ff0-53be1216b5af\") " pod="opendatahub/dashboard-redirect-5d48895b7f-xxbb2" Jun 10 15:04:05.234791 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.234464 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66hpb\" (UniqueName: \"kubernetes.io/projected/c8975d6d-0342-42a3-8ff0-53be1216b5af-kube-api-access-66hpb\") pod \"dashboard-redirect-5d48895b7f-xxbb2\" (UID: \"c8975d6d-0342-42a3-8ff0-53be1216b5af\") " pod="opendatahub/dashboard-redirect-5d48895b7f-xxbb2" Jun 10 15:04:05.235095 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.235077 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c8975d6d-0342-42a3-8ff0-53be1216b5af-redirect-config\") pod \"dashboard-redirect-5d48895b7f-xxbb2\" (UID: \"c8975d6d-0342-42a3-8ff0-53be1216b5af\") " pod="opendatahub/dashboard-redirect-5d48895b7f-xxbb2" Jun 10 15:04:05.247363 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.247335 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66hpb\" (UniqueName: \"kubernetes.io/projected/c8975d6d-0342-42a3-8ff0-53be1216b5af-kube-api-access-66hpb\") pod \"dashboard-redirect-5d48895b7f-xxbb2\" (UID: \"c8975d6d-0342-42a3-8ff0-53be1216b5af\") " pod="opendatahub/dashboard-redirect-5d48895b7f-xxbb2" Jun 10 15:04:05.357041 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.356968 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5d48895b7f-xxbb2" Jun 10 15:04:05.485456 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.485423 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5d48895b7f-xxbb2"] Jun 10 15:04:05.488259 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:04:05.488230 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8975d6d_0342_42a3_8ff0_53be1216b5af.slice/crio-e18f7e039a3b77ec3f4fa2e8a8478f61edc630a3b394b226e4b0e082f8740144 WatchSource:0}: Error finding container e18f7e039a3b77ec3f4fa2e8a8478f61edc630a3b394b226e4b0e082f8740144: Status 404 returned error can't find the container with id e18f7e039a3b77ec3f4fa2e8a8478f61edc630a3b394b226e4b0e082f8740144 Jun 10 15:04:05.793371 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:05.793339 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5d48895b7f-xxbb2" event={"ID":"c8975d6d-0342-42a3-8ff0-53be1216b5af","Type":"ContainerStarted","Data":"e18f7e039a3b77ec3f4fa2e8a8478f61edc630a3b394b226e4b0e082f8740144"} Jun 10 15:04:08.382513 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:08.382471 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:08.471843 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:08.471789 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:09.776030 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:09.776001 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:10.817534 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:10.817453 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5d48895b7f-xxbb2" event={"ID":"c8975d6d-0342-42a3-8ff0-53be1216b5af","Type":"ContainerStarted","Data":"2ac4938a12e085f0179c91cadc261a035102e988e8727c7b01e6ef2d3958bd57"} Jun 10 15:04:10.837420 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:10.837360 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5d48895b7f-xxbb2" podStartSLOduration=0.883414078 podStartE2EDuration="5.837346119s" totalImagesPullingTime="4.953932041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:04:10.835700035 +0000 UTC m=+552.422489757" watchObservedRunningTime="2026-06-10 15:04:10.837346119 +0000 UTC m=+552.424135842" Jun 10 15:04:12.183245 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:12.183209 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:12.280589 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:12.280561 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:17.581878 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.581848 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:17.678341 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.678308 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:17.807022 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.806984 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-ccstc"] Jun 10 15:04:17.811375 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.811358 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccstc" Jun 10 15:04:17.814403 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.814357 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-qn5lj\"" Jun 10 15:04:17.814403 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.814357 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 10 15:04:17.814579 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.814494 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 10 15:04:17.832042 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.831986 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-ccstc"] Jun 10 15:04:17.838692 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.838668 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5b2af31b-63c7-4a09-a983-99ef7d8fa54e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-ccstc\" (UID: \"5b2af31b-63c7-4a09-a983-99ef7d8fa54e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccstc" Jun 10 15:04:17.838807 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.838695 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlqfz\" (UniqueName: \"kubernetes.io/projected/5b2af31b-63c7-4a09-a983-99ef7d8fa54e-kube-api-access-rlqfz\") pod \"servicemesh-operator3-57f65f65fb-ccstc\" (UID: \"5b2af31b-63c7-4a09-a983-99ef7d8fa54e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccstc" Jun 10 15:04:17.883651 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.883617 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k"] Jun 10 15:04:17.887090 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.887073 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:17.889606 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:04:17.889575 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" is forbidden: User \"system:node:ip-10-0-130-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-107.ec2.internal' and this object" podUID="20d8512a-2d45-42d4-9edb-1b451b53b1fd" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:17.889606 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:04:17.889592 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"data-science-gateway-data-science-gateway-class-dockercfg-hnjsv\" is forbidden: User \"system:node:ip-10-0-130-107.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-107.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hnjsv\"" type="*v1.Secret" Jun 10 15:04:17.889897 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:04:17.889872 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-gw-ca-root-cert\" is forbidden: User \"system:node:ip-10-0-130-107.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-107.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap" Jun 10 15:04:17.889966 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:04:17.889850 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-107.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-107.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 10 15:04:17.890049 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:04:17.889965 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-107.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-107.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 10 15:04:17.905592 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.905569 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k"] Jun 10 15:04:17.939914 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.939891 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:17.940006 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.939924 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:17.940006 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.939965 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:17.940082 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.940047 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:17.940082 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.940075 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:17.940144 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.940095 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:17.940144 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.940115 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:17.940209 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.940161 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:17.940246 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.940212 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5b2af31b-63c7-4a09-a983-99ef7d8fa54e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-ccstc\" (UID: \"5b2af31b-63c7-4a09-a983-99ef7d8fa54e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccstc" Jun 10 15:04:17.940246 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.940235 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlqfz\" (UniqueName: \"kubernetes.io/projected/5b2af31b-63c7-4a09-a983-99ef7d8fa54e-kube-api-access-rlqfz\") pod \"servicemesh-operator3-57f65f65fb-ccstc\" (UID: \"5b2af31b-63c7-4a09-a983-99ef7d8fa54e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccstc" Jun 10 15:04:17.940311 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.940257 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ck5v\" (UniqueName: \"kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-kube-api-access-4ck5v\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:17.942936 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.942918 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5b2af31b-63c7-4a09-a983-99ef7d8fa54e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-ccstc\" (UID: \"5b2af31b-63c7-4a09-a983-99ef7d8fa54e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccstc" Jun 10 15:04:17.950572 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.950553 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:17.953487 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:17.953469 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlqfz\" (UniqueName: \"kubernetes.io/projected/5b2af31b-63c7-4a09-a983-99ef7d8fa54e-kube-api-access-rlqfz\") pod \"servicemesh-operator3-57f65f65fb-ccstc\" (UID: \"5b2af31b-63c7-4a09-a983-99ef7d8fa54e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccstc" Jun 10 15:04:18.041451 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.041414 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.041602 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.041460 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.041602 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.041481 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.041602 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.041501 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.041602 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.041522 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.041602 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.041558 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ck5v\" (UniqueName: \"kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-kube-api-access-4ck5v\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.041602 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.041591 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.041903 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.041621 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.041903 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.041674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.041903 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.041837 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.041903 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.041890 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.042109 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.041925 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.042109 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.042072 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.043983 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.043954 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.044184 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.044168 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.058871 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.058851 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.074619 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.074592 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj"] Jun 10 15:04:18.078897 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.078878 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.097498 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.097476 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj"] Jun 10 15:04:18.120224 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.120199 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccstc" Jun 10 15:04:18.142900 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.142879 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.143007 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.142945 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.143007 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.142970 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.143007 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.142987 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.143128 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.143008 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7xhd\" (UniqueName: \"kubernetes.io/projected/514e4629-1819-44a2-b43d-bc93c2a62455-kube-api-access-j7xhd\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.143128 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.143025 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/514e4629-1819-44a2-b43d-bc93c2a62455-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.143128 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.143099 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/514e4629-1819-44a2-b43d-bc93c2a62455-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.143219 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.143167 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.143252 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.143221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/514e4629-1819-44a2-b43d-bc93c2a62455-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.240512 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.240482 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:18.243682 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.243658 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.243812 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.243698 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.243812 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.243725 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.243812 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.243758 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7xhd\" (UniqueName: \"kubernetes.io/projected/514e4629-1819-44a2-b43d-bc93c2a62455-kube-api-access-j7xhd\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.243812 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.243784 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/514e4629-1819-44a2-b43d-bc93c2a62455-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.243997 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.243826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/514e4629-1819-44a2-b43d-bc93c2a62455-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.243997 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.243944 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.243997 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.243993 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/514e4629-1819-44a2-b43d-bc93c2a62455-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.244155 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.244040 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.244155 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.244083 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.244155 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.244084 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.244299 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.244153 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.244299 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.244252 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.246254 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.246236 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/514e4629-1819-44a2-b43d-bc93c2a62455-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.246508 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.246493 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/514e4629-1819-44a2-b43d-bc93c2a62455-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.251902 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.251886 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/514e4629-1819-44a2-b43d-bc93c2a62455-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:18.259660 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.259638 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-ccstc"] Jun 10 15:04:18.263027 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:04:18.263007 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b2af31b_63c7_4a09_a983_99ef7d8fa54e.slice/crio-e00295a82cfa9e017815f0d8a4996074d41168665410ef01bd96ba9050138072 WatchSource:0}: Error finding container e00295a82cfa9e017815f0d8a4996074d41168665410ef01bd96ba9050138072: Status 404 returned error can't find the container with id e00295a82cfa9e017815f0d8a4996074d41168665410ef01bd96ba9050138072 Jun 10 15:04:18.498105 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.498076 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:18.799342 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.799276 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 15:04:18.848893 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.848829 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:18.859607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.859575 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccstc" event={"ID":"5b2af31b-63c7-4a09-a983-99ef7d8fa54e","Type":"ContainerStarted","Data":"e00295a82cfa9e017815f0d8a4996074d41168665410ef01bd96ba9050138072"} Jun 10 15:04:18.991290 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.991261 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 15:04:18.992820 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.992799 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:18.994880 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:18.994864 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/514e4629-1819-44a2-b43d-bc93c2a62455-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:19.057526 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:04:19.057452 2560 projected.go:291] Couldn't get configMap openshift-ingress/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 10 15:04:19.057526 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:04:19.057502 2560 projected.go:196] Error preparing data for projected volume kube-api-access-4ck5v for pod openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k: failed to sync configmap cache: timed out waiting for the condition Jun 10 15:04:19.057732 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:04:19.057562 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-kube-api-access-4ck5v podName:20d8512a-2d45-42d4-9edb-1b451b53b1fd nodeName:}" failed. No retries permitted until 2026-06-10 15:04:19.557547836 +0000 UTC m=+561.144337536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4ck5v" (UniqueName: "kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-kube-api-access-4ck5v") pod "data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" (UID: "20d8512a-2d45-42d4-9edb-1b451b53b1fd") : failed to sync configmap cache: timed out waiting for the condition Jun 10 15:04:19.063308 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:19.063100 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 15:04:19.073539 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:19.073483 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7xhd\" (UniqueName: \"kubernetes.io/projected/514e4629-1819-44a2-b43d-bc93c2a62455-kube-api-access-j7xhd\") pod \"data-science-gateway-data-science-gateway-class-74759f97957tmpj\" (UID: \"514e4629-1819-44a2-b43d-bc93c2a62455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:19.231545 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:19.231516 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hnjsv\"" Jun 10 15:04:19.288432 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:19.288380 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:19.458369 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:19.458342 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj"] Jun 10 15:04:19.460881 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:04:19.460849 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod514e4629_1819_44a2_b43d_bc93c2a62455.slice/crio-52e5fbc124b50bf9b80b6e551bf97612be8e637959ec6586d4c0ef9197ff39cc WatchSource:0}: Error finding container 52e5fbc124b50bf9b80b6e551bf97612be8e637959ec6586d4c0ef9197ff39cc: Status 404 returned error can't find the container with id 52e5fbc124b50bf9b80b6e551bf97612be8e637959ec6586d4c0ef9197ff39cc Jun 10 15:04:19.655587 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:19.655557 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ck5v\" (UniqueName: \"kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-kube-api-access-4ck5v\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:19.658495 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:19.658464 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ck5v\" (UniqueName: \"kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-kube-api-access-4ck5v\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:19.697296 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:19.697266 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:19.867616 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:19.867573 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" event={"ID":"514e4629-1819-44a2-b43d-bc93c2a62455","Type":"ContainerStarted","Data":"52e5fbc124b50bf9b80b6e551bf97612be8e637959ec6586d4c0ef9197ff39cc"} Jun 10 15:04:20.644062 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:20.644004 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k"] Jun 10 15:04:20.654405 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:04:20.654349 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d8512a_2d45_42d4_9edb_1b451b53b1fd.slice/crio-5271033a6c914e996d3b53f658d1a01dcb1e3db9cc40f420ac24691bb5a66d23 WatchSource:0}: Error finding container 5271033a6c914e996d3b53f658d1a01dcb1e3db9cc40f420ac24691bb5a66d23: Status 404 returned error can't find the container with id 5271033a6c914e996d3b53f658d1a01dcb1e3db9cc40f420ac24691bb5a66d23 Jun 10 15:04:20.875228 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:20.874840 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccstc" event={"ID":"5b2af31b-63c7-4a09-a983-99ef7d8fa54e","Type":"ContainerStarted","Data":"b5a64372e0cbc06b8d3c85b501860f2f04b42fa1e54164bbbbb1c0530c411c67"} Jun 10 15:04:20.875228 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:20.874984 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccstc" Jun 10 15:04:20.876275 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:20.876252 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" event={"ID":"20d8512a-2d45-42d4-9edb-1b451b53b1fd","Type":"ContainerStarted","Data":"5271033a6c914e996d3b53f658d1a01dcb1e3db9cc40f420ac24691bb5a66d23"} Jun 10 15:04:20.899024 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:20.898973 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccstc" podStartSLOduration=1.59435365 podStartE2EDuration="3.898960055s" totalImagesPullingTime="2.304606405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:04:20.897771888 +0000 UTC m=+562.484561624" watchObservedRunningTime="2026-06-10 15:04:20.898960055 +0000 UTC m=+562.485749777" Jun 10 15:04:22.769000 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:22.768960 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:04:22.769406 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:22.769046 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:04:22.769406 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:22.769075 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:04:22.774655 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:22.774623 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:04:22.774756 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:22.774685 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:04:22.774756 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:22.774719 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:04:22.893424 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:22.893331 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" event={"ID":"20d8512a-2d45-42d4-9edb-1b451b53b1fd","Type":"ContainerStarted","Data":"d220454680ab591d2e29590ef0e14665eefecc26a52be8a04406e192c540b69b"} Jun 10 15:04:22.895360 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:22.895211 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" event={"ID":"514e4629-1819-44a2-b43d-bc93c2a62455","Type":"ContainerStarted","Data":"8640a3d0ba2261964734e607ef74a6a448aff7028daeabc2118fe394b417c7f2"} Jun 10 15:04:22.922171 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:22.922117 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" podStartSLOduration=3.80491714 podStartE2EDuration="5.922097754s" totalImagesPullingTime="2.117180614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:04:22.920166181 +0000 UTC m=+564.506955909" watchObservedRunningTime="2026-06-10 15:04:22.922097754 +0000 UTC m=+564.508887478" Jun 10 15:04:22.945626 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:22.945559 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" podStartSLOduration=1.64039425 podStartE2EDuration="4.94553619s" totalImagesPullingTime="3.30514194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:04:22.944650387 +0000 UTC m=+564.531440108" watchObservedRunningTime="2026-06-10 15:04:22.94553619 +0000 UTC m=+564.532325916" Jun 10 15:04:23.288579 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:23.288542 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:23.293176 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:23.293153 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:23.698247 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:23.698211 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:23.699495 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:23.699474 2560 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jun 10 15:04:23.699548 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:23.699522 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" podUID="20d8512a-2d45-42d4-9edb-1b451b53b1fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jun 10 15:04:23.899882 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:23.899850 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:23.900868 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:23.900849 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97957tmpj" Jun 10 15:04:23.970253 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:23.970180 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k"] Jun 10 15:04:24.698150 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:24.698113 2560 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jun 10 15:04:24.698315 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:24.698166 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" podUID="20d8512a-2d45-42d4-9edb-1b451b53b1fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jun 10 15:04:25.698336 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:25.698297 2560 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jun 10 15:04:25.698813 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:25.698368 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" podUID="20d8512a-2d45-42d4-9edb-1b451b53b1fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jun 10 15:04:25.913742 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:25.913705 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" podUID="20d8512a-2d45-42d4-9edb-1b451b53b1fd" containerName="istio-proxy" containerID="cri-o://d220454680ab591d2e29590ef0e14665eefecc26a52be8a04406e192c540b69b" gracePeriod=30 Jun 10 15:04:31.167922 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.167895 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:31.259268 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259198 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-workload-socket\") pod \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " Jun 10 15:04:31.259268 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259233 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-envoy\") pod \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " Jun 10 15:04:31.259486 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259279 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-workload-certs\") pod \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " Jun 10 15:04:31.259486 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259306 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-token\") pod \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " Jun 10 15:04:31.259486 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259369 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istiod-ca-cert\") pod \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " Jun 10 15:04:31.259486 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259422 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-podinfo\") pod \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " Jun 10 15:04:31.259486 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259458 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ck5v\" (UniqueName: \"kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-kube-api-access-4ck5v\") pod \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " Jun 10 15:04:31.259738 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259497 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-data\") pod \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " Jun 10 15:04:31.259738 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259499 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "20d8512a-2d45-42d4-9edb-1b451b53b1fd" (UID: "20d8512a-2d45-42d4-9edb-1b451b53b1fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:04:31.259738 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259529 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-credential-socket\") pod \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\" (UID: \"20d8512a-2d45-42d4-9edb-1b451b53b1fd\") " Jun 10 15:04:31.259738 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259598 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "20d8512a-2d45-42d4-9edb-1b451b53b1fd" (UID: "20d8512a-2d45-42d4-9edb-1b451b53b1fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:04:31.259927 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259740 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "20d8512a-2d45-42d4-9edb-1b451b53b1fd" (UID: "20d8512a-2d45-42d4-9edb-1b451b53b1fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:04:31.259927 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259840 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-data" (OuterVolumeSpecName: "istio-data") pod "20d8512a-2d45-42d4-9edb-1b451b53b1fd" (UID: "20d8512a-2d45-42d4-9edb-1b451b53b1fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:04:31.259927 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259848 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "20d8512a-2d45-42d4-9edb-1b451b53b1fd" (UID: "20d8512a-2d45-42d4-9edb-1b451b53b1fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:04:31.259927 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259903 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:04:31.259927 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259924 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:04:31.260117 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.259939 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:04:31.261719 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.261695 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "20d8512a-2d45-42d4-9edb-1b451b53b1fd" (UID: "20d8512a-2d45-42d4-9edb-1b451b53b1fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:04:31.261819 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.261755 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "20d8512a-2d45-42d4-9edb-1b451b53b1fd" (UID: "20d8512a-2d45-42d4-9edb-1b451b53b1fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 15:04:31.262203 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.262186 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-token" (OuterVolumeSpecName: "istio-token") pod "20d8512a-2d45-42d4-9edb-1b451b53b1fd" (UID: "20d8512a-2d45-42d4-9edb-1b451b53b1fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:04:31.262203 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.262196 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-kube-api-access-4ck5v" (OuterVolumeSpecName: "kube-api-access-4ck5v") pod "20d8512a-2d45-42d4-9edb-1b451b53b1fd" (UID: "20d8512a-2d45-42d4-9edb-1b451b53b1fd"). InnerVolumeSpecName "kube-api-access-4ck5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:04:31.361043 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.361006 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:04:31.361043 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.361031 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:04:31.361043 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.361048 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:04:31.361263 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.361056 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ck5v\" (UniqueName: \"kubernetes.io/projected/20d8512a-2d45-42d4-9edb-1b451b53b1fd-kube-api-access-4ck5v\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:04:31.361263 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.361066 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:04:31.361263 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.361074 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d8512a-2d45-42d4-9edb-1b451b53b1fd-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:04:31.884470 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.884435 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ccstc" Jun 10 15:04:31.946369 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.946330 2560 generic.go:356] "Generic (PLEG): container finished" podID="20d8512a-2d45-42d4-9edb-1b451b53b1fd" containerID="d220454680ab591d2e29590ef0e14665eefecc26a52be8a04406e192c540b69b" exitCode=0 Jun 10 15:04:31.946369 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.946371 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" Jun 10 15:04:31.946673 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.946421 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" event={"ID":"20d8512a-2d45-42d4-9edb-1b451b53b1fd","Type":"ContainerDied","Data":"d220454680ab591d2e29590ef0e14665eefecc26a52be8a04406e192c540b69b"} Jun 10 15:04:31.946673 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.946475 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k" event={"ID":"20d8512a-2d45-42d4-9edb-1b451b53b1fd","Type":"ContainerDied","Data":"5271033a6c914e996d3b53f658d1a01dcb1e3db9cc40f420ac24691bb5a66d23"} Jun 10 15:04:31.946673 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.946500 2560 scope.go:117] "RemoveContainer" containerID="d220454680ab591d2e29590ef0e14665eefecc26a52be8a04406e192c540b69b" Jun 10 15:04:31.957211 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.956865 2560 scope.go:117] "RemoveContainer" containerID="d220454680ab591d2e29590ef0e14665eefecc26a52be8a04406e192c540b69b" Jun 10 15:04:31.957211 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:04:31.957153 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d220454680ab591d2e29590ef0e14665eefecc26a52be8a04406e192c540b69b\": container with ID starting with d220454680ab591d2e29590ef0e14665eefecc26a52be8a04406e192c540b69b not found: ID does not exist" containerID="d220454680ab591d2e29590ef0e14665eefecc26a52be8a04406e192c540b69b" Jun 10 15:04:31.957211 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.957177 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d220454680ab591d2e29590ef0e14665eefecc26a52be8a04406e192c540b69b"} err="failed to get container status \"d220454680ab591d2e29590ef0e14665eefecc26a52be8a04406e192c540b69b\": rpc error: code = NotFound desc = could not find container \"d220454680ab591d2e29590ef0e14665eefecc26a52be8a04406e192c540b69b\": container with ID starting with d220454680ab591d2e29590ef0e14665eefecc26a52be8a04406e192c540b69b not found: ID does not exist" Jun 10 15:04:31.977147 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.977120 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k"] Jun 10 15:04:31.987938 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:31.987907 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fvst5k"] Jun 10 15:04:32.851868 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:32.851825 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20d8512a-2d45-42d4-9edb-1b451b53b1fd" path="/var/lib/kubelet/pods/20d8512a-2d45-42d4-9edb-1b451b53b1fd/volumes" Jun 10 15:04:35.379735 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.379707 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:35.484214 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.484188 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:35.493988 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.493959 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h6d9j"] Jun 10 15:04:35.494312 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.494296 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d8512a-2d45-42d4-9edb-1b451b53b1fd" containerName="istio-proxy" Jun 10 15:04:35.494435 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.494315 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d8512a-2d45-42d4-9edb-1b451b53b1fd" containerName="istio-proxy" Jun 10 15:04:35.494504 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.494457 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="20d8512a-2d45-42d4-9edb-1b451b53b1fd" containerName="istio-proxy" Jun 10 15:04:35.498835 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.498815 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h6d9j" Jun 10 15:04:35.504346 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.504325 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 15:04:35.504981 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.504963 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-txvgb\"" Jun 10 15:04:35.505051 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.504964 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 15:04:35.519853 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.519834 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h6d9j"] Jun 10 15:04:35.598815 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.598783 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qllj8\" (UniqueName: \"kubernetes.io/projected/df6e6d74-b7e2-456d-9995-9d3b2da4a195-kube-api-access-qllj8\") pod \"kuadrant-operator-catalog-h6d9j\" (UID: \"df6e6d74-b7e2-456d-9995-9d3b2da4a195\") " pod="kuadrant-system/kuadrant-operator-catalog-h6d9j" Jun 10 15:04:35.646856 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.646790 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:35.699592 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.699564 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qllj8\" (UniqueName: \"kubernetes.io/projected/df6e6d74-b7e2-456d-9995-9d3b2da4a195-kube-api-access-qllj8\") pod \"kuadrant-operator-catalog-h6d9j\" (UID: \"df6e6d74-b7e2-456d-9995-9d3b2da4a195\") " pod="kuadrant-system/kuadrant-operator-catalog-h6d9j" Jun 10 15:04:35.725523 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.725500 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qllj8\" (UniqueName: \"kubernetes.io/projected/df6e6d74-b7e2-456d-9995-9d3b2da4a195-kube-api-access-qllj8\") pod \"kuadrant-operator-catalog-h6d9j\" (UID: \"df6e6d74-b7e2-456d-9995-9d3b2da4a195\") " pod="kuadrant-system/kuadrant-operator-catalog-h6d9j" Jun 10 15:04:35.807787 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.807764 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h6d9j" Jun 10 15:04:35.841401 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.841354 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h6d9j"] Jun 10 15:04:35.938786 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.938761 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h6d9j"] Jun 10 15:04:35.941183 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:04:35.941156 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6e6d74_b7e2_456d_9995_9d3b2da4a195.slice/crio-502ff8782fb4176dd6b4be50d13f754aea0f6c692fc949749c7dcb008d5e2060 WatchSource:0}: Error finding container 502ff8782fb4176dd6b4be50d13f754aea0f6c692fc949749c7dcb008d5e2060: Status 404 returned error can't find the container with id 502ff8782fb4176dd6b4be50d13f754aea0f6c692fc949749c7dcb008d5e2060 Jun 10 15:04:35.963464 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:35.963440 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h6d9j" event={"ID":"df6e6d74-b7e2-456d-9995-9d3b2da4a195","Type":"ContainerStarted","Data":"502ff8782fb4176dd6b4be50d13f754aea0f6c692fc949749c7dcb008d5e2060"} Jun 10 15:04:36.070384 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:36.070356 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vwgqd"] Jun 10 15:04:36.074583 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:36.074568 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vwgqd" Jun 10 15:04:36.102566 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:36.102540 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vwgqd"] Jun 10 15:04:36.204059 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:36.203990 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64v6d\" (UniqueName: \"kubernetes.io/projected/d912a236-ccb1-4dc1-b62b-0c5c9b69c365-kube-api-access-64v6d\") pod \"kuadrant-operator-catalog-vwgqd\" (UID: \"d912a236-ccb1-4dc1-b62b-0c5c9b69c365\") " pod="kuadrant-system/kuadrant-operator-catalog-vwgqd" Jun 10 15:04:36.305202 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:36.305172 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64v6d\" (UniqueName: \"kubernetes.io/projected/d912a236-ccb1-4dc1-b62b-0c5c9b69c365-kube-api-access-64v6d\") pod \"kuadrant-operator-catalog-vwgqd\" (UID: \"d912a236-ccb1-4dc1-b62b-0c5c9b69c365\") " pod="kuadrant-system/kuadrant-operator-catalog-vwgqd" Jun 10 15:04:36.325793 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:36.325765 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64v6d\" (UniqueName: \"kubernetes.io/projected/d912a236-ccb1-4dc1-b62b-0c5c9b69c365-kube-api-access-64v6d\") pod \"kuadrant-operator-catalog-vwgqd\" (UID: \"d912a236-ccb1-4dc1-b62b-0c5c9b69c365\") " pod="kuadrant-system/kuadrant-operator-catalog-vwgqd" Jun 10 15:04:36.383816 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:36.383787 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vwgqd" Jun 10 15:04:36.521090 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:36.520957 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vwgqd"] Jun 10 15:04:36.523583 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:04:36.523519 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd912a236_ccb1_4dc1_b62b_0c5c9b69c365.slice/crio-d5954f45d2e8345c61c478baba862b1a32d1bdadf2439834a615817c2c71a789 WatchSource:0}: Error finding container d5954f45d2e8345c61c478baba862b1a32d1bdadf2439834a615817c2c71a789: Status 404 returned error can't find the container with id d5954f45d2e8345c61c478baba862b1a32d1bdadf2439834a615817c2c71a789 Jun 10 15:04:36.969507 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:36.969476 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vwgqd" event={"ID":"d912a236-ccb1-4dc1-b62b-0c5c9b69c365","Type":"ContainerStarted","Data":"d5954f45d2e8345c61c478baba862b1a32d1bdadf2439834a615817c2c71a789"} Jun 10 15:04:38.979111 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:38.979070 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h6d9j" event={"ID":"df6e6d74-b7e2-456d-9995-9d3b2da4a195","Type":"ContainerStarted","Data":"eec72e871f29264a80183d782df3e6c3168abfcf56740e2f3072506cbd903cd8"} Jun 10 15:04:38.979605 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:38.979143 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-h6d9j" podUID="df6e6d74-b7e2-456d-9995-9d3b2da4a195" containerName="registry-server" containerID="cri-o://eec72e871f29264a80183d782df3e6c3168abfcf56740e2f3072506cbd903cd8" gracePeriod=2 Jun 10 15:04:38.980517 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:38.980492 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vwgqd" event={"ID":"d912a236-ccb1-4dc1-b62b-0c5c9b69c365","Type":"ContainerStarted","Data":"2b963fa4077ddca3b96d865e69bf267eb53b871a66066d4120d2bb8d6495e24b"} Jun 10 15:04:38.996728 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:38.996692 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-h6d9j" podStartSLOduration=1.690440057 podStartE2EDuration="3.99667912s" totalImagesPullingTime="2.306239063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:04:38.995254976 +0000 UTC m=+580.582044711" watchObservedRunningTime="2026-06-10 15:04:38.99667912 +0000 UTC m=+580.583468843" Jun 10 15:04:39.011940 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:39.011893 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vwgqd" podStartSLOduration=1.285030093 podStartE2EDuration="3.01187853s" totalImagesPullingTime="1.726848437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:04:39.011273613 +0000 UTC m=+580.598063335" watchObservedRunningTime="2026-06-10 15:04:39.01187853 +0000 UTC m=+580.598668252" Jun 10 15:04:39.216490 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:39.216459 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h6d9j" Jun 10 15:04:39.330307 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:39.330225 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qllj8\" (UniqueName: \"kubernetes.io/projected/df6e6d74-b7e2-456d-9995-9d3b2da4a195-kube-api-access-qllj8\") pod \"df6e6d74-b7e2-456d-9995-9d3b2da4a195\" (UID: \"df6e6d74-b7e2-456d-9995-9d3b2da4a195\") " Jun 10 15:04:39.332521 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:39.332498 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df6e6d74-b7e2-456d-9995-9d3b2da4a195-kube-api-access-qllj8" (OuterVolumeSpecName: "kube-api-access-qllj8") pod "df6e6d74-b7e2-456d-9995-9d3b2da4a195" (UID: "df6e6d74-b7e2-456d-9995-9d3b2da4a195"). InnerVolumeSpecName "kube-api-access-qllj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:04:39.431053 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:39.431020 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qllj8\" (UniqueName: \"kubernetes.io/projected/df6e6d74-b7e2-456d-9995-9d3b2da4a195-kube-api-access-qllj8\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:04:39.985847 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:39.985817 2560 generic.go:356] "Generic (PLEG): container finished" podID="df6e6d74-b7e2-456d-9995-9d3b2da4a195" containerID="eec72e871f29264a80183d782df3e6c3168abfcf56740e2f3072506cbd903cd8" exitCode=0 Jun 10 15:04:39.986281 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:39.985882 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h6d9j" Jun 10 15:04:39.986281 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:39.985902 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h6d9j" event={"ID":"df6e6d74-b7e2-456d-9995-9d3b2da4a195","Type":"ContainerDied","Data":"eec72e871f29264a80183d782df3e6c3168abfcf56740e2f3072506cbd903cd8"} Jun 10 15:04:39.986281 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:39.985962 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h6d9j" event={"ID":"df6e6d74-b7e2-456d-9995-9d3b2da4a195","Type":"ContainerDied","Data":"502ff8782fb4176dd6b4be50d13f754aea0f6c692fc949749c7dcb008d5e2060"} Jun 10 15:04:39.986281 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:39.985983 2560 scope.go:117] "RemoveContainer" containerID="eec72e871f29264a80183d782df3e6c3168abfcf56740e2f3072506cbd903cd8" Jun 10 15:04:39.995688 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:39.995673 2560 scope.go:117] "RemoveContainer" containerID="eec72e871f29264a80183d782df3e6c3168abfcf56740e2f3072506cbd903cd8" Jun 10 15:04:39.995950 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:04:39.995934 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eec72e871f29264a80183d782df3e6c3168abfcf56740e2f3072506cbd903cd8\": container with ID starting with eec72e871f29264a80183d782df3e6c3168abfcf56740e2f3072506cbd903cd8 not found: ID does not exist" containerID="eec72e871f29264a80183d782df3e6c3168abfcf56740e2f3072506cbd903cd8" Jun 10 15:04:39.996017 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:39.995957 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec72e871f29264a80183d782df3e6c3168abfcf56740e2f3072506cbd903cd8"} err="failed to get container status \"eec72e871f29264a80183d782df3e6c3168abfcf56740e2f3072506cbd903cd8\": rpc error: code = NotFound desc = could not find container \"eec72e871f29264a80183d782df3e6c3168abfcf56740e2f3072506cbd903cd8\": container with ID starting with eec72e871f29264a80183d782df3e6c3168abfcf56740e2f3072506cbd903cd8 not found: ID does not exist" Jun 10 15:04:40.006525 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:40.006501 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h6d9j"] Jun 10 15:04:40.010864 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:40.010843 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h6d9j"] Jun 10 15:04:40.851777 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:40.851744 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df6e6d74-b7e2-456d-9995-9d3b2da4a195" path="/var/lib/kubelet/pods/df6e6d74-b7e2-456d-9995-9d3b2da4a195/volumes" Jun 10 15:04:46.384750 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:46.384719 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vwgqd" Jun 10 15:04:46.385218 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:46.384789 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vwgqd" Jun 10 15:04:46.406773 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:46.406745 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vwgqd" Jun 10 15:04:47.038549 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:47.038523 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vwgqd" Jun 10 15:04:50.032902 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:50.032867 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:04:58.818367 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:58.818334 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:04:58.818894 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:58.818823 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:04:58.827682 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:58.827660 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:04:58.828104 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:04:58.828085 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:05:04.674843 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:04.674809 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:07.359103 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:07.359020 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqxtf"] Jun 10 15:05:07.359478 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:07.359352 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df6e6d74-b7e2-456d-9995-9d3b2da4a195" containerName="registry-server" Jun 10 15:05:07.359478 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:07.359363 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="df6e6d74-b7e2-456d-9995-9d3b2da4a195" containerName="registry-server" Jun 10 15:05:07.359478 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:07.359454 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="df6e6d74-b7e2-456d-9995-9d3b2da4a195" containerName="registry-server" Jun 10 15:05:07.361298 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:07.361279 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqxtf" Jun 10 15:05:07.364041 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:07.364018 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 15:05:07.364142 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:07.364051 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5rdzd\"" Jun 10 15:05:07.378461 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:07.378433 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqxtf"] Jun 10 15:05:07.467813 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:07.467777 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbxgz\" (UniqueName: \"kubernetes.io/projected/2baefecb-09ab-45b6-8c5f-194c6c8aae2b-kube-api-access-qbxgz\") pod \"dns-operator-controller-manager-864dd78c4c-qqxtf\" (UID: \"2baefecb-09ab-45b6-8c5f-194c6c8aae2b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqxtf" Jun 10 15:05:07.568990 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:07.568942 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbxgz\" (UniqueName: \"kubernetes.io/projected/2baefecb-09ab-45b6-8c5f-194c6c8aae2b-kube-api-access-qbxgz\") pod \"dns-operator-controller-manager-864dd78c4c-qqxtf\" (UID: \"2baefecb-09ab-45b6-8c5f-194c6c8aae2b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqxtf" Jun 10 15:05:07.587933 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:07.587906 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbxgz\" (UniqueName: \"kubernetes.io/projected/2baefecb-09ab-45b6-8c5f-194c6c8aae2b-kube-api-access-qbxgz\") pod \"dns-operator-controller-manager-864dd78c4c-qqxtf\" (UID: \"2baefecb-09ab-45b6-8c5f-194c6c8aae2b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqxtf" Jun 10 15:05:07.671994 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:07.671957 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqxtf" Jun 10 15:05:07.829542 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:07.829513 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqxtf"] Jun 10 15:05:07.832146 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:05:07.832121 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2baefecb_09ab_45b6_8c5f_194c6c8aae2b.slice/crio-6570061d4d59e9515982f7b6d1b66aef7717d93265de06e62014cf902f26370d WatchSource:0}: Error finding container 6570061d4d59e9515982f7b6d1b66aef7717d93265de06e62014cf902f26370d: Status 404 returned error can't find the container with id 6570061d4d59e9515982f7b6d1b66aef7717d93265de06e62014cf902f26370d Jun 10 15:05:08.115927 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:08.115839 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqxtf" event={"ID":"2baefecb-09ab-45b6-8c5f-194c6c8aae2b","Type":"ContainerStarted","Data":"6570061d4d59e9515982f7b6d1b66aef7717d93265de06e62014cf902f26370d"} Jun 10 15:05:08.235444 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:08.235383 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:11.133700 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:11.133657 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqxtf" event={"ID":"2baefecb-09ab-45b6-8c5f-194c6c8aae2b","Type":"ContainerStarted","Data":"1d6ce3165c0ff39b1bb7058068821897d52edee04cb17b1ee5fd5e9eaf3613fb"} Jun 10 15:05:11.134105 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:11.133731 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqxtf" Jun 10 15:05:11.182759 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:11.178730 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqxtf" podStartSLOduration=1.386065379 podStartE2EDuration="4.178707491s" totalImagesPullingTime="2.792642112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:05:11.174087413 +0000 UTC m=+612.760877136" watchObservedRunningTime="2026-06-10 15:05:11.178707491 +0000 UTC m=+612.765497215" Jun 10 15:05:11.365300 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:11.365261 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:11.559160 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:11.559085 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:12.893149 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:12.893110 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:13.008138 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.008101 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt"] Jun 10 15:05:13.010282 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.010265 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:13.021376 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.021354 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cvctl\"" Jun 10 15:05:13.039699 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.039679 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt"] Jun 10 15:05:13.113874 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.113847 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d398fa7-e0fb-4fbf-9533-3366eec4676b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zxspt\" (UID: \"8d398fa7-e0fb-4fbf-9533-3366eec4676b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:13.113998 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.113890 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fd8c\" (UniqueName: \"kubernetes.io/projected/8d398fa7-e0fb-4fbf-9533-3366eec4676b-kube-api-access-9fd8c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zxspt\" (UID: \"8d398fa7-e0fb-4fbf-9533-3366eec4676b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:13.214657 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.214581 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d398fa7-e0fb-4fbf-9533-3366eec4676b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zxspt\" (UID: \"8d398fa7-e0fb-4fbf-9533-3366eec4676b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:13.214657 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.214623 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fd8c\" (UniqueName: \"kubernetes.io/projected/8d398fa7-e0fb-4fbf-9533-3366eec4676b-kube-api-access-9fd8c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zxspt\" (UID: \"8d398fa7-e0fb-4fbf-9533-3366eec4676b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:13.214943 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.214918 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d398fa7-e0fb-4fbf-9533-3366eec4676b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zxspt\" (UID: \"8d398fa7-e0fb-4fbf-9533-3366eec4676b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:13.234269 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.234243 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fd8c\" (UniqueName: \"kubernetes.io/projected/8d398fa7-e0fb-4fbf-9533-3366eec4676b-kube-api-access-9fd8c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zxspt\" (UID: \"8d398fa7-e0fb-4fbf-9533-3366eec4676b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:13.296570 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.296542 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:13.319759 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.319732 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:13.459648 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.459614 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt"] Jun 10 15:05:13.462632 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:05:13.462606 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d398fa7_e0fb_4fbf_9533_3366eec4676b.slice/crio-96076c7dd876b65887be9395c4fb21a84f36f23bd944d48255e88d2aea48cc61 WatchSource:0}: Error finding container 96076c7dd876b65887be9395c4fb21a84f36f23bd944d48255e88d2aea48cc61: Status 404 returned error can't find the container with id 96076c7dd876b65887be9395c4fb21a84f36f23bd944d48255e88d2aea48cc61 Jun 10 15:05:13.835506 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:13.835425 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:14.148268 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:14.148234 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" event={"ID":"8d398fa7-e0fb-4fbf-9533-3366eec4676b","Type":"ContainerStarted","Data":"96076c7dd876b65887be9395c4fb21a84f36f23bd944d48255e88d2aea48cc61"} Jun 10 15:05:15.972403 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:15.972369 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:17.345440 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:17.345381 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:18.535570 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:18.535533 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:18.944959 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:18.944929 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw"] Jun 10 15:05:18.947619 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:18.947600 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" Jun 10 15:05:18.951443 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:18.951408 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-94mst\"" Jun 10 15:05:18.973084 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:18.973054 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw"] Jun 10 15:05:19.066690 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:19.066657 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9b4g\" (UniqueName: \"kubernetes.io/projected/8137b72a-98bf-4930-8123-f99592c23571-kube-api-access-f9b4g\") pod \"limitador-operator-controller-manager-859d7b78bd-dffhw\" (UID: \"8137b72a-98bf-4930-8123-f99592c23571\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" Jun 10 15:05:19.168114 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:19.168069 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9b4g\" (UniqueName: \"kubernetes.io/projected/8137b72a-98bf-4930-8123-f99592c23571-kube-api-access-f9b4g\") pod \"limitador-operator-controller-manager-859d7b78bd-dffhw\" (UID: \"8137b72a-98bf-4930-8123-f99592c23571\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" Jun 10 15:05:19.185654 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:19.185625 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9b4g\" (UniqueName: \"kubernetes.io/projected/8137b72a-98bf-4930-8123-f99592c23571-kube-api-access-f9b4g\") pod \"limitador-operator-controller-manager-859d7b78bd-dffhw\" (UID: \"8137b72a-98bf-4930-8123-f99592c23571\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" Jun 10 15:05:19.260573 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:19.260467 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" Jun 10 15:05:20.440331 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:20.440121 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw"] Jun 10 15:05:20.444745 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:05:20.444714 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8137b72a_98bf_4930_8123_f99592c23571.slice/crio-2a0f6e4e046a772088504732cfa56053176f38a95f38fd37e6ecec538539c181 WatchSource:0}: Error finding container 2a0f6e4e046a772088504732cfa56053176f38a95f38fd37e6ecec538539c181: Status 404 returned error can't find the container with id 2a0f6e4e046a772088504732cfa56053176f38a95f38fd37e6ecec538539c181 Jun 10 15:05:20.518051 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:20.518014 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:20.624352 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:20.624272 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:21.188075 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:21.188043 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" event={"ID":"8137b72a-98bf-4930-8123-f99592c23571","Type":"ContainerStarted","Data":"2a0f6e4e046a772088504732cfa56053176f38a95f38fd37e6ecec538539c181"} Jun 10 15:05:21.190028 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:21.190002 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" event={"ID":"8d398fa7-e0fb-4fbf-9533-3366eec4676b","Type":"ContainerStarted","Data":"10009aa86c1861b8c40434cb38f518d0f312ab667832bd8b15244b56d4350e91"} Jun 10 15:05:21.190162 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:21.190142 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:21.222937 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:21.222879 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" podStartSLOduration=2.371154906 podStartE2EDuration="9.222859509s" totalImagesPullingTime="6.851704603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:05:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:05:21.220482136 +0000 UTC m=+622.807271883" watchObservedRunningTime="2026-06-10 15:05:21.222859509 +0000 UTC m=+622.809649241" Jun 10 15:05:22.141107 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:22.141077 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qqxtf" Jun 10 15:05:23.201124 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:23.201085 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" event={"ID":"8137b72a-98bf-4930-8123-f99592c23571","Type":"ContainerStarted","Data":"d7c6e4676d1912f20152cfcf8d40732b4898b236c2920d0ad943cd075987143f"} Jun 10 15:05:23.201731 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:23.201176 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" Jun 10 15:05:23.232005 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:23.231954 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" podStartSLOduration=2.984712343 podStartE2EDuration="5.23193951s" totalImagesPullingTime="2.247227167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:05:23.229636117 +0000 UTC m=+624.816425839" watchObservedRunningTime="2026-06-10 15:05:23.23193951 +0000 UTC m=+624.818729232" Jun 10 15:05:23.633055 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:23.633028 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:23.754144 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:23.754112 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:24.262219 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:24.262184 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:24.427675 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:24.427642 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:32.196861 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:32.196833 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:33.563301 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:33.563268 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:33.692288 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:33.692260 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:34.207940 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.207913 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" Jun 10 15:05:34.649603 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.649569 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt"] Jun 10 15:05:34.650003 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.649812 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" podUID="8d398fa7-e0fb-4fbf-9533-3366eec4676b" containerName="manager" containerID="cri-o://10009aa86c1861b8c40434cb38f518d0f312ab667832bd8b15244b56d4350e91" gracePeriod=2 Jun 10 15:05:34.667508 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.667435 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt"] Jun 10 15:05:34.673574 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:05:34.673529 2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8d398fa7-e0fb-4fbf-9533-3366eec4676b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-zxspt\": pods \"kuadrant-operator-controller-manager-8684c9ff49-zxspt\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:34.706680 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.706650 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw"] Jun 10 15:05:34.706982 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.706951 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6"] Jun 10 15:05:34.707565 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.707546 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d398fa7-e0fb-4fbf-9533-3366eec4676b" containerName="manager" Jun 10 15:05:34.707680 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.707670 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d398fa7-e0fb-4fbf-9533-3366eec4676b" containerName="manager" Jun 10 15:05:34.707857 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.707845 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d398fa7-e0fb-4fbf-9533-3366eec4676b" containerName="manager" Jun 10 15:05:34.709153 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.709101 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" podUID="8137b72a-98bf-4930-8123-f99592c23571" containerName="manager" containerID="cri-o://d7c6e4676d1912f20152cfcf8d40732b4898b236c2920d0ad943cd075987143f" gracePeriod=2 Jun 10 15:05:34.711081 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.711062 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw"] Jun 10 15:05:34.712223 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.711256 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" Jun 10 15:05:34.713807 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:05:34.713680 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zxspt\" is forbidden: User \"system:node:ip-10-0-130-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-107.ec2.internal' and this object" podUID="8d398fa7-e0fb-4fbf-9533-3366eec4676b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:34.724078 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.719902 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6"] Jun 10 15:05:34.724078 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:05:34.720066 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dffhw\" is forbidden: User \"system:node:ip-10-0-130-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-107.ec2.internal' and this object" podUID="8137b72a-98bf-4930-8123-f99592c23571" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" Jun 10 15:05:34.724549 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:05:34.724439 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dffhw\" is forbidden: User \"system:node:ip-10-0-130-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-107.ec2.internal' and this object" podUID="8137b72a-98bf-4930-8123-f99592c23571" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" Jun 10 15:05:34.729055 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:05:34.728958 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zxspt\" is forbidden: User \"system:node:ip-10-0-130-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-107.ec2.internal' and this object" podUID="8d398fa7-e0fb-4fbf-9533-3366eec4676b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:34.741192 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.741032 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g7dkr"] Jun 10 15:05:34.741614 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.741591 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8137b72a-98bf-4930-8123-f99592c23571" containerName="manager" Jun 10 15:05:34.742334 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.742311 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8137b72a-98bf-4930-8123-f99592c23571" containerName="manager" Jun 10 15:05:34.742464 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.742447 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8137b72a-98bf-4930-8123-f99592c23571" containerName="manager" Jun 10 15:05:34.744751 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.744731 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g7dkr" Jun 10 15:05:34.768441 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.768407 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g7dkr"] Jun 10 15:05:34.775704 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:05:34.775669 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dffhw\" is forbidden: User \"system:node:ip-10-0-130-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-107.ec2.internal' and this object" podUID="8137b72a-98bf-4930-8123-f99592c23571" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" Jun 10 15:05:34.778634 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:05:34.778602 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zxspt\" is forbidden: User \"system:node:ip-10-0-130-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-107.ec2.internal' and this object" podUID="8d398fa7-e0fb-4fbf-9533-3366eec4676b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:34.800663 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.800642 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlnl7\" (UniqueName: \"kubernetes.io/projected/c3ccb65f-ec16-4e13-97d8-a37934fb16c3-kube-api-access-vlnl7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r8sg6\" (UID: \"c3ccb65f-ec16-4e13-97d8-a37934fb16c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" Jun 10 15:05:34.800760 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.800678 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3ccb65f-ec16-4e13-97d8-a37934fb16c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r8sg6\" (UID: \"c3ccb65f-ec16-4e13-97d8-a37934fb16c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" Jun 10 15:05:34.902070 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.901985 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlnl7\" (UniqueName: \"kubernetes.io/projected/c3ccb65f-ec16-4e13-97d8-a37934fb16c3-kube-api-access-vlnl7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r8sg6\" (UID: \"c3ccb65f-ec16-4e13-97d8-a37934fb16c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" Jun 10 15:05:34.902070 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.902043 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3ccb65f-ec16-4e13-97d8-a37934fb16c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r8sg6\" (UID: \"c3ccb65f-ec16-4e13-97d8-a37934fb16c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" Jun 10 15:05:34.902274 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.902136 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96tcq\" (UniqueName: \"kubernetes.io/projected/8e984def-3ace-4053-af4b-0fac97f92a9a-kube-api-access-96tcq\") pod \"limitador-operator-controller-manager-859d7b78bd-g7dkr\" (UID: \"8e984def-3ace-4053-af4b-0fac97f92a9a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g7dkr" Jun 10 15:05:34.902662 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.902641 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3ccb65f-ec16-4e13-97d8-a37934fb16c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r8sg6\" (UID: \"c3ccb65f-ec16-4e13-97d8-a37934fb16c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" Jun 10 15:05:34.920277 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.920249 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlnl7\" (UniqueName: \"kubernetes.io/projected/c3ccb65f-ec16-4e13-97d8-a37934fb16c3-kube-api-access-vlnl7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r8sg6\" (UID: \"c3ccb65f-ec16-4e13-97d8-a37934fb16c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" Jun 10 15:05:34.949617 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.949598 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:34.952640 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:34.952619 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" Jun 10 15:05:35.002923 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.002891 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96tcq\" (UniqueName: \"kubernetes.io/projected/8e984def-3ace-4053-af4b-0fac97f92a9a-kube-api-access-96tcq\") pod \"limitador-operator-controller-manager-859d7b78bd-g7dkr\" (UID: \"8e984def-3ace-4053-af4b-0fac97f92a9a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g7dkr" Jun 10 15:05:35.018067 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.018043 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96tcq\" (UniqueName: \"kubernetes.io/projected/8e984def-3ace-4053-af4b-0fac97f92a9a-kube-api-access-96tcq\") pod \"limitador-operator-controller-manager-859d7b78bd-g7dkr\" (UID: \"8e984def-3ace-4053-af4b-0fac97f92a9a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g7dkr" Jun 10 15:05:35.088000 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.087972 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" Jun 10 15:05:35.094880 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.094850 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g7dkr" Jun 10 15:05:35.103618 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.103595 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9b4g\" (UniqueName: \"kubernetes.io/projected/8137b72a-98bf-4930-8123-f99592c23571-kube-api-access-f9b4g\") pod \"8137b72a-98bf-4930-8123-f99592c23571\" (UID: \"8137b72a-98bf-4930-8123-f99592c23571\") " Jun 10 15:05:35.103719 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.103656 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d398fa7-e0fb-4fbf-9533-3366eec4676b-extensions-socket-volume\") pod \"8d398fa7-e0fb-4fbf-9533-3366eec4676b\" (UID: \"8d398fa7-e0fb-4fbf-9533-3366eec4676b\") " Jun 10 15:05:35.103777 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.103717 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fd8c\" (UniqueName: \"kubernetes.io/projected/8d398fa7-e0fb-4fbf-9533-3366eec4676b-kube-api-access-9fd8c\") pod \"8d398fa7-e0fb-4fbf-9533-3366eec4676b\" (UID: \"8d398fa7-e0fb-4fbf-9533-3366eec4676b\") " Jun 10 15:05:35.104094 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.104063 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d398fa7-e0fb-4fbf-9533-3366eec4676b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8d398fa7-e0fb-4fbf-9533-3366eec4676b" (UID: "8d398fa7-e0fb-4fbf-9533-3366eec4676b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:05:35.106007 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.105977 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d398fa7-e0fb-4fbf-9533-3366eec4676b-kube-api-access-9fd8c" (OuterVolumeSpecName: "kube-api-access-9fd8c") pod "8d398fa7-e0fb-4fbf-9533-3366eec4676b" (UID: "8d398fa7-e0fb-4fbf-9533-3366eec4676b"). InnerVolumeSpecName "kube-api-access-9fd8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:05:35.106086 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.106033 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8137b72a-98bf-4930-8123-f99592c23571-kube-api-access-f9b4g" (OuterVolumeSpecName: "kube-api-access-f9b4g") pod "8137b72a-98bf-4930-8123-f99592c23571" (UID: "8137b72a-98bf-4930-8123-f99592c23571"). InnerVolumeSpecName "kube-api-access-f9b4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:05:35.205145 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.205075 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9b4g\" (UniqueName: \"kubernetes.io/projected/8137b72a-98bf-4930-8123-f99592c23571-kube-api-access-f9b4g\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:05:35.205145 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.205106 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d398fa7-e0fb-4fbf-9533-3366eec4676b-extensions-socket-volume\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:05:35.205145 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.205116 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fd8c\" (UniqueName: \"kubernetes.io/projected/8d398fa7-e0fb-4fbf-9533-3366eec4676b-kube-api-access-9fd8c\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:05:35.250252 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.250225 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6"] Jun 10 15:05:35.253329 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:05:35.253300 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ccb65f_ec16_4e13_97d8_a37934fb16c3.slice/crio-478429249ba69997a04e7ed99ca0ff78cea48393a22de1aad7422f8a4dcc6d59 WatchSource:0}: Error finding container 478429249ba69997a04e7ed99ca0ff78cea48393a22de1aad7422f8a4dcc6d59: Status 404 returned error can't find the container with id 478429249ba69997a04e7ed99ca0ff78cea48393a22de1aad7422f8a4dcc6d59 Jun 10 15:05:35.254444 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.254424 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g7dkr"] Jun 10 15:05:35.256985 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:05:35.256930 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e984def_3ace_4053_af4b_0fac97f92a9a.slice/crio-5dc88149e77096e30ede684ac87f3fee14bc478a46ba9cfeb27579b7fcd863b9 WatchSource:0}: Error finding container 5dc88149e77096e30ede684ac87f3fee14bc478a46ba9cfeb27579b7fcd863b9: Status 404 returned error can't find the container with id 5dc88149e77096e30ede684ac87f3fee14bc478a46ba9cfeb27579b7fcd863b9 Jun 10 15:05:35.258062 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.258036 2560 generic.go:356] "Generic (PLEG): container finished" podID="8d398fa7-e0fb-4fbf-9533-3366eec4676b" containerID="10009aa86c1861b8c40434cb38f518d0f312ab667832bd8b15244b56d4350e91" exitCode=0 Jun 10 15:05:35.258111 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.258086 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zxspt" Jun 10 15:05:35.258157 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.258137 2560 scope.go:117] "RemoveContainer" containerID="10009aa86c1861b8c40434cb38f518d0f312ab667832bd8b15244b56d4350e91" Jun 10 15:05:35.259513 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.259492 2560 generic.go:356] "Generic (PLEG): container finished" podID="8137b72a-98bf-4930-8123-f99592c23571" containerID="d7c6e4676d1912f20152cfcf8d40732b4898b236c2920d0ad943cd075987143f" exitCode=0 Jun 10 15:05:35.259603 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.259544 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dffhw" Jun 10 15:05:35.268325 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.268309 2560 scope.go:117] "RemoveContainer" containerID="10009aa86c1861b8c40434cb38f518d0f312ab667832bd8b15244b56d4350e91" Jun 10 15:05:35.268624 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:05:35.268601 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10009aa86c1861b8c40434cb38f518d0f312ab667832bd8b15244b56d4350e91\": container with ID starting with 10009aa86c1861b8c40434cb38f518d0f312ab667832bd8b15244b56d4350e91 not found: ID does not exist" containerID="10009aa86c1861b8c40434cb38f518d0f312ab667832bd8b15244b56d4350e91" Jun 10 15:05:35.268679 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.268632 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10009aa86c1861b8c40434cb38f518d0f312ab667832bd8b15244b56d4350e91"} err="failed to get container status \"10009aa86c1861b8c40434cb38f518d0f312ab667832bd8b15244b56d4350e91\": rpc error: code = NotFound desc = could not find container \"10009aa86c1861b8c40434cb38f518d0f312ab667832bd8b15244b56d4350e91\": container with ID starting with 10009aa86c1861b8c40434cb38f518d0f312ab667832bd8b15244b56d4350e91 not found: ID does not exist" Jun 10 15:05:35.268679 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.268649 2560 scope.go:117] "RemoveContainer" containerID="d7c6e4676d1912f20152cfcf8d40732b4898b236c2920d0ad943cd075987143f" Jun 10 15:05:35.277965 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.277949 2560 scope.go:117] "RemoveContainer" containerID="d7c6e4676d1912f20152cfcf8d40732b4898b236c2920d0ad943cd075987143f" Jun 10 15:05:35.278271 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:05:35.278253 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c6e4676d1912f20152cfcf8d40732b4898b236c2920d0ad943cd075987143f\": container with ID starting with d7c6e4676d1912f20152cfcf8d40732b4898b236c2920d0ad943cd075987143f not found: ID does not exist" containerID="d7c6e4676d1912f20152cfcf8d40732b4898b236c2920d0ad943cd075987143f" Jun 10 15:05:35.278319 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:35.278278 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c6e4676d1912f20152cfcf8d40732b4898b236c2920d0ad943cd075987143f"} err="failed to get container status \"d7c6e4676d1912f20152cfcf8d40732b4898b236c2920d0ad943cd075987143f\": rpc error: code = NotFound desc = could not find container \"d7c6e4676d1912f20152cfcf8d40732b4898b236c2920d0ad943cd075987143f\": container with ID starting with d7c6e4676d1912f20152cfcf8d40732b4898b236c2920d0ad943cd075987143f not found: ID does not exist" Jun 10 15:05:36.265184 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.265151 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" event={"ID":"c3ccb65f-ec16-4e13-97d8-a37934fb16c3","Type":"ContainerStarted","Data":"6019cc3c980d323d35382ca263a3e6cbc0615caa8d3b1f7cce84dc98c67fb8f6"} Jun 10 15:05:36.265642 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.265204 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" event={"ID":"c3ccb65f-ec16-4e13-97d8-a37934fb16c3","Type":"ContainerStarted","Data":"478429249ba69997a04e7ed99ca0ff78cea48393a22de1aad7422f8a4dcc6d59"} Jun 10 15:05:36.265642 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.265256 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" Jun 10 15:05:36.267693 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.267664 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g7dkr" event={"ID":"8e984def-3ace-4053-af4b-0fac97f92a9a","Type":"ContainerStarted","Data":"88fc80d94cef4adc1196045f59b56188ca2fe3e7115ffc399ad511f409636d63"} Jun 10 15:05:36.267803 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.267721 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g7dkr" Jun 10 15:05:36.267803 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.267746 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g7dkr" event={"ID":"8e984def-3ace-4053-af4b-0fac97f92a9a","Type":"ContainerStarted","Data":"5dc88149e77096e30ede684ac87f3fee14bc478a46ba9cfeb27579b7fcd863b9"} Jun 10 15:05:36.297401 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.297351 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" podStartSLOduration=2.297336729 podStartE2EDuration="2.297336729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:05:36.29427858 +0000 UTC m=+637.881068302" watchObservedRunningTime="2026-06-10 15:05:36.297336729 +0000 UTC m=+637.884126526" Jun 10 15:05:36.320486 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.320440 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g7dkr" podStartSLOduration=2.320425987 podStartE2EDuration="2.320425987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:05:36.318289099 +0000 UTC m=+637.905078822" watchObservedRunningTime="2026-06-10 15:05:36.320425987 +0000 UTC m=+637.907215709" Jun 10 15:05:36.540897 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.540827 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:36.568129 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.568098 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9"] Jun 10 15:05:36.570306 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.570291 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" Jun 10 15:05:36.594508 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.594486 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9"] Jun 10 15:05:36.689206 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.689174 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:36.717286 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.717260 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0db1b74-cfef-4012-adb0-6878e1354ef3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-t2xg9\" (UID: \"b0db1b74-cfef-4012-adb0-6878e1354ef3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" Jun 10 15:05:36.717409 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.717304 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqbcs\" (UniqueName: \"kubernetes.io/projected/b0db1b74-cfef-4012-adb0-6878e1354ef3-kube-api-access-nqbcs\") pod \"kuadrant-operator-controller-manager-86878c769f-t2xg9\" (UID: \"b0db1b74-cfef-4012-adb0-6878e1354ef3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" Jun 10 15:05:36.818330 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.818253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0db1b74-cfef-4012-adb0-6878e1354ef3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-t2xg9\" (UID: \"b0db1b74-cfef-4012-adb0-6878e1354ef3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" Jun 10 15:05:36.818330 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.818310 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqbcs\" (UniqueName: \"kubernetes.io/projected/b0db1b74-cfef-4012-adb0-6878e1354ef3-kube-api-access-nqbcs\") pod \"kuadrant-operator-controller-manager-86878c769f-t2xg9\" (UID: \"b0db1b74-cfef-4012-adb0-6878e1354ef3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" Jun 10 15:05:36.818635 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.818611 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0db1b74-cfef-4012-adb0-6878e1354ef3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-t2xg9\" (UID: \"b0db1b74-cfef-4012-adb0-6878e1354ef3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" Jun 10 15:05:36.830776 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.830750 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqbcs\" (UniqueName: \"kubernetes.io/projected/b0db1b74-cfef-4012-adb0-6878e1354ef3-kube-api-access-nqbcs\") pod \"kuadrant-operator-controller-manager-86878c769f-t2xg9\" (UID: \"b0db1b74-cfef-4012-adb0-6878e1354ef3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" Jun 10 15:05:36.852033 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.852006 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8137b72a-98bf-4930-8123-f99592c23571" path="/var/lib/kubelet/pods/8137b72a-98bf-4930-8123-f99592c23571/volumes" Jun 10 15:05:36.852569 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.852549 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d398fa7-e0fb-4fbf-9533-3366eec4676b" path="/var/lib/kubelet/pods/8d398fa7-e0fb-4fbf-9533-3366eec4676b/volumes" Jun 10 15:05:36.880411 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:36.880359 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" Jun 10 15:05:37.024937 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:37.024915 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9"] Jun 10 15:05:37.027026 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:05:37.026997 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0db1b74_cfef_4012_adb0_6878e1354ef3.slice/crio-e51d89fe1ab1c7cd53b5878de72982df5a6910ba55f93b05f3c0e009f7524ec0 WatchSource:0}: Error finding container e51d89fe1ab1c7cd53b5878de72982df5a6910ba55f93b05f3c0e009f7524ec0: Status 404 returned error can't find the container with id e51d89fe1ab1c7cd53b5878de72982df5a6910ba55f93b05f3c0e009f7524ec0 Jun 10 15:05:37.274967 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:37.274926 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" event={"ID":"b0db1b74-cfef-4012-adb0-6878e1354ef3","Type":"ContainerStarted","Data":"ffe3bc071a4491d5f275484acca85e2d9cb625424caf7f86eb065ea9abc13e03"} Jun 10 15:05:37.275449 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:37.274997 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" event={"ID":"b0db1b74-cfef-4012-adb0-6878e1354ef3","Type":"ContainerStarted","Data":"e51d89fe1ab1c7cd53b5878de72982df5a6910ba55f93b05f3c0e009f7524ec0"} Jun 10 15:05:37.298705 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:37.298661 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" podStartSLOduration=1.2986451749999999 podStartE2EDuration="1.298645175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:05:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:05:37.298002 +0000 UTC m=+638.884791724" watchObservedRunningTime="2026-06-10 15:05:37.298645175 +0000 UTC m=+638.885434897" Jun 10 15:05:38.281486 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:38.281457 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" Jun 10 15:05:39.254771 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:39.254738 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:39.421946 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:39.421919 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:43.299116 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:43.299084 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:43.598304 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:43.598215 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:47.277489 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:47.277461 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g7dkr" Jun 10 15:05:47.277857 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:47.277538 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" Jun 10 15:05:49.288532 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:49.288502 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" Jun 10 15:05:49.491341 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:49.491306 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6"] Jun 10 15:05:49.491529 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:49.491494 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" podUID="c3ccb65f-ec16-4e13-97d8-a37934fb16c3" containerName="manager" containerID="cri-o://6019cc3c980d323d35382ca263a3e6cbc0615caa8d3b1f7cce84dc98c67fb8f6" gracePeriod=10 Jun 10 15:05:49.749415 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:49.749374 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" Jun 10 15:05:49.930320 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:49.930289 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3ccb65f-ec16-4e13-97d8-a37934fb16c3-extensions-socket-volume\") pod \"c3ccb65f-ec16-4e13-97d8-a37934fb16c3\" (UID: \"c3ccb65f-ec16-4e13-97d8-a37934fb16c3\") " Jun 10 15:05:49.930501 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:49.930346 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlnl7\" (UniqueName: \"kubernetes.io/projected/c3ccb65f-ec16-4e13-97d8-a37934fb16c3-kube-api-access-vlnl7\") pod \"c3ccb65f-ec16-4e13-97d8-a37934fb16c3\" (UID: \"c3ccb65f-ec16-4e13-97d8-a37934fb16c3\") " Jun 10 15:05:49.930739 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:49.930718 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3ccb65f-ec16-4e13-97d8-a37934fb16c3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c3ccb65f-ec16-4e13-97d8-a37934fb16c3" (UID: "c3ccb65f-ec16-4e13-97d8-a37934fb16c3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:05:49.932596 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:49.932574 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3ccb65f-ec16-4e13-97d8-a37934fb16c3-kube-api-access-vlnl7" (OuterVolumeSpecName: "kube-api-access-vlnl7") pod "c3ccb65f-ec16-4e13-97d8-a37934fb16c3" (UID: "c3ccb65f-ec16-4e13-97d8-a37934fb16c3"). InnerVolumeSpecName "kube-api-access-vlnl7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:05:50.031485 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:50.031457 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3ccb65f-ec16-4e13-97d8-a37934fb16c3-extensions-socket-volume\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:05:50.031485 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:50.031482 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlnl7\" (UniqueName: \"kubernetes.io/projected/c3ccb65f-ec16-4e13-97d8-a37934fb16c3-kube-api-access-vlnl7\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:05:50.340229 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:50.340137 2560 generic.go:356] "Generic (PLEG): container finished" podID="c3ccb65f-ec16-4e13-97d8-a37934fb16c3" containerID="6019cc3c980d323d35382ca263a3e6cbc0615caa8d3b1f7cce84dc98c67fb8f6" exitCode=0 Jun 10 15:05:50.340229 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:50.340179 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" event={"ID":"c3ccb65f-ec16-4e13-97d8-a37934fb16c3","Type":"ContainerDied","Data":"6019cc3c980d323d35382ca263a3e6cbc0615caa8d3b1f7cce84dc98c67fb8f6"} Jun 10 15:05:50.340229 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:50.340222 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" event={"ID":"c3ccb65f-ec16-4e13-97d8-a37934fb16c3","Type":"ContainerDied","Data":"478429249ba69997a04e7ed99ca0ff78cea48393a22de1aad7422f8a4dcc6d59"} Jun 10 15:05:50.340781 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:50.340248 2560 scope.go:117] "RemoveContainer" containerID="6019cc3c980d323d35382ca263a3e6cbc0615caa8d3b1f7cce84dc98c67fb8f6" Jun 10 15:05:50.340781 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:50.340182 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6" Jun 10 15:05:50.348811 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:50.348794 2560 scope.go:117] "RemoveContainer" containerID="6019cc3c980d323d35382ca263a3e6cbc0615caa8d3b1f7cce84dc98c67fb8f6" Jun 10 15:05:50.349078 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:05:50.349057 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6019cc3c980d323d35382ca263a3e6cbc0615caa8d3b1f7cce84dc98c67fb8f6\": container with ID starting with 6019cc3c980d323d35382ca263a3e6cbc0615caa8d3b1f7cce84dc98c67fb8f6 not found: ID does not exist" containerID="6019cc3c980d323d35382ca263a3e6cbc0615caa8d3b1f7cce84dc98c67fb8f6" Jun 10 15:05:50.349139 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:50.349092 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6019cc3c980d323d35382ca263a3e6cbc0615caa8d3b1f7cce84dc98c67fb8f6"} err="failed to get container status \"6019cc3c980d323d35382ca263a3e6cbc0615caa8d3b1f7cce84dc98c67fb8f6\": rpc error: code = NotFound desc = could not find container \"6019cc3c980d323d35382ca263a3e6cbc0615caa8d3b1f7cce84dc98c67fb8f6\": container with ID starting with 6019cc3c980d323d35382ca263a3e6cbc0615caa8d3b1f7cce84dc98c67fb8f6 not found: ID does not exist" Jun 10 15:05:50.370676 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:50.370654 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6"] Jun 10 15:05:50.382549 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:50.382521 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r8sg6"] Jun 10 15:05:50.852262 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:50.852230 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3ccb65f-ec16-4e13-97d8-a37934fb16c3" path="/var/lib/kubelet/pods/c3ccb65f-ec16-4e13-97d8-a37934fb16c3/volumes" Jun 10 15:05:52.049746 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:52.049702 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:52.152114 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:52.152084 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:52.248912 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:52.248878 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:55.041301 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:55.041267 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:05:55.164265 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:05:55.164228 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:06.099008 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.098971 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l"] Jun 10 15:06:06.099643 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.099596 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3ccb65f-ec16-4e13-97d8-a37934fb16c3" containerName="manager" Jun 10 15:06:06.099643 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.099616 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3ccb65f-ec16-4e13-97d8-a37934fb16c3" containerName="manager" Jun 10 15:06:06.099747 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.099721 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3ccb65f-ec16-4e13-97d8-a37934fb16c3" containerName="manager" Jun 10 15:06:06.102985 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.102964 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.106401 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.106365 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-m25tk\"" Jun 10 15:06:06.120534 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.120510 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l"] Jun 10 15:06:06.146635 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.146604 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:06.158337 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.158311 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.158476 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.158358 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.158476 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.158377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78d4c434-3c40-4504-a657-aab9960bdf97-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.158476 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.158445 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.158607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.158478 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.158607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.158515 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.158607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.158547 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78d4c434-3c40-4504-a657-aab9960bdf97-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.158607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.158591 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78d4c434-3c40-4504-a657-aab9960bdf97-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.158745 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.158628 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spggw\" (UniqueName: \"kubernetes.io/projected/78d4c434-3c40-4504-a657-aab9960bdf97-kube-api-access-spggw\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.244896 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.244868 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:06.260885 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.260857 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78d4c434-3c40-4504-a657-aab9960bdf97-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.261071 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.260906 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spggw\" (UniqueName: \"kubernetes.io/projected/78d4c434-3c40-4504-a657-aab9960bdf97-kube-api-access-spggw\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.261071 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.260958 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.261071 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.261028 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.261071 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.261065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78d4c434-3c40-4504-a657-aab9960bdf97-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.261286 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.261100 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.261286 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.261135 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.261286 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.261164 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.261286 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.261185 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78d4c434-3c40-4504-a657-aab9960bdf97-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.261847 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.261826 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.262006 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.261848 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.262123 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.262077 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.262255 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.262136 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78d4c434-3c40-4504-a657-aab9960bdf97-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.262255 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.262201 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.265649 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.264680 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78d4c434-3c40-4504-a657-aab9960bdf97-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.265649 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.264876 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78d4c434-3c40-4504-a657-aab9960bdf97-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.275851 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.275830 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78d4c434-3c40-4504-a657-aab9960bdf97-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.276057 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.276040 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spggw\" (UniqueName: \"kubernetes.io/projected/78d4c434-3c40-4504-a657-aab9960bdf97-kube-api-access-spggw\") pod \"maas-default-gateway-openshift-default-687ff6996-g849l\" (UID: \"78d4c434-3c40-4504-a657-aab9960bdf97\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.415839 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.415799 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:06.564593 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.564560 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l"] Jun 10 15:06:06.567623 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:06:06.567591 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d4c434_3c40_4504_a657_aab9960bdf97.slice/crio-1edcf8723a425d071d3aa5438a86d549ee2068edb8631ac94f903c0cb9540430 WatchSource:0}: Error finding container 1edcf8723a425d071d3aa5438a86d549ee2068edb8631ac94f903c0cb9540430: Status 404 returned error can't find the container with id 1edcf8723a425d071d3aa5438a86d549ee2068edb8631ac94f903c0cb9540430 Jun 10 15:06:06.569737 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.569702 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:06:06.569826 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.569769 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:06:06.569826 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:06.569796 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:06:07.425460 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:07.425423 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" event={"ID":"78d4c434-3c40-4504-a657-aab9960bdf97","Type":"ContainerStarted","Data":"da67618c6d09152eb97b424d633e62f39de54168f6541650292e6e97d7154393"} Jun 10 15:06:07.425844 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:07.425480 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" event={"ID":"78d4c434-3c40-4504-a657-aab9960bdf97","Type":"ContainerStarted","Data":"1edcf8723a425d071d3aa5438a86d549ee2068edb8631ac94f903c0cb9540430"} Jun 10 15:06:07.449588 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:07.449537 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" podStartSLOduration=1.449521207 podStartE2EDuration="1.449521207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:07.448119801 +0000 UTC m=+669.034909535" watchObservedRunningTime="2026-06-10 15:06:07.449521207 +0000 UTC m=+669.036310930" Jun 10 15:06:08.416082 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:08.416047 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:08.421009 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:08.420984 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:08.430190 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:08.430167 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:08.431045 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:08.431028 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:06:10.089599 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:10.089565 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:10.566551 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:10.566513 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:10.696631 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:10.696589 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:10.807425 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:10.807398 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:11.468413 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:11.468365 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:11.550451 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:11.550379 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:19.029505 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:19.029459 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:19.129473 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:19.129429 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:26.838273 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:26.838222 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:27.025159 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:27.025097 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:27.485433 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:27.485362 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:35.581080 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:35.581043 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:39.266145 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:39.266118 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:39.375125 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:39.375100 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:39.551242 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:39.551155 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:49.240891 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:49.240853 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-64m88"] Jun 10 15:06:49.244421 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:49.244402 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-64m88" Jun 10 15:06:49.249318 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:49.249297 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-x48fd\"" Jun 10 15:06:49.249568 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:49.249555 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 15:06:49.249646 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:49.249586 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 15:06:49.259093 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:49.259073 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-64m88"] Jun 10 15:06:49.342586 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:49.342547 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjwsf\" (UniqueName: \"kubernetes.io/projected/3d4b5355-c7e0-4dfc-8b15-401c17880743-kube-api-access-vjwsf\") pod \"keycloak-operator-d67dbbb48-64m88\" (UID: \"3d4b5355-c7e0-4dfc-8b15-401c17880743\") " pod="keycloak-system/keycloak-operator-d67dbbb48-64m88" Jun 10 15:06:49.443241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:49.443206 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwsf\" (UniqueName: \"kubernetes.io/projected/3d4b5355-c7e0-4dfc-8b15-401c17880743-kube-api-access-vjwsf\") pod \"keycloak-operator-d67dbbb48-64m88\" (UID: \"3d4b5355-c7e0-4dfc-8b15-401c17880743\") " pod="keycloak-system/keycloak-operator-d67dbbb48-64m88" Jun 10 15:06:49.459568 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:49.459543 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjwsf\" (UniqueName: \"kubernetes.io/projected/3d4b5355-c7e0-4dfc-8b15-401c17880743-kube-api-access-vjwsf\") pod \"keycloak-operator-d67dbbb48-64m88\" (UID: \"3d4b5355-c7e0-4dfc-8b15-401c17880743\") " pod="keycloak-system/keycloak-operator-d67dbbb48-64m88" Jun 10 15:06:49.554773 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:49.554698 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-64m88" Jun 10 15:06:49.734561 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:06:49.734525 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d4b5355_c7e0_4dfc_8b15_401c17880743.slice/crio-0f36804cb94431f7b2cf65ceaf8b1fade838fceac80eaffa516c3f1ed7a44367 WatchSource:0}: Error finding container 0f36804cb94431f7b2cf65ceaf8b1fade838fceac80eaffa516c3f1ed7a44367: Status 404 returned error can't find the container with id 0f36804cb94431f7b2cf65ceaf8b1fade838fceac80eaffa516c3f1ed7a44367 Jun 10 15:06:49.735604 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:49.735578 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-64m88"] Jun 10 15:06:50.628588 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:50.628556 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-64m88" event={"ID":"3d4b5355-c7e0-4dfc-8b15-401c17880743","Type":"ContainerStarted","Data":"0f36804cb94431f7b2cf65ceaf8b1fade838fceac80eaffa516c3f1ed7a44367"} Jun 10 15:06:57.666471 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:57.666430 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-64m88" event={"ID":"3d4b5355-c7e0-4dfc-8b15-401c17880743","Type":"ContainerStarted","Data":"f4f716e773880431b755217e0b830eda60a196ee1ca375ad500e6c56024468ee"} Jun 10 15:06:57.687217 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:57.687165 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-64m88" podStartSLOduration=1.6689737230000001 podStartE2EDuration="8.687149939s" totalImagesPullingTime="7.018176216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:57.684632868 +0000 UTC m=+719.271422590" watchObservedRunningTime="2026-06-10 15:06:57.687149939 +0000 UTC m=+719.273939661" Jun 10 15:06:58.057449 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:58.057339 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:06:58.215896 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:06:58.215865 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:07:05.524208 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:07:05.524175 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:07:05.622444 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:07:05.622409 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:07:38.046655 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:07:38.046606 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:07:38.153719 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:07:38.153690 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:07:43.997528 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:07:43.997492 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:07:44.116568 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:07:44.116533 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:07:44.221924 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:07:44.221893 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:07:44.398403 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:07:44.398367 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:07:47.468834 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:07:47.468805 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:07:47.603971 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:07:47.603938 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:08:18.677366 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:18.677328 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:08:18.871032 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:18.870993 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:08:19.257439 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:19.257406 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:08:19.361141 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:19.361096 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:08:27.097148 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:27.097118 2560 generic.go:356] "Generic (PLEG): container finished" podID="78d4c434-3c40-4504-a657-aab9960bdf97" containerID="da67618c6d09152eb97b424d633e62f39de54168f6541650292e6e97d7154393" exitCode=0 Jun 10 15:08:27.097545 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:27.097189 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" event={"ID":"78d4c434-3c40-4504-a657-aab9960bdf97","Type":"ContainerDied","Data":"da67618c6d09152eb97b424d633e62f39de54168f6541650292e6e97d7154393"} Jun 10 15:08:27.097590 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:27.097578 2560 scope.go:117] "RemoveContainer" containerID="da67618c6d09152eb97b424d633e62f39de54168f6541650292e6e97d7154393" Jun 10 15:08:27.098598 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:27.098573 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:08:27.098708 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:27.098655 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:08:27.098771 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:27.098709 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:08:28.105178 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:28.105142 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" event={"ID":"78d4c434-3c40-4504-a657-aab9960bdf97","Type":"ContainerStarted","Data":"abeccea0e6df24dedc5bb6f5365e455c4b14cc66551f30d1fb30078f70033635"} Jun 10 15:08:28.416228 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:28.416189 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:08:28.416475 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:28.416448 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-g849l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 10 15:08:28.416570 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:28.416518 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" podUID="78d4c434-3c40-4504-a657-aab9960bdf97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 10 15:08:29.416255 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:29.416221 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-g849l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 10 15:08:29.416694 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:29.416280 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" podUID="78d4c434-3c40-4504-a657-aab9960bdf97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 10 15:08:30.416610 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:30.416566 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-g849l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 10 15:08:30.416998 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:30.416633 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" podUID="78d4c434-3c40-4504-a657-aab9960bdf97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 10 15:08:31.417031 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:31.416998 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-g849l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 10 15:08:31.417406 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:31.417066 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" podUID="78d4c434-3c40-4504-a657-aab9960bdf97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 10 15:08:32.419644 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:32.419610 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:08:32.420114 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:32.420000 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:08:32.420685 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:08:32.420666 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-g849l" Jun 10 15:09:10.218241 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:10.218205 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:09:11.564107 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:11.564072 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:09:19.595882 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:19.595828 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:09:29.091245 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:29.091209 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:09:39.887159 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:39.887118 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:09:48.554059 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.554029 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx"] Jun 10 15:09:48.557367 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.557350 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.562868 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.562839 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pbz7s\"" Jun 10 15:09:48.562868 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.562867 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 15:09:48.563066 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.562908 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 15:09:48.563200 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.563181 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 15:09:48.571108 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.571087 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx"] Jun 10 15:09:48.592668 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.592641 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:09:48.648809 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.648782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb448d2-db04-4c8c-8ba3-062377d9be7f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.648970 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.648813 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb448d2-db04-4c8c-8ba3-062377d9be7f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.648970 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.648857 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb448d2-db04-4c8c-8ba3-062377d9be7f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.648970 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.648893 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb448d2-db04-4c8c-8ba3-062377d9be7f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.648970 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.648908 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qms4\" (UniqueName: \"kubernetes.io/projected/eeb448d2-db04-4c8c-8ba3-062377d9be7f-kube-api-access-8qms4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.648970 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.648941 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eeb448d2-db04-4c8c-8ba3-062377d9be7f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.750316 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.750278 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb448d2-db04-4c8c-8ba3-062377d9be7f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.750316 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.750318 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb448d2-db04-4c8c-8ba3-062377d9be7f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.750588 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.750356 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb448d2-db04-4c8c-8ba3-062377d9be7f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.750588 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.750378 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb448d2-db04-4c8c-8ba3-062377d9be7f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.750588 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.750424 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qms4\" (UniqueName: \"kubernetes.io/projected/eeb448d2-db04-4c8c-8ba3-062377d9be7f-kube-api-access-8qms4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.750588 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.750449 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eeb448d2-db04-4c8c-8ba3-062377d9be7f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.750788 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.750766 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb448d2-db04-4c8c-8ba3-062377d9be7f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.750879 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.750855 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb448d2-db04-4c8c-8ba3-062377d9be7f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.750925 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.750900 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eeb448d2-db04-4c8c-8ba3-062377d9be7f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.752849 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.752827 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb448d2-db04-4c8c-8ba3-062377d9be7f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.753025 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.753008 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb448d2-db04-4c8c-8ba3-062377d9be7f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.758491 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.758470 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qms4\" (UniqueName: \"kubernetes.io/projected/eeb448d2-db04-4c8c-8ba3-062377d9be7f-kube-api-access-8qms4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx\" (UID: \"eeb448d2-db04-4c8c-8ba3-062377d9be7f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:48.867886 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:48.867811 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:09:49.010364 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:49.010340 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx"] Jun 10 15:09:49.012789 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:09:49.012762 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb448d2_db04_4c8c_8ba3_062377d9be7f.slice/crio-298b841b2accba56698b9639449d4157351bce75c7808bf003b6a57b52c012b7 WatchSource:0}: Error finding container 298b841b2accba56698b9639449d4157351bce75c7808bf003b6a57b52c012b7: Status 404 returned error can't find the container with id 298b841b2accba56698b9639449d4157351bce75c7808bf003b6a57b52c012b7 Jun 10 15:09:49.014548 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:49.014530 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 15:09:49.488216 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:49.488169 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" event={"ID":"eeb448d2-db04-4c8c-8ba3-062377d9be7f","Type":"ContainerStarted","Data":"298b841b2accba56698b9639449d4157351bce75c7808bf003b6a57b52c012b7"} Jun 10 15:09:53.511013 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:53.510969 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" event={"ID":"eeb448d2-db04-4c8c-8ba3-062377d9be7f","Type":"ContainerStarted","Data":"8155f6b38c9cef163142dd4c2727c6b21be0de037e3f4a3b65cb72060e4e0e4f"} Jun 10 15:09:55.255028 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:55.254988 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:09:58.851899 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:58.851866 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:09:58.853861 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:58.853831 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:09:58.861601 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:58.861577 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:09:58.863151 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:09:58.863130 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:10:01.312707 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:10:01.312671 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:10:45.036122 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:10:45.036092 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:10:45.760352 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:10:45.760259 2560 generic.go:356] "Generic (PLEG): container finished" podID="eeb448d2-db04-4c8c-8ba3-062377d9be7f" containerID="8155f6b38c9cef163142dd4c2727c6b21be0de037e3f4a3b65cb72060e4e0e4f" exitCode=0 Jun 10 15:10:45.760352 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:10:45.760310 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" event={"ID":"eeb448d2-db04-4c8c-8ba3-062377d9be7f","Type":"ContainerDied","Data":"8155f6b38c9cef163142dd4c2727c6b21be0de037e3f4a3b65cb72060e4e0e4f"} Jun 10 15:10:47.772310 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:10:47.772276 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" event={"ID":"eeb448d2-db04-4c8c-8ba3-062377d9be7f","Type":"ContainerStarted","Data":"7dc6ed53aefdabcfcd08e7753c1b8d6aaebca0f591b8d68f29c929acf1e7ac1f"} Jun 10 15:10:47.795986 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:10:47.795937 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" podStartSLOduration=1.9651149540000001 podStartE2EDuration="59.795922103s" totalImagesPullingTime="4.892572793s" totalInitContainerRuntime="52.938234356s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:09:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:10:47.794000183 +0000 UTC m=+949.380789912" watchObservedRunningTime="2026-06-10 15:10:47.795922103 +0000 UTC m=+949.382711825" Jun 10 15:10:48.868792 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:10:48.868762 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:10:48.869165 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:10:48.868806 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:10:48.881199 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:10:48.881177 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:10:49.793072 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:10:49.793042 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx" Jun 10 15:11:05.088659 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:11:05.088623 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:11:05.222813 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:11:05.222780 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:11:06.332661 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:11:06.332585 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:11:06.453505 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:11:06.453463 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:11:26.525062 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:11:26.525028 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:12:22.655099 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:12:22.655063 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:12:22.756023 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:12:22.755990 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:12:32.904687 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:12:32.904652 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:12:35.001403 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:12:35.001364 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:12:35.073306 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:12:35.073275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:12:45.241630 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:12:45.241547 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:12:46.683075 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:12:46.683016 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:13:29.583160 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:13:29.583125 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:13:29.719175 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:13:29.719146 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:13:38.020690 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:13:38.020657 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:13:43.541863 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:13:43.541832 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:13:44.236311 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:13:44.236274 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:13:44.339456 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:13:44.339421 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:13:49.443862 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:13:49.443827 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:14:16.388767 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:14:16.388722 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:14:17.497755 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:14:17.497724 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:14:40.470194 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:14:40.470157 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:14:46.985414 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:14:46.979339 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:14:47.199184 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:14:47.199155 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:14:47.482576 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:14:47.482542 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:14:47.609424 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:14:47.609372 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:14:58.889662 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:14:58.889632 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:14:58.890936 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:14:58.890911 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:14:58.898583 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:14:58.898560 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:14:58.899747 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:14:58.899730 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:15:00.159656 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:00.159623 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb"] Jun 10 15:15:00.163058 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:00.163043 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb" Jun 10 15:15:00.166053 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:00.166030 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-kcmlr\"" Jun 10 15:15:00.166193 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:00.166100 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 10 15:15:00.166691 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:00.166674 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 10 15:15:00.184096 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:00.184069 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb"] Jun 10 15:15:00.281682 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:00.281648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9mjv\" (UniqueName: \"kubernetes.io/projected/356017d2-3914-4d0e-bbac-1326c872aa92-kube-api-access-r9mjv\") pod \"maas-api-key-cleanup-29685075-q68hb\" (UID: \"356017d2-3914-4d0e-bbac-1326c872aa92\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb" Jun 10 15:15:00.383102 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:00.383054 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9mjv\" (UniqueName: \"kubernetes.io/projected/356017d2-3914-4d0e-bbac-1326c872aa92-kube-api-access-r9mjv\") pod \"maas-api-key-cleanup-29685075-q68hb\" (UID: \"356017d2-3914-4d0e-bbac-1326c872aa92\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb" Jun 10 15:15:00.395877 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:00.395846 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9mjv\" (UniqueName: \"kubernetes.io/projected/356017d2-3914-4d0e-bbac-1326c872aa92-kube-api-access-r9mjv\") pod \"maas-api-key-cleanup-29685075-q68hb\" (UID: \"356017d2-3914-4d0e-bbac-1326c872aa92\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb" Jun 10 15:15:00.474053 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:00.473947 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb" Jun 10 15:15:00.608235 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:00.608209 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb"] Jun 10 15:15:00.609942 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:15:00.609916 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356017d2_3914_4d0e_bbac_1326c872aa92.slice/crio-37e6ff6bba4949842b5a80dc964bc405ce32c7187f321a0dd4d07e86d3a431d0 WatchSource:0}: Error finding container 37e6ff6bba4949842b5a80dc964bc405ce32c7187f321a0dd4d07e86d3a431d0: Status 404 returned error can't find the container with id 37e6ff6bba4949842b5a80dc964bc405ce32c7187f321a0dd4d07e86d3a431d0 Jun 10 15:15:00.611878 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:00.611860 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 15:15:00.965461 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:00.965426 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb" event={"ID":"356017d2-3914-4d0e-bbac-1326c872aa92","Type":"ContainerStarted","Data":"37e6ff6bba4949842b5a80dc964bc405ce32c7187f321a0dd4d07e86d3a431d0"} Jun 10 15:15:03.983075 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:03.982977 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb" event={"ID":"356017d2-3914-4d0e-bbac-1326c872aa92","Type":"ContainerStarted","Data":"0c563216b6f2dbd1b99c187393bd50c0ce83ece2c7fc76b10822b2ec7d5c3c4e"} Jun 10 15:15:04.000153 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:04.000105 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb" podStartSLOduration=1.294625932 podStartE2EDuration="4.000090799s" totalImagesPullingTime="2.705464867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:15:03.999128321 +0000 UTC m=+1205.585918073" watchObservedRunningTime="2026-06-10 15:15:04.000090799 +0000 UTC m=+1205.586880542" Jun 10 15:15:04.013097 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:04.013060 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:15:04.129463 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:04.129431 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:15:04.231154 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:04.231116 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:15:10.605967 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:10.605927 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:15:10.717640 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:10.717605 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:15:18.751799 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:18.751769 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:15:18.865670 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:18.865635 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:15:18.957465 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:18.957432 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:15:19.059351 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:19.059269 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:15:35.668360 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:35.668310 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:15:35.957441 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:35.957346 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:15:36.069904 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:36.069828 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:15:42.147577 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:42.147541 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:15:42.243234 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:15:42.243201 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:16:00.011975 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:00.011939 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb"] Jun 10 15:16:00.012583 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:00.012135 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb" podUID="356017d2-3914-4d0e-bbac-1326c872aa92" containerName="cleanup" containerID="cri-o://0c563216b6f2dbd1b99c187393bd50c0ce83ece2c7fc76b10822b2ec7d5c3c4e" gracePeriod=30 Jun 10 15:16:04.761428 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:04.761376 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:16:04.850626 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:04.850598 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:16:04.979697 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:04.979665 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:16:11.031809 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:11.031774 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:16:11.138695 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:11.138657 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:16:11.244199 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:11.244170 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:16:11.393089 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:11.393061 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:16:17.761739 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:17.761700 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:16:17.862922 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:17.862893 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:16:30.211699 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.211672 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb" Jun 10 15:16:30.286991 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.286908 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9mjv\" (UniqueName: \"kubernetes.io/projected/356017d2-3914-4d0e-bbac-1326c872aa92-kube-api-access-r9mjv\") pod \"356017d2-3914-4d0e-bbac-1326c872aa92\" (UID: \"356017d2-3914-4d0e-bbac-1326c872aa92\") " Jun 10 15:16:30.289217 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.289186 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/356017d2-3914-4d0e-bbac-1326c872aa92-kube-api-access-r9mjv" (OuterVolumeSpecName: "kube-api-access-r9mjv") pod "356017d2-3914-4d0e-bbac-1326c872aa92" (UID: "356017d2-3914-4d0e-bbac-1326c872aa92"). InnerVolumeSpecName "kube-api-access-r9mjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:16:30.388221 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.388177 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9mjv\" (UniqueName: \"kubernetes.io/projected/356017d2-3914-4d0e-bbac-1326c872aa92-kube-api-access-r9mjv\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:16:30.401980 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.401941 2560 generic.go:356] "Generic (PLEG): container finished" podID="356017d2-3914-4d0e-bbac-1326c872aa92" containerID="0c563216b6f2dbd1b99c187393bd50c0ce83ece2c7fc76b10822b2ec7d5c3c4e" exitCode=137 Jun 10 15:16:30.402123 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.401995 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb" Jun 10 15:16:30.402123 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.402033 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb" event={"ID":"356017d2-3914-4d0e-bbac-1326c872aa92","Type":"ContainerDied","Data":"0c563216b6f2dbd1b99c187393bd50c0ce83ece2c7fc76b10822b2ec7d5c3c4e"} Jun 10 15:16:30.402123 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.402088 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb" event={"ID":"356017d2-3914-4d0e-bbac-1326c872aa92","Type":"ContainerDied","Data":"37e6ff6bba4949842b5a80dc964bc405ce32c7187f321a0dd4d07e86d3a431d0"} Jun 10 15:16:30.402123 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.402110 2560 scope.go:117] "RemoveContainer" containerID="0c563216b6f2dbd1b99c187393bd50c0ce83ece2c7fc76b10822b2ec7d5c3c4e" Jun 10 15:16:30.410818 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.410803 2560 scope.go:117] "RemoveContainer" containerID="0c563216b6f2dbd1b99c187393bd50c0ce83ece2c7fc76b10822b2ec7d5c3c4e" Jun 10 15:16:30.411075 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:16:30.411054 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c563216b6f2dbd1b99c187393bd50c0ce83ece2c7fc76b10822b2ec7d5c3c4e\": container with ID starting with 0c563216b6f2dbd1b99c187393bd50c0ce83ece2c7fc76b10822b2ec7d5c3c4e not found: ID does not exist" containerID="0c563216b6f2dbd1b99c187393bd50c0ce83ece2c7fc76b10822b2ec7d5c3c4e" Jun 10 15:16:30.411129 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.411082 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c563216b6f2dbd1b99c187393bd50c0ce83ece2c7fc76b10822b2ec7d5c3c4e"} err="failed to get container status \"0c563216b6f2dbd1b99c187393bd50c0ce83ece2c7fc76b10822b2ec7d5c3c4e\": rpc error: code = NotFound desc = could not find container \"0c563216b6f2dbd1b99c187393bd50c0ce83ece2c7fc76b10822b2ec7d5c3c4e\": container with ID starting with 0c563216b6f2dbd1b99c187393bd50c0ce83ece2c7fc76b10822b2ec7d5c3c4e not found: ID does not exist" Jun 10 15:16:30.424077 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.424049 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb"] Jun 10 15:16:30.426102 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.426077 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685075-q68hb"] Jun 10 15:16:30.852873 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:16:30.852839 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="356017d2-3914-4d0e-bbac-1326c872aa92" path="/var/lib/kubelet/pods/356017d2-3914-4d0e-bbac-1326c872aa92/volumes" Jun 10 15:17:02.927186 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:17:02.927152 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:19:58.920265 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:19:58.920227 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:19:58.922804 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:19:58.920891 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:19:58.928900 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:19:58.928878 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:19:58.929079 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:19:58.929064 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:21:07.690587 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:21:07.690553 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:23:22.721864 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:22.721831 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9"] Jun 10 15:23:22.722304 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:22.722028 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" podUID="b0db1b74-cfef-4012-adb0-6878e1354ef3" containerName="manager" containerID="cri-o://ffe3bc071a4491d5f275484acca85e2d9cb625424caf7f86eb065ea9abc13e03" gracePeriod=10 Jun 10 15:23:22.987280 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:22.987252 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" Jun 10 15:23:23.187281 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.187250 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0db1b74-cfef-4012-adb0-6878e1354ef3-extensions-socket-volume\") pod \"b0db1b74-cfef-4012-adb0-6878e1354ef3\" (UID: \"b0db1b74-cfef-4012-adb0-6878e1354ef3\") " Jun 10 15:23:23.187441 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.187319 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqbcs\" (UniqueName: \"kubernetes.io/projected/b0db1b74-cfef-4012-adb0-6878e1354ef3-kube-api-access-nqbcs\") pod \"b0db1b74-cfef-4012-adb0-6878e1354ef3\" (UID: \"b0db1b74-cfef-4012-adb0-6878e1354ef3\") " Jun 10 15:23:23.187659 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.187636 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0db1b74-cfef-4012-adb0-6878e1354ef3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b0db1b74-cfef-4012-adb0-6878e1354ef3" (UID: "b0db1b74-cfef-4012-adb0-6878e1354ef3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:23:23.189511 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.189488 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0db1b74-cfef-4012-adb0-6878e1354ef3-kube-api-access-nqbcs" (OuterVolumeSpecName: "kube-api-access-nqbcs") pod "b0db1b74-cfef-4012-adb0-6878e1354ef3" (UID: "b0db1b74-cfef-4012-adb0-6878e1354ef3"). InnerVolumeSpecName "kube-api-access-nqbcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:23:23.288180 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.288112 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0db1b74-cfef-4012-adb0-6878e1354ef3-extensions-socket-volume\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:23:23.288180 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.288135 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqbcs\" (UniqueName: \"kubernetes.io/projected/b0db1b74-cfef-4012-adb0-6878e1354ef3-kube-api-access-nqbcs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:23:23.403686 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.403649 2560 generic.go:356] "Generic (PLEG): container finished" podID="b0db1b74-cfef-4012-adb0-6878e1354ef3" containerID="ffe3bc071a4491d5f275484acca85e2d9cb625424caf7f86eb065ea9abc13e03" exitCode=0 Jun 10 15:23:23.403834 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.403690 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" Jun 10 15:23:23.403834 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.403733 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" event={"ID":"b0db1b74-cfef-4012-adb0-6878e1354ef3","Type":"ContainerDied","Data":"ffe3bc071a4491d5f275484acca85e2d9cb625424caf7f86eb065ea9abc13e03"} Jun 10 15:23:23.403834 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.403786 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9" event={"ID":"b0db1b74-cfef-4012-adb0-6878e1354ef3","Type":"ContainerDied","Data":"e51d89fe1ab1c7cd53b5878de72982df5a6910ba55f93b05f3c0e009f7524ec0"} Jun 10 15:23:23.403834 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.403811 2560 scope.go:117] "RemoveContainer" containerID="ffe3bc071a4491d5f275484acca85e2d9cb625424caf7f86eb065ea9abc13e03" Jun 10 15:23:23.412895 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.412877 2560 scope.go:117] "RemoveContainer" containerID="ffe3bc071a4491d5f275484acca85e2d9cb625424caf7f86eb065ea9abc13e03" Jun 10 15:23:23.413157 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:23:23.413138 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe3bc071a4491d5f275484acca85e2d9cb625424caf7f86eb065ea9abc13e03\": container with ID starting with ffe3bc071a4491d5f275484acca85e2d9cb625424caf7f86eb065ea9abc13e03 not found: ID does not exist" containerID="ffe3bc071a4491d5f275484acca85e2d9cb625424caf7f86eb065ea9abc13e03" Jun 10 15:23:23.413229 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.413164 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe3bc071a4491d5f275484acca85e2d9cb625424caf7f86eb065ea9abc13e03"} err="failed to get container status \"ffe3bc071a4491d5f275484acca85e2d9cb625424caf7f86eb065ea9abc13e03\": rpc error: code = NotFound desc = could not find container \"ffe3bc071a4491d5f275484acca85e2d9cb625424caf7f86eb065ea9abc13e03\": container with ID starting with ffe3bc071a4491d5f275484acca85e2d9cb625424caf7f86eb065ea9abc13e03 not found: ID does not exist" Jun 10 15:23:23.427139 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.427118 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9"] Jun 10 15:23:23.433693 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:23.433671 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t2xg9"] Jun 10 15:23:24.853076 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:24.853040 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0db1b74-cfef-4012-adb0-6878e1354ef3" path="/var/lib/kubelet/pods/b0db1b74-cfef-4012-adb0-6878e1354ef3/volumes" Jun 10 15:23:38.638122 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:23:38.638084 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:24:28.875869 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:28.875840 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8"] Jun 10 15:24:28.876305 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:28.876206 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="356017d2-3914-4d0e-bbac-1326c872aa92" containerName="cleanup" Jun 10 15:24:28.876305 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:28.876221 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="356017d2-3914-4d0e-bbac-1326c872aa92" containerName="cleanup" Jun 10 15:24:28.876305 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:28.876243 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0db1b74-cfef-4012-adb0-6878e1354ef3" containerName="manager" Jun 10 15:24:28.876305 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:28.876248 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0db1b74-cfef-4012-adb0-6878e1354ef3" containerName="manager" Jun 10 15:24:28.876472 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:28.876315 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0db1b74-cfef-4012-adb0-6878e1354ef3" containerName="manager" Jun 10 15:24:28.876472 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:28.876325 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="356017d2-3914-4d0e-bbac-1326c872aa92" containerName="cleanup" Jun 10 15:24:28.879416 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:28.879379 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8" Jun 10 15:24:28.882935 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:28.882918 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cvctl\"" Jun 10 15:24:28.897768 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:28.897746 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8"] Jun 10 15:24:28.940548 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:28.940520 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfrg8\" (UniqueName: \"kubernetes.io/projected/d7651f7b-8d41-4526-9e61-4739a1c4c67b-kube-api-access-cfrg8\") pod \"kuadrant-operator-controller-manager-86878c769f-fs5r8\" (UID: \"d7651f7b-8d41-4526-9e61-4739a1c4c67b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8" Jun 10 15:24:28.940668 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:28.940593 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7651f7b-8d41-4526-9e61-4739a1c4c67b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fs5r8\" (UID: \"d7651f7b-8d41-4526-9e61-4739a1c4c67b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8" Jun 10 15:24:29.041406 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:29.041369 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfrg8\" (UniqueName: \"kubernetes.io/projected/d7651f7b-8d41-4526-9e61-4739a1c4c67b-kube-api-access-cfrg8\") pod \"kuadrant-operator-controller-manager-86878c769f-fs5r8\" (UID: \"d7651f7b-8d41-4526-9e61-4739a1c4c67b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8" Jun 10 15:24:29.041589 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:29.041473 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7651f7b-8d41-4526-9e61-4739a1c4c67b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fs5r8\" (UID: \"d7651f7b-8d41-4526-9e61-4739a1c4c67b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8" Jun 10 15:24:29.041803 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:29.041787 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7651f7b-8d41-4526-9e61-4739a1c4c67b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fs5r8\" (UID: \"d7651f7b-8d41-4526-9e61-4739a1c4c67b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8" Jun 10 15:24:29.051298 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:29.051266 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfrg8\" (UniqueName: \"kubernetes.io/projected/d7651f7b-8d41-4526-9e61-4739a1c4c67b-kube-api-access-cfrg8\") pod \"kuadrant-operator-controller-manager-86878c769f-fs5r8\" (UID: \"d7651f7b-8d41-4526-9e61-4739a1c4c67b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8" Jun 10 15:24:29.189805 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:29.189731 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8" Jun 10 15:24:29.335149 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:29.335125 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8"] Jun 10 15:24:29.337334 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:24:29.337301 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7651f7b_8d41_4526_9e61_4739a1c4c67b.slice/crio-fc4d9236025953f85fb0a5137c34547a3f828ed89ada32de124371af0deda6ce WatchSource:0}: Error finding container fc4d9236025953f85fb0a5137c34547a3f828ed89ada32de124371af0deda6ce: Status 404 returned error can't find the container with id fc4d9236025953f85fb0a5137c34547a3f828ed89ada32de124371af0deda6ce Jun 10 15:24:29.724355 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:29.724322 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8" event={"ID":"d7651f7b-8d41-4526-9e61-4739a1c4c67b","Type":"ContainerStarted","Data":"866d208d7566502748eb01ac2cf068e0c72fbd696f6e288fffce0f81798f010f"} Jun 10 15:24:29.724563 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:29.724375 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8" event={"ID":"d7651f7b-8d41-4526-9e61-4739a1c4c67b","Type":"ContainerStarted","Data":"fc4d9236025953f85fb0a5137c34547a3f828ed89ada32de124371af0deda6ce"} Jun 10 15:24:29.724563 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:29.724428 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8" Jun 10 15:24:29.765888 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:29.765832 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8" podStartSLOduration=1.765814972 podStartE2EDuration="1.765814972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:24:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:24:29.763649585 +0000 UTC m=+1771.350439308" watchObservedRunningTime="2026-06-10 15:24:29.765814972 +0000 UTC m=+1771.352604695" Jun 10 15:24:40.732308 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:40.732216 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fs5r8" Jun 10 15:24:58.950168 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:58.950061 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:24:58.956255 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:58.950178 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:24:58.965155 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:58.965128 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:24:58.965365 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:24:58.965341 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:26:29.238381 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:26:29.238346 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:27:27.552668 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:27:27.552625 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:29:58.985644 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:29:58.985517 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:29:58.989827 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:29:58.987775 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:29:58.995366 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:29:58.995345 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:29:58.997738 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:29:58.997720 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:30:00.151869 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:00.151836 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x"] Jun 10 15:30:00.155131 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:00.155115 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x" Jun 10 15:30:00.158563 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:00.158540 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-kcmlr\"" Jun 10 15:30:00.158679 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:00.158576 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 10 15:30:00.159251 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:00.159229 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 10 15:30:00.184649 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:00.184624 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x"] Jun 10 15:30:00.271001 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:00.270954 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kvsk\" (UniqueName: \"kubernetes.io/projected/33b70f17-8038-44d8-8cda-60ae948fe6e7-kube-api-access-2kvsk\") pod \"maas-api-key-cleanup-29685090-7zh6x\" (UID: \"33b70f17-8038-44d8-8cda-60ae948fe6e7\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x" Jun 10 15:30:00.371613 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:00.371576 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kvsk\" (UniqueName: \"kubernetes.io/projected/33b70f17-8038-44d8-8cda-60ae948fe6e7-kube-api-access-2kvsk\") pod \"maas-api-key-cleanup-29685090-7zh6x\" (UID: \"33b70f17-8038-44d8-8cda-60ae948fe6e7\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x" Jun 10 15:30:00.386452 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:00.386422 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kvsk\" (UniqueName: \"kubernetes.io/projected/33b70f17-8038-44d8-8cda-60ae948fe6e7-kube-api-access-2kvsk\") pod \"maas-api-key-cleanup-29685090-7zh6x\" (UID: \"33b70f17-8038-44d8-8cda-60ae948fe6e7\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x" Jun 10 15:30:00.465563 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:00.465474 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x" Jun 10 15:30:00.605317 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:00.605284 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x"] Jun 10 15:30:00.607601 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:30:00.607569 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b70f17_8038_44d8_8cda_60ae948fe6e7.slice/crio-8bf6884e7b0c33f7d82bb8f0a2ad630763650b947e0bbd8feed3ec2fdb092354 WatchSource:0}: Error finding container 8bf6884e7b0c33f7d82bb8f0a2ad630763650b947e0bbd8feed3ec2fdb092354: Status 404 returned error can't find the container with id 8bf6884e7b0c33f7d82bb8f0a2ad630763650b947e0bbd8feed3ec2fdb092354 Jun 10 15:30:01.301932 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:01.301894 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x" event={"ID":"33b70f17-8038-44d8-8cda-60ae948fe6e7","Type":"ContainerStarted","Data":"7d278500a7b15e041069cf70c0e1b9e890da65913004f931c0e0a398492334ad"} Jun 10 15:30:01.302354 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:01.301948 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x" event={"ID":"33b70f17-8038-44d8-8cda-60ae948fe6e7","Type":"ContainerStarted","Data":"8bf6884e7b0c33f7d82bb8f0a2ad630763650b947e0bbd8feed3ec2fdb092354"} Jun 10 15:30:01.332043 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:01.331993 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x" podStartSLOduration=1.331976386 podStartE2EDuration="1.331976386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:30:01.330729013 +0000 UTC m=+2102.917518735" watchObservedRunningTime="2026-06-10 15:30:01.331976386 +0000 UTC m=+2102.918766109" Jun 10 15:30:27.512484 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:30:27.512436 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:31:00.009743 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:00.009649 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x"] Jun 10 15:31:00.010291 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:00.009855 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x" podUID="33b70f17-8038-44d8-8cda-60ae948fe6e7" containerName="cleanup" containerID="cri-o://7d278500a7b15e041069cf70c0e1b9e890da65913004f931c0e0a398492334ad" gracePeriod=30 Jun 10 15:31:26.013733 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:26.013698 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:31:30.191997 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.191974 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x" Jun 10 15:31:30.268528 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.268430 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kvsk\" (UniqueName: \"kubernetes.io/projected/33b70f17-8038-44d8-8cda-60ae948fe6e7-kube-api-access-2kvsk\") pod \"33b70f17-8038-44d8-8cda-60ae948fe6e7\" (UID: \"33b70f17-8038-44d8-8cda-60ae948fe6e7\") " Jun 10 15:31:30.270666 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.270636 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33b70f17-8038-44d8-8cda-60ae948fe6e7-kube-api-access-2kvsk" (OuterVolumeSpecName: "kube-api-access-2kvsk") pod "33b70f17-8038-44d8-8cda-60ae948fe6e7" (UID: "33b70f17-8038-44d8-8cda-60ae948fe6e7"). InnerVolumeSpecName "kube-api-access-2kvsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:31:30.369404 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.369338 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kvsk\" (UniqueName: \"kubernetes.io/projected/33b70f17-8038-44d8-8cda-60ae948fe6e7-kube-api-access-2kvsk\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:31:30.725192 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.725153 2560 generic.go:356] "Generic (PLEG): container finished" podID="33b70f17-8038-44d8-8cda-60ae948fe6e7" containerID="7d278500a7b15e041069cf70c0e1b9e890da65913004f931c0e0a398492334ad" exitCode=137 Jun 10 15:31:30.725416 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.725200 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x" Jun 10 15:31:30.725416 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.725244 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x" event={"ID":"33b70f17-8038-44d8-8cda-60ae948fe6e7","Type":"ContainerDied","Data":"7d278500a7b15e041069cf70c0e1b9e890da65913004f931c0e0a398492334ad"} Jun 10 15:31:30.725416 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.725317 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x" event={"ID":"33b70f17-8038-44d8-8cda-60ae948fe6e7","Type":"ContainerDied","Data":"8bf6884e7b0c33f7d82bb8f0a2ad630763650b947e0bbd8feed3ec2fdb092354"} Jun 10 15:31:30.725416 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.725340 2560 scope.go:117] "RemoveContainer" containerID="7d278500a7b15e041069cf70c0e1b9e890da65913004f931c0e0a398492334ad" Jun 10 15:31:30.734227 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.734209 2560 scope.go:117] "RemoveContainer" containerID="7d278500a7b15e041069cf70c0e1b9e890da65913004f931c0e0a398492334ad" Jun 10 15:31:30.734527 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:31:30.734506 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d278500a7b15e041069cf70c0e1b9e890da65913004f931c0e0a398492334ad\": container with ID starting with 7d278500a7b15e041069cf70c0e1b9e890da65913004f931c0e0a398492334ad not found: ID does not exist" containerID="7d278500a7b15e041069cf70c0e1b9e890da65913004f931c0e0a398492334ad" Jun 10 15:31:30.734607 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.734541 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d278500a7b15e041069cf70c0e1b9e890da65913004f931c0e0a398492334ad"} err="failed to get container status \"7d278500a7b15e041069cf70c0e1b9e890da65913004f931c0e0a398492334ad\": rpc error: code = NotFound desc = could not find container \"7d278500a7b15e041069cf70c0e1b9e890da65913004f931c0e0a398492334ad\": container with ID starting with 7d278500a7b15e041069cf70c0e1b9e890da65913004f931c0e0a398492334ad not found: ID does not exist" Jun 10 15:31:30.747424 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.747382 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x"] Jun 10 15:31:30.752504 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.752482 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685090-7zh6x"] Jun 10 15:31:30.853489 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:31:30.853459 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33b70f17-8038-44d8-8cda-60ae948fe6e7" path="/var/lib/kubelet/pods/33b70f17-8038-44d8-8cda-60ae948fe6e7/volumes" Jun 10 15:33:17.376689 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:33:17.376645 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:33:22.763433 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:33:22.763376 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:33:46.989013 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:33:46.988899 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:00.074603 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:00.074565 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:01.700438 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.700410 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9"] Jun 10 15:34:01.700943 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.700913 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b70f17-8038-44d8-8cda-60ae948fe6e7" containerName="cleanup" Jun 10 15:34:01.700943 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.700943 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b70f17-8038-44d8-8cda-60ae948fe6e7" containerName="cleanup" Jun 10 15:34:01.701145 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.701021 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="33b70f17-8038-44d8-8cda-60ae948fe6e7" containerName="cleanup" Jun 10 15:34:01.704173 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.704155 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.707022 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.706993 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-89f044fb-openshift-default-dockercfg-4dpkh\"" Jun 10 15:34:01.730869 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.730839 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9"] Jun 10 15:34:01.737686 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.737658 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:01.797709 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.797674 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9qw7\" (UniqueName: \"kubernetes.io/projected/008f7fe2-8881-4d52-a05b-c5a809d3de82-kube-api-access-q9qw7\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.797877 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.797715 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-workload-socket\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.797877 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.797735 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-workload-certs\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.797877 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.797832 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-envoy\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.797988 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.797877 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-token\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.797988 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.797925 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-podinfo\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.797988 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.797949 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008f7fe2-8881-4d52-a05b-c5a809d3de82-istiod-ca-cert\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.798081 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.797995 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-credential-socket\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.798081 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.798014 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-data\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.805424 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.805375 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:01.898480 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.898429 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-workload-socket\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.898480 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.898477 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-workload-certs\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.898736 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.898520 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-envoy\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.898736 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.898549 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-token\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.898736 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.898581 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-podinfo\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.898736 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.898613 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008f7fe2-8881-4d52-a05b-c5a809d3de82-istiod-ca-cert\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.898736 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.898663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-credential-socket\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.898736 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.898690 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-data\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.898736 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.898728 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9qw7\" (UniqueName: \"kubernetes.io/projected/008f7fe2-8881-4d52-a05b-c5a809d3de82-kube-api-access-q9qw7\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.899085 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.898872 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-workload-socket\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.899085 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.898918 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-workload-certs\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.899193 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.899083 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-credential-socket\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.899193 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.899167 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-data\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.899366 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.899347 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008f7fe2-8881-4d52-a05b-c5a809d3de82-istiod-ca-cert\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.901151 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.901127 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-envoy\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.901334 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.901316 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-podinfo\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.910779 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.910741 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:01.912010 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.911990 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-token\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:01.913014 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:01.912990 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9qw7\" (UniqueName: \"kubernetes.io/projected/008f7fe2-8881-4d52-a05b-c5a809d3de82-kube-api-access-q9qw7\") pod \"e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:02.010271 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:02.010170 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:02.016568 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:02.016544 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:02.169201 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:02.169161 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9"] Jun 10 15:34:02.170206 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:34:02.170181 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008f7fe2_8881_4d52_a05b_c5a809d3de82.slice/crio-258e66c8d3ed1a246f0d84e8ca64e625abc26b97a13be7ffe11d976a1e6031a6 WatchSource:0}: Error finding container 258e66c8d3ed1a246f0d84e8ca64e625abc26b97a13be7ffe11d976a1e6031a6: Status 404 returned error can't find the container with id 258e66c8d3ed1a246f0d84e8ca64e625abc26b97a13be7ffe11d976a1e6031a6 Jun 10 15:34:02.172763 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:02.172730 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:34:02.172859 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:02.172794 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:34:02.172859 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:02.172822 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:34:02.443482 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:02.443443 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" event={"ID":"008f7fe2-8881-4d52-a05b-c5a809d3de82","Type":"ContainerStarted","Data":"6a2e94bc133a032ed95f20e823e6816efd0245bafe4199ffc8fc0364d0e5b895"} Jun 10 15:34:02.443651 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:02.443504 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" event={"ID":"008f7fe2-8881-4d52-a05b-c5a809d3de82","Type":"ContainerStarted","Data":"258e66c8d3ed1a246f0d84e8ca64e625abc26b97a13be7ffe11d976a1e6031a6"} Jun 10 15:34:02.471560 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:02.471496 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" podStartSLOduration=1.471472383 podStartE2EDuration="1.471472383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:34:02.471456977 +0000 UTC m=+2344.058246702" watchObservedRunningTime="2026-06-10 15:34:02.471472383 +0000 UTC m=+2344.058262107" Jun 10 15:34:03.017150 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:03.017110 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:03.022704 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:03.022680 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:03.449164 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:03.449126 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:03.450015 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:03.449998 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:05.800219 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:05.800184 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:07.990075 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:07.990044 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:08.139957 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:08.139922 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9"] Jun 10 15:34:08.140141 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:08.140106 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" podUID="008f7fe2-8881-4d52-a05b-c5a809d3de82" containerName="istio-proxy" containerID="cri-o://6a2e94bc133a032ed95f20e823e6816efd0245bafe4199ffc8fc0364d0e5b895" gracePeriod=30 Jun 10 15:34:08.168126 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:08.168087 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:08.266088 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:08.265998 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:09.649920 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:09.649881 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:13.387696 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.387671 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:13.404864 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.404812 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-envoy\") pod \"008f7fe2-8881-4d52-a05b-c5a809d3de82\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " Jun 10 15:34:13.404864 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.404838 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-credential-socket\") pod \"008f7fe2-8881-4d52-a05b-c5a809d3de82\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " Jun 10 15:34:13.405102 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.404867 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008f7fe2-8881-4d52-a05b-c5a809d3de82-istiod-ca-cert\") pod \"008f7fe2-8881-4d52-a05b-c5a809d3de82\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " Jun 10 15:34:13.405102 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.404888 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-token\") pod \"008f7fe2-8881-4d52-a05b-c5a809d3de82\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " Jun 10 15:34:13.405102 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.404926 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9qw7\" (UniqueName: \"kubernetes.io/projected/008f7fe2-8881-4d52-a05b-c5a809d3de82-kube-api-access-q9qw7\") pod \"008f7fe2-8881-4d52-a05b-c5a809d3de82\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " Jun 10 15:34:13.405102 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.405073 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-workload-certs\") pod \"008f7fe2-8881-4d52-a05b-c5a809d3de82\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " Jun 10 15:34:13.405319 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.405120 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "008f7fe2-8881-4d52-a05b-c5a809d3de82" (UID: "008f7fe2-8881-4d52-a05b-c5a809d3de82"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:34:13.405319 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.405165 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-workload-socket\") pod \"008f7fe2-8881-4d52-a05b-c5a809d3de82\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " Jun 10 15:34:13.405319 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.405207 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-podinfo\") pod \"008f7fe2-8881-4d52-a05b-c5a809d3de82\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " Jun 10 15:34:13.405319 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.405228 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-data\") pod \"008f7fe2-8881-4d52-a05b-c5a809d3de82\" (UID: \"008f7fe2-8881-4d52-a05b-c5a809d3de82\") " Jun 10 15:34:13.405319 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.405283 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "008f7fe2-8881-4d52-a05b-c5a809d3de82" (UID: "008f7fe2-8881-4d52-a05b-c5a809d3de82"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:34:13.405319 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.405302 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/008f7fe2-8881-4d52-a05b-c5a809d3de82-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "008f7fe2-8881-4d52-a05b-c5a809d3de82" (UID: "008f7fe2-8881-4d52-a05b-c5a809d3de82"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:34:13.405656 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.405457 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "008f7fe2-8881-4d52-a05b-c5a809d3de82" (UID: "008f7fe2-8881-4d52-a05b-c5a809d3de82"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:34:13.405656 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.405596 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-data" (OuterVolumeSpecName: "istio-data") pod "008f7fe2-8881-4d52-a05b-c5a809d3de82" (UID: "008f7fe2-8881-4d52-a05b-c5a809d3de82"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:34:13.405794 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.405761 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:13.405865 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.405800 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008f7fe2-8881-4d52-a05b-c5a809d3de82-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:13.405865 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.405814 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:13.405865 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.405828 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:13.407171 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.407149 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/008f7fe2-8881-4d52-a05b-c5a809d3de82-kube-api-access-q9qw7" (OuterVolumeSpecName: "kube-api-access-q9qw7") pod "008f7fe2-8881-4d52-a05b-c5a809d3de82" (UID: "008f7fe2-8881-4d52-a05b-c5a809d3de82"). InnerVolumeSpecName "kube-api-access-q9qw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:34:13.407265 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.407190 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-token" (OuterVolumeSpecName: "istio-token") pod "008f7fe2-8881-4d52-a05b-c5a809d3de82" (UID: "008f7fe2-8881-4d52-a05b-c5a809d3de82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:34:13.407824 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.407807 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "008f7fe2-8881-4d52-a05b-c5a809d3de82" (UID: "008f7fe2-8881-4d52-a05b-c5a809d3de82"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 15:34:13.407824 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.407813 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "008f7fe2-8881-4d52-a05b-c5a809d3de82" (UID: "008f7fe2-8881-4d52-a05b-c5a809d3de82"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:34:13.496539 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.496499 2560 generic.go:356] "Generic (PLEG): container finished" podID="008f7fe2-8881-4d52-a05b-c5a809d3de82" containerID="6a2e94bc133a032ed95f20e823e6816efd0245bafe4199ffc8fc0364d0e5b895" exitCode=0 Jun 10 15:34:13.496657 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.496550 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" Jun 10 15:34:13.496657 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.496583 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" event={"ID":"008f7fe2-8881-4d52-a05b-c5a809d3de82","Type":"ContainerDied","Data":"6a2e94bc133a032ed95f20e823e6816efd0245bafe4199ffc8fc0364d0e5b895"} Jun 10 15:34:13.496657 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.496638 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9" event={"ID":"008f7fe2-8881-4d52-a05b-c5a809d3de82","Type":"ContainerDied","Data":"258e66c8d3ed1a246f0d84e8ca64e625abc26b97a13be7ffe11d976a1e6031a6"} Jun 10 15:34:13.496790 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.496660 2560 scope.go:117] "RemoveContainer" containerID="6a2e94bc133a032ed95f20e823e6816efd0245bafe4199ffc8fc0364d0e5b895" Jun 10 15:34:13.506018 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.505999 2560 scope.go:117] "RemoveContainer" containerID="6a2e94bc133a032ed95f20e823e6816efd0245bafe4199ffc8fc0364d0e5b895" Jun 10 15:34:13.506281 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:34:13.506262 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a2e94bc133a032ed95f20e823e6816efd0245bafe4199ffc8fc0364d0e5b895\": container with ID starting with 6a2e94bc133a032ed95f20e823e6816efd0245bafe4199ffc8fc0364d0e5b895 not found: ID does not exist" containerID="6a2e94bc133a032ed95f20e823e6816efd0245bafe4199ffc8fc0364d0e5b895" Jun 10 15:34:13.506344 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.506288 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a2e94bc133a032ed95f20e823e6816efd0245bafe4199ffc8fc0364d0e5b895"} err="failed to get container status \"6a2e94bc133a032ed95f20e823e6816efd0245bafe4199ffc8fc0364d0e5b895\": rpc error: code = NotFound desc = could not find container \"6a2e94bc133a032ed95f20e823e6816efd0245bafe4199ffc8fc0364d0e5b895\": container with ID starting with 6a2e94bc133a032ed95f20e823e6816efd0245bafe4199ffc8fc0364d0e5b895 not found: ID does not exist" Jun 10 15:34:13.506344 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.506325 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:13.506344 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.506341 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:13.506479 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.506350 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:13.506479 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.506358 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008f7fe2-8881-4d52-a05b-c5a809d3de82-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:13.506479 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.506366 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9qw7\" (UniqueName: \"kubernetes.io/projected/008f7fe2-8881-4d52-a05b-c5a809d3de82-kube-api-access-q9qw7\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:13.518927 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.518900 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9"] Jun 10 15:34:13.523704 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:13.523682 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-89f044fb-openshift-default-f4cf586dd-q26z9"] Jun 10 15:34:14.407093 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.407065 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:14.472383 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.472354 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:14.574789 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.574752 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd"] Jun 10 15:34:14.575204 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.575184 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="008f7fe2-8881-4d52-a05b-c5a809d3de82" containerName="istio-proxy" Jun 10 15:34:14.575342 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.575236 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="008f7fe2-8881-4d52-a05b-c5a809d3de82" containerName="istio-proxy" Jun 10 15:34:14.575420 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.575357 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="008f7fe2-8881-4d52-a05b-c5a809d3de82" containerName="istio-proxy" Jun 10 15:34:14.579930 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.579903 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.582374 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.582352 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-05351a20-openshift-default-dockercfg-s7mvt\"" Jun 10 15:34:14.593642 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.593619 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd"] Jun 10 15:34:14.615840 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.615818 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-workload-socket\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.615970 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.615859 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-workload-certs\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.615970 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.615888 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-podinfo\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.615970 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.615955 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2bp7\" (UniqueName: \"kubernetes.io/projected/c812686c-85db-4bb0-bb8e-cfca66e63b68-kube-api-access-m2bp7\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.616145 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.616010 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-data\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.616145 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.616038 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c812686c-85db-4bb0-bb8e-cfca66e63b68-istiod-ca-cert\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.616145 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.616062 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-envoy\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.616145 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.616119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-token\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.616350 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.616219 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-credential-socket\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.633087 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.633061 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:14.703298 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.703217 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:14.717647 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.717617 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-credential-socket\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.717795 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.717667 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-workload-socket\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.717795 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.717691 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-workload-certs\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.717795 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.717719 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-podinfo\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.717795 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.717739 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2bp7\" (UniqueName: \"kubernetes.io/projected/c812686c-85db-4bb0-bb8e-cfca66e63b68-kube-api-access-m2bp7\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.717795 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.717781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-data\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.718069 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.717807 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c812686c-85db-4bb0-bb8e-cfca66e63b68-istiod-ca-cert\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.718069 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.717840 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-envoy\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.718069 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.718030 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-token\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.718232 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.718086 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-credential-socket\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.718232 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.718169 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-workload-socket\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.718334 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.718273 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-data\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.718334 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.718299 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-workload-certs\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.719083 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.719059 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c812686c-85db-4bb0-bb8e-cfca66e63b68-istiod-ca-cert\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.720356 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.720338 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-envoy\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.720569 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.720550 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-podinfo\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.726102 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.726084 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-token\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.726508 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.726487 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2bp7\" (UniqueName: \"kubernetes.io/projected/c812686c-85db-4bb0-bb8e-cfca66e63b68-kube-api-access-m2bp7\") pod \"e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.807078 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.807047 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:14.853619 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.853587 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="008f7fe2-8881-4d52-a05b-c5a809d3de82" path="/var/lib/kubelet/pods/008f7fe2-8881-4d52-a05b-c5a809d3de82/volumes" Jun 10 15:34:14.892375 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.892348 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:14.900503 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:14.900468 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:15.043538 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:15.043510 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd"] Jun 10 15:34:15.045738 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:34:15.045705 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc812686c_85db_4bb0_bb8e_cfca66e63b68.slice/crio-393645f58821b72bb0d7894b9b08a7bbd4b0f61c50fd26be77a2bc536de2f582 WatchSource:0}: Error finding container 393645f58821b72bb0d7894b9b08a7bbd4b0f61c50fd26be77a2bc536de2f582: Status 404 returned error can't find the container with id 393645f58821b72bb0d7894b9b08a7bbd4b0f61c50fd26be77a2bc536de2f582 Jun 10 15:34:15.047989 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:15.047954 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:34:15.048083 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:15.048018 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:34:15.048083 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:15.048053 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 15:34:15.511627 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:15.511588 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" event={"ID":"c812686c-85db-4bb0-bb8e-cfca66e63b68","Type":"ContainerStarted","Data":"718d1e9e62fd85c61a0b8c45bcfbb5ff9d730df8fc8815e06efbc738517cf077"} Jun 10 15:34:15.512013 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:15.511682 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" event={"ID":"c812686c-85db-4bb0-bb8e-cfca66e63b68","Type":"ContainerStarted","Data":"393645f58821b72bb0d7894b9b08a7bbd4b0f61c50fd26be77a2bc536de2f582"} Jun 10 15:34:15.534731 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:15.534689 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" podStartSLOduration=1.53467414 podStartE2EDuration="1.53467414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:34:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:34:15.532881596 +0000 UTC m=+2357.119671319" watchObservedRunningTime="2026-06-10 15:34:15.53467414 +0000 UTC m=+2357.121463863" Jun 10 15:34:15.892559 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:15.892530 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:16.897566 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:16.897534 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:17.521884 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:17.521847 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:17.522900 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:17.522882 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:17.885427 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:17.885363 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:20.912823 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:20.912794 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:22.062444 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:22.062406 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd"] Jun 10 15:34:22.062831 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:22.062675 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" podUID="c812686c-85db-4bb0-bb8e-cfca66e63b68" containerName="istio-proxy" containerID="cri-o://718d1e9e62fd85c61a0b8c45bcfbb5ff9d730df8fc8815e06efbc738517cf077" gracePeriod=30 Jun 10 15:34:22.088875 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:22.088841 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:22.190468 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:22.190437 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:24.183256 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:24.183211 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:27.313220 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.313196 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:27.432503 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.432476 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-workload-socket\") pod \"c812686c-85db-4bb0-bb8e-cfca66e63b68\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " Jun 10 15:34:27.432657 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.432513 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-podinfo\") pod \"c812686c-85db-4bb0-bb8e-cfca66e63b68\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " Jun 10 15:34:27.432657 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.432577 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-data\") pod \"c812686c-85db-4bb0-bb8e-cfca66e63b68\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " Jun 10 15:34:27.432657 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.432593 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-envoy\") pod \"c812686c-85db-4bb0-bb8e-cfca66e63b68\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " Jun 10 15:34:27.432657 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.432608 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-token\") pod \"c812686c-85db-4bb0-bb8e-cfca66e63b68\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " Jun 10 15:34:27.432657 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.432640 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-credential-socket\") pod \"c812686c-85db-4bb0-bb8e-cfca66e63b68\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " Jun 10 15:34:27.432907 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.432668 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c812686c-85db-4bb0-bb8e-cfca66e63b68-istiod-ca-cert\") pod \"c812686c-85db-4bb0-bb8e-cfca66e63b68\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " Jun 10 15:34:27.432907 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.432712 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2bp7\" (UniqueName: \"kubernetes.io/projected/c812686c-85db-4bb0-bb8e-cfca66e63b68-kube-api-access-m2bp7\") pod \"c812686c-85db-4bb0-bb8e-cfca66e63b68\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " Jun 10 15:34:27.432907 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.432746 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-workload-certs\") pod \"c812686c-85db-4bb0-bb8e-cfca66e63b68\" (UID: \"c812686c-85db-4bb0-bb8e-cfca66e63b68\") " Jun 10 15:34:27.432907 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.432808 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c812686c-85db-4bb0-bb8e-cfca66e63b68" (UID: "c812686c-85db-4bb0-bb8e-cfca66e63b68"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:34:27.432907 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.432827 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-data" (OuterVolumeSpecName: "istio-data") pod "c812686c-85db-4bb0-bb8e-cfca66e63b68" (UID: "c812686c-85db-4bb0-bb8e-cfca66e63b68"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:34:27.433223 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.433115 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:27.433223 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.433120 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c812686c-85db-4bb0-bb8e-cfca66e63b68" (UID: "c812686c-85db-4bb0-bb8e-cfca66e63b68"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:34:27.433223 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.433136 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:27.433358 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.433226 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c812686c-85db-4bb0-bb8e-cfca66e63b68" (UID: "c812686c-85db-4bb0-bb8e-cfca66e63b68"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:34:27.433358 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.433256 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c812686c-85db-4bb0-bb8e-cfca66e63b68-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c812686c-85db-4bb0-bb8e-cfca66e63b68" (UID: "c812686c-85db-4bb0-bb8e-cfca66e63b68"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 15:34:27.434969 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.434938 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-token" (OuterVolumeSpecName: "istio-token") pod "c812686c-85db-4bb0-bb8e-cfca66e63b68" (UID: "c812686c-85db-4bb0-bb8e-cfca66e63b68"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:34:27.435078 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.435045 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c812686c-85db-4bb0-bb8e-cfca66e63b68-kube-api-access-m2bp7" (OuterVolumeSpecName: "kube-api-access-m2bp7") pod "c812686c-85db-4bb0-bb8e-cfca66e63b68" (UID: "c812686c-85db-4bb0-bb8e-cfca66e63b68"). InnerVolumeSpecName "kube-api-access-m2bp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:34:27.435494 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.435469 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c812686c-85db-4bb0-bb8e-cfca66e63b68" (UID: "c812686c-85db-4bb0-bb8e-cfca66e63b68"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:34:27.435494 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.435473 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c812686c-85db-4bb0-bb8e-cfca66e63b68" (UID: "c812686c-85db-4bb0-bb8e-cfca66e63b68"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 15:34:27.533755 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.533724 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:27.533755 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.533748 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:27.533755 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.533758 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:27.533959 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.533767 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c812686c-85db-4bb0-bb8e-cfca66e63b68-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:27.533959 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.533775 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2bp7\" (UniqueName: \"kubernetes.io/projected/c812686c-85db-4bb0-bb8e-cfca66e63b68-kube-api-access-m2bp7\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:27.533959 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.533783 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c812686c-85db-4bb0-bb8e-cfca66e63b68-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:27.533959 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.533791 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c812686c-85db-4bb0-bb8e-cfca66e63b68-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Jun 10 15:34:27.572023 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.571977 2560 generic.go:356] "Generic (PLEG): container finished" podID="c812686c-85db-4bb0-bb8e-cfca66e63b68" containerID="718d1e9e62fd85c61a0b8c45bcfbb5ff9d730df8fc8815e06efbc738517cf077" exitCode=0 Jun 10 15:34:27.572180 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.572024 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" Jun 10 15:34:27.572180 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.572062 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" event={"ID":"c812686c-85db-4bb0-bb8e-cfca66e63b68","Type":"ContainerDied","Data":"718d1e9e62fd85c61a0b8c45bcfbb5ff9d730df8fc8815e06efbc738517cf077"} Jun 10 15:34:27.572180 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.572123 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd" event={"ID":"c812686c-85db-4bb0-bb8e-cfca66e63b68","Type":"ContainerDied","Data":"393645f58821b72bb0d7894b9b08a7bbd4b0f61c50fd26be77a2bc536de2f582"} Jun 10 15:34:27.572180 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.572155 2560 scope.go:117] "RemoveContainer" containerID="718d1e9e62fd85c61a0b8c45bcfbb5ff9d730df8fc8815e06efbc738517cf077" Jun 10 15:34:27.581544 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.581527 2560 scope.go:117] "RemoveContainer" containerID="718d1e9e62fd85c61a0b8c45bcfbb5ff9d730df8fc8815e06efbc738517cf077" Jun 10 15:34:27.581805 ip-10-0-130-107 kubenswrapper[2560]: E0610 15:34:27.581785 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"718d1e9e62fd85c61a0b8c45bcfbb5ff9d730df8fc8815e06efbc738517cf077\": container with ID starting with 718d1e9e62fd85c61a0b8c45bcfbb5ff9d730df8fc8815e06efbc738517cf077 not found: ID does not exist" containerID="718d1e9e62fd85c61a0b8c45bcfbb5ff9d730df8fc8815e06efbc738517cf077" Jun 10 15:34:27.581854 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.581814 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"718d1e9e62fd85c61a0b8c45bcfbb5ff9d730df8fc8815e06efbc738517cf077"} err="failed to get container status \"718d1e9e62fd85c61a0b8c45bcfbb5ff9d730df8fc8815e06efbc738517cf077\": rpc error: code = NotFound desc = could not find container \"718d1e9e62fd85c61a0b8c45bcfbb5ff9d730df8fc8815e06efbc738517cf077\": container with ID starting with 718d1e9e62fd85c61a0b8c45bcfbb5ff9d730df8fc8815e06efbc738517cf077 not found: ID does not exist" Jun 10 15:34:27.594873 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.594846 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd"] Jun 10 15:34:27.605859 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:27.605838 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-05351a20-openshift-default-867d899fbd-h7pxd"] Jun 10 15:34:28.419424 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:28.419357 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:28.519351 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:28.519269 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:28.853754 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:28.853681 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c812686c-85db-4bb0-bb8e-cfca66e63b68" path="/var/lib/kubelet/pods/c812686c-85db-4bb0-bb8e-cfca66e63b68/volumes" Jun 10 15:34:39.405326 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:39.405284 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5d48895b7f-xxbb2_c8975d6d-0342-42a3-8ff0-53be1216b5af/nginx/0.log" Jun 10 15:34:40.358522 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:40.358495 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b55bf6875-s7kqb_d4ee39f9-7106-4c2f-a654-e70ffc4f86eb/copy-manifests/0.log" Jun 10 15:34:40.366526 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:40.366498 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b55bf6875-s7kqb_d4ee39f9-7106-4c2f-a654-e70ffc4f86eb/manager/0.log" Jun 10 15:34:41.893409 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:41.893356 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qqxtf_2baefecb-09ab-45b6-8c5f-194c6c8aae2b/manager/0.log" Jun 10 15:34:42.113414 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:42.113367 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vwgqd_d912a236-ccb1-4dc1-b62b-0c5c9b69c365/registry-server/0.log" Jun 10 15:34:42.232216 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:42.232121 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fs5r8_d7651f7b-8d41-4526-9e61-4739a1c4c67b/manager/0.log" Jun 10 15:34:42.463960 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:42.463933 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g7dkr_8e984def-3ace-4053-af4b-0fac97f92a9a/manager/0.log" Jun 10 15:34:42.811213 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:42.811188 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97957tmpj_514e4629-1819-44a2-b43d-bc93c2a62455/istio-proxy/0.log" Jun 10 15:34:43.274948 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:43.274922 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g849l_78d4c434-3c40-4504-a657-aab9960bdf97/istio-proxy/1.log" Jun 10 15:34:44.341613 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:44.341582 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx_eeb448d2-db04-4c8c-8ba3-062377d9be7f/storage-initializer/0.log" Jun 10 15:34:44.350600 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:44.350577 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctnczx_eeb448d2-db04-4c8c-8ba3-062377d9be7f/main/0.log" Jun 10 15:34:48.642310 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:48.642279 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:48.741049 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:48.741015 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:34:52.396043 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:52.396016 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qdpbt_ee837172-4366-4f5e-8aa0-06c0c17f0bca/global-pull-secret-syncer/0.log" Jun 10 15:34:52.452983 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:52.452955 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" Jun 10 15:34:52.550158 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:52.550133 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-107.ec2.internal_8be6d5f80eb92a9d92719a07fd96bd87/haproxy/0.log" Jun 10 15:34:56.321634 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:56.321598 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-ccstc_5b2af31b-63c7-4a09-a983-99ef7d8fa54e/sail-operator/0.log" Jun 10 15:34:57.654722 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:57.654690 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qqxtf_2baefecb-09ab-45b6-8c5f-194c6c8aae2b/manager/0.log" Jun 10 15:34:57.721630 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:57.721596 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vwgqd_d912a236-ccb1-4dc1-b62b-0c5c9b69c365/registry-server/0.log" Jun 10 15:34:57.784330 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:57.784298 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fs5r8_d7651f7b-8d41-4526-9e61-4739a1c4c67b/manager/0.log" Jun 10 15:34:57.891551 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:57.891518 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g7dkr_8e984def-3ace-4053-af4b-0fac97f92a9a/manager/0.log" Jun 10 15:34:59.015521 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:59.015367 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:34:59.024611 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:59.022768 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:34:59.029250 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:59.028515 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:34:59.033954 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:59.033926 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-224fh_792f5971-505f-4445-873d-156674dfc5b0/ovn-acl-logging/0.log" Jun 10 15:34:59.797972 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:34:59.797876 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-cx5zt_91c7173f-835f-4f26-aada-060529587c6b/cluster-monitoring-operator/0.log" Jun 10 15:35:00.176576 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:00.176552 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vm928_c90a0ad5-a2af-48ac-afd6-9823f609846f/node-exporter/0.log" Jun 10 15:35:00.199364 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:00.199333 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vm928_c90a0ad5-a2af-48ac-afd6-9823f609846f/kube-rbac-proxy/0.log" Jun 10 15:35:00.223496 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:00.223472 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vm928_c90a0ad5-a2af-48ac-afd6-9823f609846f/init-textfile/0.log" Jun 10 15:35:00.396293 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:00.396201 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a8b8792-df4e-4729-be10-794dc9b63017/prometheus/0.log" Jun 10 15:35:00.418276 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:00.418252 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a8b8792-df4e-4729-be10-794dc9b63017/config-reloader/0.log" Jun 10 15:35:00.441216 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:00.441194 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a8b8792-df4e-4729-be10-794dc9b63017/thanos-sidecar/0.log" Jun 10 15:35:00.464099 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:00.464072 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a8b8792-df4e-4729-be10-794dc9b63017/kube-rbac-proxy-web/0.log" Jun 10 15:35:00.490097 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:00.490074 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a8b8792-df4e-4729-be10-794dc9b63017/kube-rbac-proxy/0.log" Jun 10 15:35:00.517714 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:00.517683 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a8b8792-df4e-4729-be10-794dc9b63017/kube-rbac-proxy-thanos/0.log" Jun 10 15:35:00.540368 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:00.540347 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a8b8792-df4e-4729-be10-794dc9b63017/init-config-reloader/0.log" Jun 10 15:35:00.816195 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:00.816160 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:35:00.918426 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:00.918362 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:35:03.182878 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:03.182848 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/2.log" Jun 10 15:35:03.186715 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:03.186683 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mmmc2_ee1a077b-2c76-4f92-9194-a3f262e4ace8/console-operator/3.log" Jun 10 15:35:04.480713 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.480686 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-hbt98_6376fa5f-76da-4313-b051-e01d213189cc/volume-data-source-validator/0.log" Jun 10 15:35:04.514951 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.514919 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw"] Jun 10 15:35:04.515312 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.515300 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c812686c-85db-4bb0-bb8e-cfca66e63b68" containerName="istio-proxy" Jun 10 15:35:04.515362 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.515315 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c812686c-85db-4bb0-bb8e-cfca66e63b68" containerName="istio-proxy" Jun 10 15:35:04.515415 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.515399 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c812686c-85db-4bb0-bb8e-cfca66e63b68" containerName="istio-proxy" Jun 10 15:35:04.519673 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.519652 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.521910 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.521859 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wflr2\"/\"openshift-service-ca.crt\"" Jun 10 15:35:04.522768 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.522749 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wflr2\"/\"default-dockercfg-pf6ln\"" Jun 10 15:35:04.522871 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.522756 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wflr2\"/\"kube-root-ca.crt\"" Jun 10 15:35:04.528068 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.528045 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw"] Jun 10 15:35:04.548818 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.548790 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35e46b05-ef3d-4095-969a-1559ae2bd7e7-lib-modules\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.548960 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.548832 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/35e46b05-ef3d-4095-969a-1559ae2bd7e7-proc\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.548960 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.548858 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8mhl\" (UniqueName: \"kubernetes.io/projected/35e46b05-ef3d-4095-969a-1559ae2bd7e7-kube-api-access-q8mhl\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.548960 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.548939 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35e46b05-ef3d-4095-969a-1559ae2bd7e7-sys\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.549115 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.548965 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/35e46b05-ef3d-4095-969a-1559ae2bd7e7-podres\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.650363 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.650331 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35e46b05-ef3d-4095-969a-1559ae2bd7e7-sys\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.650363 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.650367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/35e46b05-ef3d-4095-969a-1559ae2bd7e7-podres\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.650646 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.650451 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35e46b05-ef3d-4095-969a-1559ae2bd7e7-lib-modules\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.650646 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.650485 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/35e46b05-ef3d-4095-969a-1559ae2bd7e7-proc\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.650646 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.650493 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35e46b05-ef3d-4095-969a-1559ae2bd7e7-sys\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.650646 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.650503 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8mhl\" (UniqueName: \"kubernetes.io/projected/35e46b05-ef3d-4095-969a-1559ae2bd7e7-kube-api-access-q8mhl\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.650646 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.650577 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/35e46b05-ef3d-4095-969a-1559ae2bd7e7-proc\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.650646 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.650615 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35e46b05-ef3d-4095-969a-1559ae2bd7e7-lib-modules\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.650646 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.650615 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/35e46b05-ef3d-4095-969a-1559ae2bd7e7-podres\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.659736 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.659700 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8mhl\" (UniqueName: \"kubernetes.io/projected/35e46b05-ef3d-4095-969a-1559ae2bd7e7-kube-api-access-q8mhl\") pod \"perf-node-gather-daemonset-xmzmw\" (UID: \"35e46b05-ef3d-4095-969a-1559ae2bd7e7\") " pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.830516 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.830415 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:04.968410 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:04.968367 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw"] Jun 10 15:35:04.970324 ip-10-0-130-107 kubenswrapper[2560]: W0610 15:35:04.970302 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod35e46b05_ef3d_4095_969a_1559ae2bd7e7.slice/crio-a957b1542501a3194cfadbfda5b39e00e80e65f4f813f06f38d5d3f29ba6af42 WatchSource:0}: Error finding container a957b1542501a3194cfadbfda5b39e00e80e65f4f813f06f38d5d3f29ba6af42: Status 404 returned error can't find the container with id a957b1542501a3194cfadbfda5b39e00e80e65f4f813f06f38d5d3f29ba6af42 Jun 10 15:35:05.762229 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:05.762189 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" event={"ID":"35e46b05-ef3d-4095-969a-1559ae2bd7e7","Type":"ContainerStarted","Data":"be87690496f2d4eceeb1a349c46a10361afbae3e0777f7a07c9b0eacd142ddd4"} Jun 10 15:35:05.762651 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:05.762239 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" event={"ID":"35e46b05-ef3d-4095-969a-1559ae2bd7e7","Type":"ContainerStarted","Data":"a957b1542501a3194cfadbfda5b39e00e80e65f4f813f06f38d5d3f29ba6af42"} Jun 10 15:35:05.762651 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:05.762326 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:05.782098 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:05.782044 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" podStartSLOduration=1.782028644 podStartE2EDuration="1.782028644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:35:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:35:05.78065753 +0000 UTC m=+2407.367447254" watchObservedRunningTime="2026-06-10 15:35:05.782028644 +0000 UTC m=+2407.368818389" Jun 10 15:35:05.920069 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:05.920037 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kckpq_fcf06589-00b6-4e3d-a60c-9023441c29b5/dns/0.log" Jun 10 15:35:05.943138 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:05.943111 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kckpq_fcf06589-00b6-4e3d-a60c-9023441c29b5/kube-rbac-proxy/0.log" Jun 10 15:35:06.036316 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:06.036242 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-72c4r_2438bf76-f556-4a2f-83c6-dcf98a216432/dns-node-resolver/0.log" Jun 10 15:35:06.758718 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:06.758684 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dbpgp_366482e2-0d37-4e7a-8344-4414bcab48d6/node-ca/0.log" Jun 10 15:35:07.836073 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:07.836047 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97957tmpj_514e4629-1819-44a2-b43d-bc93c2a62455/istio-proxy/0.log" Jun 10 15:35:08.022012 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:08.021982 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g849l_78d4c434-3c40-4504-a657-aab9960bdf97/istio-proxy/0.log" Jun 10 15:35:08.052534 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:08.052506 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g849l_78d4c434-3c40-4504-a657-aab9960bdf97/istio-proxy/1.log" Jun 10 15:35:08.865803 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:08.865775 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z7hgb_349051fb-b35b-4493-b8c0-821175071eae/serve-healthcheck-canary/0.log" Jun 10 15:35:09.428594 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:09.428565 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-4pvg5_b122c82e-bb9c-4ed6-8530-0b47dbc230b8/insights-operator/0.log" Jun 10 15:35:09.430738 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:09.430723 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-4pvg5_b122c82e-bb9c-4ed6-8530-0b47dbc230b8/insights-operator/1.log" Jun 10 15:35:09.609836 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:09.609806 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbzgk_06392e9b-65cd-4364-9c4c-14e46521b44a/kube-rbac-proxy/0.log" Jun 10 15:35:09.644298 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:09.644272 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbzgk_06392e9b-65cd-4364-9c4c-14e46521b44a/exporter/0.log" Jun 10 15:35:09.687788 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:09.687721 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mbzgk_06392e9b-65cd-4364-9c4c-14e46521b44a/extractor/0.log" Jun 10 15:35:11.776192 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:11.776165 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wflr2/perf-node-gather-daemonset-xmzmw" Jun 10 15:35:12.016097 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:12.016024 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5d48895b7f-xxbb2_c8975d6d-0342-42a3-8ff0-53be1216b5af/nginx/0.log" Jun 10 15:35:12.549321 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:12.549294 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b55bf6875-s7kqb_d4ee39f9-7106-4c2f-a654-e70ffc4f86eb/manager/0.log" Jun 10 15:35:12.578795 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:12.578771 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b55bf6875-s7kqb_d4ee39f9-7106-4c2f-a654-e70ffc4f86eb/copy-manifests/0.log" Jun 10 15:35:14.297965 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:14.297943 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7776b7cdb6-j2dbr_f2bafdf5-f34b-478e-9bcf-24fb5e5caa08/manager/0.log" Jun 10 15:35:18.777510 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:18.777479 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97957tmpj_514e4629-1819-44a2-b43d-bc93c2a62455/istio-proxy/0.log" Jun 10 15:35:18.910302 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:18.910271 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g849l_78d4c434-3c40-4504-a657-aab9960bdf97/istio-proxy/0.log" Jun 10 15:35:18.944216 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:18.944186 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g849l_78d4c434-3c40-4504-a657-aab9960bdf97/istio-proxy/1.log" Jun 10 15:35:19.922375 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:19.922328 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:35:19.975298 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:19.975271 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4plgp_443a9574-ddb3-4b8d-949a-c1fcbb4e7a36/konnectivity-agent/0.log" limit=1024 Jun 10 15:35:20.161128 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:20.161099 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97957tmpj_514e4629-1819-44a2-b43d-bc93c2a62455/istio-proxy/0.log" Jun 10 15:35:20.228492 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:20.228413 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-jqgxn_1392c32a-c09c-4879-b8c4-5d9cf4d12905/kube-storage-version-migrator-operator/1.log" Jun 10 15:35:20.229065 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:20.229046 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-jqgxn_1392c32a-c09c-4879-b8c4-5d9cf4d12905/kube-storage-version-migrator-operator/0.log" Jun 10 15:35:20.291804 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:20.291775 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g849l_78d4c434-3c40-4504-a657-aab9960bdf97/istio-proxy/0.log" Jun 10 15:35:20.324510 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:20.324485 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-g849l_78d4c434-3c40-4504-a657-aab9960bdf97/istio-proxy/1.log" Jun 10 15:35:21.606747 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:21.606719 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrdbz_96be0e35-f6f4-4074-af48-3c2600372ee9/kube-multus-additional-cni-plugins/0.log" Jun 10 15:35:21.635872 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:21.635849 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrdbz_96be0e35-f6f4-4074-af48-3c2600372ee9/egress-router-binary-copy/0.log" Jun 10 15:35:21.657772 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:21.657751 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrdbz_96be0e35-f6f4-4074-af48-3c2600372ee9/cni-plugins/0.log" Jun 10 15:35:21.679590 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:21.679570 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrdbz_96be0e35-f6f4-4074-af48-3c2600372ee9/bond-cni-plugin/0.log" Jun 10 15:35:21.701255 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:21.701234 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrdbz_96be0e35-f6f4-4074-af48-3c2600372ee9/routeoverride-cni/0.log" Jun 10 15:35:21.730252 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:21.730232 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrdbz_96be0e35-f6f4-4074-af48-3c2600372ee9/whereabouts-cni-bincopy/0.log" Jun 10 15:35:21.750158 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:21.750142 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hrdbz_96be0e35-f6f4-4074-af48-3c2600372ee9/whereabouts-cni/0.log" Jun 10 15:35:21.959397 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:21.959370 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k54c5_1328ca2f-86e3-46cf-9a7c-90aa349b46cc/kube-multus/0.log" Jun 10 15:35:22.096876 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:22.096853 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nvzzs_f54ab5dc-d0e0-453e-92f1-968e16b67c00/network-metrics-daemon/0.log" Jun 10 15:35:22.120481 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:22.120451 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nvzzs_f54ab5dc-d0e0-453e-92f1-968e16b67c00/kube-rbac-proxy/0.log" Jun 10 15:35:22.153160 ip-10-0-130-107 kubenswrapper[2560]: I0610 15:35:22.153134 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97957tmpj_514e4629-1819-44a2-b43d-bc93c2a62455/istio-proxy/0.log"