Jun 05 15:38:29.209224 ip-10-0-135-97 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 05 15:38:29.209236 ip-10-0-135-97 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 05 15:38:29.209245 ip-10-0-135-97 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 05 15:38:29.209555 ip-10-0-135-97 systemd[1]: Failed to start Kubernetes Kubelet. Jun 05 15:38:39.232734 ip-10-0-135-97 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 05 15:38:39.232746 ip-10-0-135-97 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ddbb0171ed444bb082a6c8c63cced38a -- Jun 05 15:40:58.155399 ip-10-0-135-97 systemd[1]: Starting Kubernetes Kubelet... Jun 05 15:40:58.541319 ip-10-0-135-97 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 15:40:58.541319 ip-10-0-135-97 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 15:40:58.541319 ip-10-0-135-97 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 15:40:58.541319 ip-10-0-135-97 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 15:40:58.542400 ip-10-0-135-97 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 15:40:58.542400 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.541391 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 15:40:58.546769 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546743 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:40:58.546769 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546765 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:40:58.546769 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546770 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:40:58.546769 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546774 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:40:58.546769 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546777 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:40:58.546769 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546780 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546784 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546788 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546793 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546796 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546807 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546810 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546813 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546815 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546818 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546820 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546823 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546825 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546828 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546830 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546833 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546836 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546838 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546841 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546844 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:40:58.547003 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546847 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546853 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546856 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546858 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546861 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546863 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546866 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546868 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546871 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546873 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546876 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546878 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546881 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546883 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546887 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546890 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546892 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546895 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546897 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546900 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:40:58.547491 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546903 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546905 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546908 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546910 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546913 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546915 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546919 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546923 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546926 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546930 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546933 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546936 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546938 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546941 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546943 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546945 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546948 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546950 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546953 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:40:58.547966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546955 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546958 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546960 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546963 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546965 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546968 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546970 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546974 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546976 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546979 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546981 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546984 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546986 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546988 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546991 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546993 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546996 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.546998 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547001 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:40:58.548462 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547003 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547006 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547008 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547011 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547014 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547018 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547021 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547024 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547027 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547030 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547033 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547035 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547038 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547040 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547043 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547045 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547759 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547766 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547769 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547772 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:40:58.548913 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547776 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547779 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547782 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547785 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547787 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547790 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547792 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547794 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547797 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547799 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547802 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547805 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547808 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547811 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547814 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547816 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547818 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547821 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547823 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547826 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:40:58.549419 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547829 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547831 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547834 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547836 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547838 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547841 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547844 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547846 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547848 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547851 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547853 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547856 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547859 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547862 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547865 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547869 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547873 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547876 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547879 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547882 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:40:58.549907 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547884 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547887 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547889 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547892 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547894 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547897 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547900 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547902 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547905 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547907 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547910 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547912 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547915 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547917 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547920 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547923 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547926 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547930 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547932 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:40:58.550442 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547935 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547938 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547942 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547944 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547946 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547949 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547953 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547956 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547959 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547962 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547964 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547967 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547969 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547972 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547975 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547977 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547980 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547984 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547986 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:40:58.550896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547989 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547992 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547994 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547997 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.547999 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548002 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548005 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548007 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548009 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548012 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548014 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548017 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548019 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548022 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548024 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548027 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548029 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548425 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548431 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:40:58.551361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548435 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548438 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548441 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548444 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548447 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548449 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548453 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548457 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548460 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548463 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548466 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548469 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548472 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548475 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548479 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548481 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548484 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548487 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548489 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548492 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:40:58.551809 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548494 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548497 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548500 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548502 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548505 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548508 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548510 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548513 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548516 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548518 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548520 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548523 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548525 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548528 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548530 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548533 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548535 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548538 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548541 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548543 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:40:58.552293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548545 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548548 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548555 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548559 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548561 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548563 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548566 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548570 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548572 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548574 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548577 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548579 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548582 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548584 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548587 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548589 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548592 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548595 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548597 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548600 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:40:58.552775 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548602 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548605 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548607 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548610 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548612 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548615 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548618 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548620 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548622 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548625 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548629 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548631 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548634 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548636 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548638 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548641 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548643 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548646 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548648 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548651 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:40:58.553293 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548654 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548656 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548659 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548661 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548663 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548666 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548669 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548672 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548674 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548676 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548679 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548683 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548687 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548690 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548692 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548695 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.548698 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548764 2566 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548771 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548777 2566 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 15:40:58.553852 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548782 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548788 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548792 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548799 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548805 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548808 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548811 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548815 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548818 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548821 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548824 2566 flags.go:64] FLAG: --cgroup-root="" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548827 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548830 2566 flags.go:64] FLAG: --client-ca-file="" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548834 2566 flags.go:64] FLAG: --cloud-provider="external" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548837 2566 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548841 2566 flags.go:64] FLAG: --cluster-domain="" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548844 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548847 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548850 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548854 2566 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548857 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548860 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548863 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 15:40:58.554363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548867 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548870 2566 flags.go:64] FLAG: --contention-profiling="false" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548873 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548876 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548879 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548882 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548886 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548889 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548891 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548894 2566 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548897 2566 flags.go:64] FLAG: --enable-server="true" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548900 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548904 2566 flags.go:64] FLAG: --event-burst="100" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548907 2566 flags.go:64] FLAG: --event-qps="50" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548910 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548913 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548916 2566 flags.go:64] FLAG: --eviction-hard="" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548920 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548923 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548926 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548929 2566 flags.go:64] FLAG: --eviction-soft="" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548932 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548935 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548939 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548942 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 15:40:58.554922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548945 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548948 2566 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548954 2566 flags.go:64] FLAG: --feature-gates="" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548957 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548960 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548963 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548966 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548969 2566 flags.go:64] FLAG: --healthz-port="10248" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548972 2566 flags.go:64] FLAG: --help="false" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548975 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548978 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548981 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548983 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548986 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548990 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548992 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548995 2566 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.548998 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549000 2566 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549003 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549051 2566 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549055 2566 flags.go:64] FLAG: --kube-reserved="" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549058 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549061 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 15:40:58.555581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549064 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549067 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549070 2566 flags.go:64] FLAG: --lock-file="" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549073 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549075 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549078 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549083 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549087 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549089 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549092 2566 flags.go:64] FLAG: --logging-format="text" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549096 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549099 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549102 2566 flags.go:64] FLAG: --manifest-url="" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549105 2566 flags.go:64] FLAG: --manifest-url-header="" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549109 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549112 2566 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549116 2566 flags.go:64] FLAG: --max-pods="110" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549119 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549137 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549150 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549153 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549156 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549159 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549162 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549169 2566 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 15:40:58.556175 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549172 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549175 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549178 2566 flags.go:64] FLAG: --pod-cidr="" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549180 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549185 2566 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549188 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549191 2566 flags.go:64] FLAG: --pods-per-core="0" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549194 2566 flags.go:64] FLAG: --port="10250" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549197 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549200 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0487133a080bf7fb1" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549203 2566 flags.go:64] FLAG: --qos-reserved="" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549206 2566 flags.go:64] FLAG: --read-only-port="10255" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549209 2566 flags.go:64] FLAG: --register-node="true" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549212 2566 flags.go:64] FLAG: --register-with-taints="" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549216 2566 flags.go:64] FLAG: --registry-burst="10" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549219 2566 flags.go:64] FLAG: --registry-qps="5" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549223 2566 flags.go:64] FLAG: --reserved-cpus="" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549225 2566 flags.go:64] FLAG: --reserved-memory="" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549230 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549233 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549236 2566 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549239 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549241 2566 flags.go:64] FLAG: --runonce="false" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549245 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549248 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 15:40:58.556787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549251 2566 flags.go:64] FLAG: --seccomp-default="false" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549254 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549257 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549260 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549263 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549266 2566 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549269 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549272 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549274 2566 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549277 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549280 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549283 2566 flags.go:64] FLAG: --system-cgroups="" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549286 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549291 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549294 2566 flags.go:64] FLAG: --tls-cert-file="" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549296 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549301 2566 flags.go:64] FLAG: --tls-min-version="" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549304 2566 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549307 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549310 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549313 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549315 2566 flags.go:64] FLAG: --v="2" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549319 2566 flags.go:64] FLAG: --version="false" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549324 2566 flags.go:64] FLAG: --vmodule="" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549327 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 15:40:58.557388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.549332 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549450 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549454 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549457 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549460 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549465 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549470 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549472 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549475 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549477 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549480 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549482 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549485 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549487 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549490 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549493 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549496 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549498 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549501 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549503 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:40:58.557994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549506 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549508 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549511 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549514 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549516 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549518 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549521 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549524 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549526 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549529 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549531 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549540 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549544 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549547 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549549 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549552 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549554 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549558 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549561 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549563 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:40:58.558486 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549567 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549571 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549574 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549577 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549580 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549584 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549587 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549590 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549593 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549597 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549600 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549602 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549605 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549607 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549610 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549612 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549615 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549617 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549620 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:40:58.558985 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549622 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549625 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549628 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549630 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549633 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549637 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549640 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549642 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549645 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549648 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549651 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549654 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549656 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549659 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549661 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549664 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549666 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549669 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549671 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:40:58.559450 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549674 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549676 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549678 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549681 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549684 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549686 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549689 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549691 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549694 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549696 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549698 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549701 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549703 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549706 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549708 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549710 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549713 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549715 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549720 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549722 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:40:58.559896 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549725 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.549728 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.550190 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.557259 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.557276 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.557295 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.557302 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557374 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557379 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557383 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557385 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557388 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557391 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557393 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:40:58.560415 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557396 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557399 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557402 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557405 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557408 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557410 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557413 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557415 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557418 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557421 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557423 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557426 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557429 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557433 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557437 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557440 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557443 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557446 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557448 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:40:58.560763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557451 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557454 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557457 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557460 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557463 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557466 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557469 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557471 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557474 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557476 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557478 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557481 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557485 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557488 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557491 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557493 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557496 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557498 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557501 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:40:58.561228 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557503 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557506 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557508 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557511 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557514 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557516 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557519 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557521 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557523 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557526 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557528 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557531 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557533 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557536 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557539 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557541 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557545 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557548 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557551 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557554 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:40:58.561678 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557556 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557558 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557561 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557563 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557566 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557569 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557571 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557573 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557576 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557578 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557580 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557583 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557585 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557588 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557590 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557593 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557595 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557598 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557600 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557603 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:40:58.562236 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557605 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557607 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557610 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557612 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557615 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557617 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557619 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557622 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557625 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557628 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557631 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557633 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557635 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557638 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.557643 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 15:40:58.562711 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557786 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557790 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557793 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557796 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557799 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557802 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557805 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557807 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557809 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557812 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557814 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557817 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557819 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557821 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557824 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557826 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557829 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557831 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557834 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557836 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:40:58.563089 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557839 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557841 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557843 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557847 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557850 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557853 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557857 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557859 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557868 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557871 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557874 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557876 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557879 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557882 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557885 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557887 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557890 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557892 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557894 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557897 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:40:58.563576 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557899 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557902 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557904 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557906 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557909 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557911 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557914 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557916 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557918 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557921 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557923 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557926 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557928 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557930 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557933 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557935 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557938 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557942 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557945 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:40:58.564037 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557948 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557951 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557959 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557962 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557965 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557967 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557970 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557973 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557976 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557978 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557980 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557983 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557985 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557988 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557990 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557992 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557994 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.557997 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558001 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558004 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:40:58.564496 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558006 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558009 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558011 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558014 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558016 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558019 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558021 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558024 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558027 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558030 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558032 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558035 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558037 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558039 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558042 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558049 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558052 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558054 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558057 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:40:58.564966 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:58.558059 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:40:58.565474 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.558063 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 15:40:58.565474 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.558214 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 15:40:58.565474 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.560621 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 15:40:58.565474 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.562108 2566 server.go:1019] "Starting client certificate rotation" Jun 05 15:40:58.565474 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.562239 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 15:40:58.565474 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.562835 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 15:40:58.565474 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.564783 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 15:40:58.569695 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.569668 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 15:40:58.579425 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.579408 2566 log.go:25] "Validated CRI v1 runtime API" Jun 05 15:40:58.582485 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.582471 2566 log.go:25] "Validated CRI v1 image API" Jun 05 15:40:58.583955 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.583939 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 15:40:58.586134 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.586105 2566 fs.go:135] Filesystem UUIDs: map[22e102e9-2428-48bc-9d9f-18fd54c245fa:/dev/nvme0n1p3 70098e00-7297-4c38-962f-f2bd5fd68f92:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 05 15:40:58.586192 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.586137 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 15:40:58.588874 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.588858 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 15:40:58.591205 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.591077 2566 manager.go:216] Machine: {Timestamp:2026-06-05 15:40:58.589914148 +0000 UTC m=+0.311487745 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3223193 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d43e6a0ca366df5d172b20c1332aa SystemUUID:ec2d43e6-a0ca-366d-f5d1-72b20c1332aa BootID:ddbb0171-ed44-4bb0-82a6-c8c63cced38a Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:91:78:26:f6:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:91:78:26:f6:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:cb:20:5d:1f:20 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 15:40:58.591205 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.591204 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 15:40:58.591312 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.591287 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 15:40:58.592639 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.592612 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 15:40:58.592796 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.592640 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-97.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 15:40:58.593348 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.593339 2566 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 15:40:58.593387 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.593350 2566 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 15:40:58.593387 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.593358 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 15:40:58.594109 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.594099 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 15:40:58.595182 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.595173 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 15:40:58.598588 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.598575 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 05 15:40:58.598711 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.598701 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 15:40:58.598751 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.598731 2566 kubelet.go:486] "Attempting to sync node with API server" Jun 05 15:40:58.598794 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.598751 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 15:40:58.598794 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.598766 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 15:40:58.598794 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.598775 2566 kubelet.go:398] "Adding apiserver pod source" Jun 05 15:40:58.598794 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.598783 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 15:40:58.599252 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.599240 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 15:40:58.599295 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.599260 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 15:40:58.602349 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.602325 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 15:40:58.604503 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.604485 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 15:40:58.604598 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.604524 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 15:40:58.605718 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.605701 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 15:40:58.605792 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.605723 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 15:40:58.605792 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.605732 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 15:40:58.605792 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.605739 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 15:40:58.605792 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.605753 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 15:40:58.605792 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.605761 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 15:40:58.605792 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.605773 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 15:40:58.605792 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.605780 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 15:40:58.605792 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.605790 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 15:40:58.606035 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.605799 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 15:40:58.606035 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.605825 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 15:40:58.606035 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.605834 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 15:40:58.606911 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.606900 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 15:40:58.606984 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.606915 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 15:40:58.607816 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.607790 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 15:40:58.607898 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.607790 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 15:40:58.608759 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.608738 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-szmcq" Jun 05 15:40:58.610119 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.610104 2566 server.go:1268] "Started kubelet" Jun 05 15:40:58.610211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.610178 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 15:40:58.610767 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.610278 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 15:40:58.610767 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.610354 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 15:40:58.610977 ip-10-0-135-97 systemd[1]: Started Kubernetes Kubelet. Jun 05 15:40:58.611629 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.611567 2566 server.go:310] "Adding debug handlers to kubelet server" Jun 05 15:40:58.612626 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.612609 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 15:40:58.615492 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.615477 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-97.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 15:40:58.616392 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.615493 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-97.ec2.internal.18b6399f3434ee45 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-97.ec2.internal,UID:ip-10-0-135-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-97.ec2.internal,},FirstTimestamp:2026-06-05 15:40:58.610077253 +0000 UTC m=+0.331650858,LastTimestamp:2026-06-05 15:40:58.610077253 +0000 UTC m=+0.331650858,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-97.ec2.internal,}" Jun 05 15:40:58.616488 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.616414 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-szmcq" Jun 05 15:40:58.616861 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.616844 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 15:40:58.620619 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.620605 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 15:40:58.620619 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.620610 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 15:40:58.620768 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.620671 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:58.621329 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.621314 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 15:40:58.621329 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.621322 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 15:40:58.621477 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.621335 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 15:40:58.621477 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.621406 2566 factory.go:55] Registering systemd factory Jun 05 15:40:58.621477 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.621424 2566 factory.go:223] Registration of the systemd container factory successfully Jun 05 15:40:58.621604 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.621524 2566 reconstruct.go:97] "Volume reconstruction finished" Jun 05 15:40:58.621604 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.621534 2566 reconciler.go:29] "Reconciler: start to sync state" Jun 05 15:40:58.622063 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.622047 2566 factory.go:153] Registering CRI-O factory Jun 05 15:40:58.622063 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.622065 2566 factory.go:223] Registration of the crio container factory successfully Jun 05 15:40:58.622203 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.622137 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 15:40:58.622203 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.622166 2566 factory.go:103] Registering Raw factory Jun 05 15:40:58.622203 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.622181 2566 manager.go:1196] Started watching for new ooms in manager Jun 05 15:40:58.622874 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.622857 2566 manager.go:349] Starting recovery of all containers Jun 05 15:40:58.623731 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.623449 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 15:40:58.623731 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.623628 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 15:40:58.635098 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.634981 2566 manager.go:354] Recovery completed Jun 05 15:40:58.639013 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.638996 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:40:58.641009 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.640990 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:40:58.641086 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.641032 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:40:58.641086 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.641047 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:40:58.641700 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.641683 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 15:40:58.641700 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.641697 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 15:40:58.641830 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.641717 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 05 15:40:58.641830 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.641699 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:40:58.642460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.642445 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:40:58.642514 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.642473 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:40:58.642514 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.642483 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:40:58.642795 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.642783 2566 policy_none.go:49] "None policy: Start" Jun 05 15:40:58.642845 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.642799 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 15:40:58.642845 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.642810 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 15:40:58.643825 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.643814 2566 policy_none.go:47] "Start" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.686702 2566 manager.go:337] "Starting Device Plugin manager" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.686734 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.686747 2566 server.go:87] "Starting device plugin registration server" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.687013 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.687025 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.687139 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.687250 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.687261 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.687717 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.687760 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.691647 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.692749 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.692782 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.692803 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 15:40:58.693018 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.692835 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 15:40:58.694652 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.694633 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:40:58.787689 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.787663 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:40:58.788586 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.788572 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:40:58.788661 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.788599 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:40:58.788661 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.788611 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:40:58.788661 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.788641 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.793138 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.793086 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-97.ec2.internal"] Jun 05 15:40:58.793185 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.793158 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:40:58.793905 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.793882 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:40:58.794000 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.793913 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:40:58.794000 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.793927 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:40:58.795303 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.795292 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:40:58.795420 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.795406 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.795476 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.795442 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:40:58.797021 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.797008 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:40:58.797118 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.797029 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:40:58.797118 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.797042 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:40:58.797118 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.797081 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:40:58.797118 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.797100 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:40:58.797118 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.797109 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:40:58.797756 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.797742 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.797801 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.797765 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-97.ec2.internal\": node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:58.798576 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.798561 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.798656 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.798590 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:40:58.799322 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.799309 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:40:58.799409 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.799336 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:40:58.799409 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.799360 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:40:58.814408 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.814384 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:58.814767 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.814754 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-97.ec2.internal\" not found" node="ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.818198 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.818176 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-97.ec2.internal\" not found" node="ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.823227 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.823211 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4e5bdca13dbab3fda0ef7d3c4a3c5e1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal\" (UID: \"c4e5bdca13dbab3fda0ef7d3c4a3c5e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.823307 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.823235 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd0cc1ed63e263716e517354ab58eacf-config\") pod \"kube-apiserver-proxy-ip-10-0-135-97.ec2.internal\" (UID: \"fd0cc1ed63e263716e517354ab58eacf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.823307 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.823251 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c4e5bdca13dbab3fda0ef7d3c4a3c5e1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal\" (UID: \"c4e5bdca13dbab3fda0ef7d3c4a3c5e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.914969 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:58.914922 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:58.924368 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.924339 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4e5bdca13dbab3fda0ef7d3c4a3c5e1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal\" (UID: \"c4e5bdca13dbab3fda0ef7d3c4a3c5e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.924463 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.924372 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd0cc1ed63e263716e517354ab58eacf-config\") pod \"kube-apiserver-proxy-ip-10-0-135-97.ec2.internal\" (UID: \"fd0cc1ed63e263716e517354ab58eacf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.924463 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.924388 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c4e5bdca13dbab3fda0ef7d3c4a3c5e1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal\" (UID: \"c4e5bdca13dbab3fda0ef7d3c4a3c5e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.924463 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.924443 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4e5bdca13dbab3fda0ef7d3c4a3c5e1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal\" (UID: \"c4e5bdca13dbab3fda0ef7d3c4a3c5e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.924559 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.924494 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd0cc1ed63e263716e517354ab58eacf-config\") pod \"kube-apiserver-proxy-ip-10-0-135-97.ec2.internal\" (UID: \"fd0cc1ed63e263716e517354ab58eacf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-97.ec2.internal" Jun 05 15:40:58.924559 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:58.924523 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c4e5bdca13dbab3fda0ef7d3c4a3c5e1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal\" (UID: \"c4e5bdca13dbab3fda0ef7d3c4a3c5e1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal" Jun 05 15:40:59.015612 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:59.015577 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:59.116424 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:59.116351 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:59.119498 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.119485 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal" Jun 05 15:40:59.123925 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.123906 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-97.ec2.internal" Jun 05 15:40:59.217075 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:59.217027 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:59.317602 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:59.317576 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:59.418117 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:59.418040 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:59.518440 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:59.518416 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:59.519049 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.519033 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:40:59.561489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.561470 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 15:40:59.561974 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.561615 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 15:40:59.561974 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.561647 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 15:40:59.618664 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:59.618634 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:59.622914 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.622873 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 15:35:58 +0000 UTC" deadline="2028-03-03 23:33:22.383703618 +0000 UTC" Jun 05 15:40:59.622914 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.622914 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15295h52m22.76079201s" Jun 05 15:40:59.665753 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:59.665721 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e5bdca13dbab3fda0ef7d3c4a3c5e1.slice/crio-c11c82b577e542a3c2d1838d6231fdd22956087ab013849fdfe51536cbcbe356 WatchSource:0}: Error finding container c11c82b577e542a3c2d1838d6231fdd22956087ab013849fdfe51536cbcbe356: Status 404 returned error can't find the container with id c11c82b577e542a3c2d1838d6231fdd22956087ab013849fdfe51536cbcbe356 Jun 05 15:40:59.666522 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:40:59.666500 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0cc1ed63e263716e517354ab58eacf.slice/crio-b5ac891251865f2ef666a4e7a62e42d4c1d1daa691dc314d8410e63371cc21d4 WatchSource:0}: Error finding container b5ac891251865f2ef666a4e7a62e42d4c1d1daa691dc314d8410e63371cc21d4: Status 404 returned error can't find the container with id b5ac891251865f2ef666a4e7a62e42d4c1d1daa691dc314d8410e63371cc21d4 Jun 05 15:40:59.673404 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.673387 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 15:40:59.697305 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.697259 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal" event={"ID":"c4e5bdca13dbab3fda0ef7d3c4a3c5e1","Type":"ContainerStarted","Data":"c11c82b577e542a3c2d1838d6231fdd22956087ab013849fdfe51536cbcbe356"} Jun 05 15:40:59.698203 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.698181 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-97.ec2.internal" event={"ID":"fd0cc1ed63e263716e517354ab58eacf","Type":"ContainerStarted","Data":"b5ac891251865f2ef666a4e7a62e42d4c1d1daa691dc314d8410e63371cc21d4"} Jun 05 15:40:59.719410 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:59.719381 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:59.802407 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.802375 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:40:59.820194 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:40:59.820168 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-97.ec2.internal\" not found" Jun 05 15:40:59.919968 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.919901 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:40:59.920811 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.920796 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal" Jun 05 15:40:59.933300 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.933276 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 15:40:59.934422 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.934404 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-97.ec2.internal" Jun 05 15:40:59.946603 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:40:59.946565 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 15:41:00.599976 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.599942 2566 apiserver.go:52] "Watching apiserver" Jun 05 15:41:00.607225 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.607200 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 15:41:00.609975 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.609945 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-2j7tw","openshift-multus/multus-v4zrt","openshift-network-operator/iptables-alerter-s2c2n","kube-system/global-pull-secret-syncer-6wbt4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726","openshift-cluster-node-tuning-operator/tuned-d7tfg","openshift-image-registry/node-ca-925tg","openshift-multus/network-metrics-daemon-6qpcp","openshift-network-diagnostics/network-check-target-94nrk","openshift-ovn-kubernetes/ovnkube-node-5w77r","kube-system/konnectivity-agent-k6dcc","kube-system/kube-apiserver-proxy-ip-10-0-135-97.ec2.internal","openshift-dns/node-resolver-tj9xd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal"] Jun 05 15:41:00.612529 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.612512 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-925tg" Jun 05 15:41:00.614534 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.614511 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tj9xd" Jun 05 15:41:00.614912 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.614893 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 15:41:00.615003 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.614893 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 15:41:00.615003 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.614952 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 15:41:00.615106 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.615016 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-src2q\"" Jun 05 15:41:00.616470 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.616449 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 15:41:00.616865 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.616845 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s2c2n" Jun 05 15:41:00.620448 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.618608 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rtfmd\"" Jun 05 15:41:00.620448 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.618691 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 15:41:00.620448 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.619377 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:41:00.620448 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.620095 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 15:41:00.621065 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.620749 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:00.621352 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:00.621138 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:00.621352 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.620998 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 15:41:00.621537 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.621432 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5jn9h\"" Jun 05 15:41:00.621537 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.621443 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 15:41:00.623153 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.623120 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.625206 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.625186 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 15:41:00.625393 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.625379 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 15:41:00.625447 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.625391 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 15:41:00.625504 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.625485 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jrj95\"" Jun 05 15:41:00.625590 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.625574 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.627795 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.627669 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:00.627795 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:00.627746 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:00.628235 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.628069 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 15:41:00.628235 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.628154 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2bmcj\"" Jun 05 15:41:00.628391 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.628296 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:41:00.628564 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.628547 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:41:00.629995 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.629961 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.632249 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.631966 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 15:41:00.632249 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632037 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 15:41:00.632249 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632044 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 15:41:00.632249 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632158 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 15:41:00.632464 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632300 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 15:41:00.632464 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632393 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.632791 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632769 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49be8ffd-e1cf-46cf-b32e-fec25dce31a0-serviceca\") pod \"node-ca-925tg\" (UID: \"49be8ffd-e1cf-46cf-b32e-fec25dce31a0\") " pod="openshift-image-registry/node-ca-925tg" Jun 05 15:41:00.632896 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632805 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49801bfa-cb30-4035-bcb1-96e59be88b6e-tmp-dir\") pod \"node-resolver-tj9xd\" (UID: \"49801bfa-cb30-4035-bcb1-96e59be88b6e\") " pod="openshift-dns/node-resolver-tj9xd" Jun 05 15:41:00.632896 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqjdn\" (UniqueName: \"kubernetes.io/projected/49801bfa-cb30-4035-bcb1-96e59be88b6e-kube-api-access-hqjdn\") pod \"node-resolver-tj9xd\" (UID: \"49801bfa-cb30-4035-bcb1-96e59be88b6e\") " pod="openshift-dns/node-resolver-tj9xd" Jun 05 15:41:00.632896 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632854 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/334834c4-5f95-4000-936e-c777209dcbfd-iptables-alerter-script\") pod \"iptables-alerter-s2c2n\" (UID: \"334834c4-5f95-4000-936e-c777209dcbfd\") " pod="openshift-network-operator/iptables-alerter-s2c2n" Jun 05 15:41:00.632896 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632875 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:00.633055 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632896 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-etc-selinux\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.633055 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632920 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-sys-fs\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.633055 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632940 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzj9n\" (UniqueName: \"kubernetes.io/projected/49be8ffd-e1cf-46cf-b32e-fec25dce31a0-kube-api-access-rzj9n\") pod \"node-ca-925tg\" (UID: \"49be8ffd-e1cf-46cf-b32e-fec25dce31a0\") " pod="openshift-image-registry/node-ca-925tg" Jun 05 15:41:00.633055 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.632961 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/334834c4-5f95-4000-936e-c777209dcbfd-host-slash\") pod \"iptables-alerter-s2c2n\" (UID: \"334834c4-5f95-4000-936e-c777209dcbfd\") " pod="openshift-network-operator/iptables-alerter-s2c2n" Jun 05 15:41:00.633055 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.633014 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vbmp\" (UniqueName: \"kubernetes.io/projected/334834c4-5f95-4000-936e-c777209dcbfd-kube-api-access-8vbmp\") pod \"iptables-alerter-s2c2n\" (UID: \"334834c4-5f95-4000-936e-c777209dcbfd\") " pod="openshift-network-operator/iptables-alerter-s2c2n" Jun 05 15:41:00.633252 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.633063 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-dbus\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:00.633252 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.633093 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c5s8n\"" Jun 05 15:41:00.633252 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.633101 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-kubelet-config\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:00.633252 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.633148 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 15:41:00.633252 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.633178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-socket-dir\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.633252 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.633207 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-registration-dir\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.633490 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.633233 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-device-dir\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.633490 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.633303 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49be8ffd-e1cf-46cf-b32e-fec25dce31a0-host\") pod \"node-ca-925tg\" (UID: \"49be8ffd-e1cf-46cf-b32e-fec25dce31a0\") " pod="openshift-image-registry/node-ca-925tg" Jun 05 15:41:00.633490 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.633326 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/49801bfa-cb30-4035-bcb1-96e59be88b6e-hosts-file\") pod \"node-resolver-tj9xd\" (UID: \"49801bfa-cb30-4035-bcb1-96e59be88b6e\") " pod="openshift-dns/node-resolver-tj9xd" Jun 05 15:41:00.633490 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.633349 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.633490 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.633374 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbzdz\" (UniqueName: \"kubernetes.io/projected/0ec86deb-d054-483f-b7de-1bf3a5accf75-kube-api-access-kbzdz\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.634955 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.634780 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.634955 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.634861 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 15:41:00.634955 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.634870 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dctrt\"" Jun 05 15:41:00.637060 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.636994 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 15:41:00.637060 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.637014 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 15:41:00.637220 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.637188 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 15:41:00.637220 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.637214 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-87r8x\"" Jun 05 15:41:00.637318 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.637225 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 15:41:00.637318 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.637288 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 15:41:00.637411 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.637364 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 15:41:00.637491 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.637473 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k6dcc" Jun 05 15:41:00.639570 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.639548 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:00.639671 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.639587 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 15:41:00.639671 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:00.639616 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:00.639671 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.639642 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 15:41:00.639822 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.639750 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-72x7x\"" Jun 05 15:41:00.655090 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.655064 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sm5qt" Jun 05 15:41:00.667301 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.667282 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sm5qt" Jun 05 15:41:00.723058 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.723035 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 15:41:00.734390 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734364 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-var-lib-openvswitch\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.734533 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734398 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpv5k\" (UniqueName: \"kubernetes.io/projected/249f79f0-b1d9-440c-93ea-1044fc32a7d9-kube-api-access-zpv5k\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.734533 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734423 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:00.734533 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e803e929-eed8-4115-a53d-1c3101e202bb-os-release\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.734533 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734466 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-etc-kubernetes\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.734533 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-etc-openvswitch\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.734783 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734554 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/249f79f0-b1d9-440c-93ea-1044fc32a7d9-env-overrides\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.734783 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734589 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e803e929-eed8-4115-a53d-1c3101e202bb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.734783 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734628 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49be8ffd-e1cf-46cf-b32e-fec25dce31a0-host\") pod \"node-ca-925tg\" (UID: \"49be8ffd-e1cf-46cf-b32e-fec25dce31a0\") " pod="openshift-image-registry/node-ca-925tg" Jun 05 15:41:00.734783 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734663 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-os-release\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.734783 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fzhr\" (UniqueName: \"kubernetes.io/projected/263c0a29-d16b-4966-b92d-c348f2ab1e57-kube-api-access-9fzhr\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.734783 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734708 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49be8ffd-e1cf-46cf-b32e-fec25dce31a0-host\") pod \"node-ca-925tg\" (UID: \"49be8ffd-e1cf-46cf-b32e-fec25dce31a0\") " pod="openshift-image-registry/node-ca-925tg" Jun 05 15:41:00.734783 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734713 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-systemd\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.734783 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734750 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-run\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.734783 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734781 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22404ca8-45ed-4fa2-9bc7-48ab456028ea-tmp\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.735049 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734811 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49801bfa-cb30-4035-bcb1-96e59be88b6e-tmp-dir\") pod \"node-resolver-tj9xd\" (UID: \"49801bfa-cb30-4035-bcb1-96e59be88b6e\") " pod="openshift-dns/node-resolver-tj9xd" Jun 05 15:41:00.735049 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/334834c4-5f95-4000-936e-c777209dcbfd-iptables-alerter-script\") pod \"iptables-alerter-s2c2n\" (UID: \"334834c4-5f95-4000-936e-c777209dcbfd\") " pod="openshift-network-operator/iptables-alerter-s2c2n" Jun 05 15:41:00.735049 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734861 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cdgx\" (UniqueName: \"kubernetes.io/projected/e803e929-eed8-4115-a53d-1c3101e202bb-kube-api-access-6cdgx\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.735049 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734883 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/263c0a29-d16b-4966-b92d-c348f2ab1e57-multus-daemon-config\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.735049 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734905 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-run-netns\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.735049 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734925 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/249f79f0-b1d9-440c-93ea-1044fc32a7d9-ovnkube-script-lib\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.735049 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734947 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-tuned\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.735049 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734970 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzj9n\" (UniqueName: \"kubernetes.io/projected/49be8ffd-e1cf-46cf-b32e-fec25dce31a0-kube-api-access-rzj9n\") pod \"node-ca-925tg\" (UID: \"49be8ffd-e1cf-46cf-b32e-fec25dce31a0\") " pod="openshift-image-registry/node-ca-925tg" Jun 05 15:41:00.735049 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.734995 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vbmp\" (UniqueName: \"kubernetes.io/projected/334834c4-5f95-4000-936e-c777209dcbfd-kube-api-access-8vbmp\") pod \"iptables-alerter-s2c2n\" (UID: \"334834c4-5f95-4000-936e-c777209dcbfd\") " pod="openshift-network-operator/iptables-alerter-s2c2n" Jun 05 15:41:00.735049 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735027 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-run-systemd\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.735049 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735048 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-run-openvswitch\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.735499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735071 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e803e929-eed8-4115-a53d-1c3101e202bb-system-cni-dir\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.735499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-var-lib-cni-bin\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.735499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735119 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49801bfa-cb30-4035-bcb1-96e59be88b6e-tmp-dir\") pod \"node-resolver-tj9xd\" (UID: \"49801bfa-cb30-4035-bcb1-96e59be88b6e\") " pod="openshift-dns/node-resolver-tj9xd" Jun 05 15:41:00.735499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735118 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-cni-netd\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.735499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735208 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-sys\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.735499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735232 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e803e929-eed8-4115-a53d-1c3101e202bb-cnibin\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.735499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735254 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-cnibin\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.735499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735275 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-var-lib-cni-multus\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.735499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735299 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-systemd-units\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.735499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735319 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-node-log\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.735499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735342 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/249f79f0-b1d9-440c-93ea-1044fc32a7d9-ovnkube-config\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.735499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49be8ffd-e1cf-46cf-b32e-fec25dce31a0-serviceca\") pod \"node-ca-925tg\" (UID: \"49be8ffd-e1cf-46cf-b32e-fec25dce31a0\") " pod="openshift-image-registry/node-ca-925tg" Jun 05 15:41:00.735499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735419 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqjdn\" (UniqueName: \"kubernetes.io/projected/49801bfa-cb30-4035-bcb1-96e59be88b6e-kube-api-access-hqjdn\") pod \"node-resolver-tj9xd\" (UID: \"49801bfa-cb30-4035-bcb1-96e59be88b6e\") " pod="openshift-dns/node-resolver-tj9xd" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735591 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-sys-fs\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735615 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-hostroot\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735638 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-sys-fs\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735647 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f85be694-2e55-4684-aee7-ece43d2433b3-konnectivity-ca\") pod \"konnectivity-agent-k6dcc\" (UID: \"f85be694-2e55-4684-aee7-ece43d2433b3\") " pod="kube-system/konnectivity-agent-k6dcc" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735685 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2694\" (UniqueName: \"kubernetes.io/projected/22404ca8-45ed-4fa2-9bc7-48ab456028ea-kube-api-access-z2694\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djlrn\" (UniqueName: \"kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn\") pod \"network-check-target-94nrk\" (UID: \"3614757c-42a4-46ae-940c-34226bfca9bd\") " pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735720 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/334834c4-5f95-4000-936e-c777209dcbfd-iptables-alerter-script\") pod \"iptables-alerter-s2c2n\" (UID: \"334834c4-5f95-4000-936e-c777209dcbfd\") " pod="openshift-network-operator/iptables-alerter-s2c2n" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735739 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-var-lib-kubelet\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735763 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-run-multus-certs\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735796 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-log-socket\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735807 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49be8ffd-e1cf-46cf-b32e-fec25dce31a0-serviceca\") pod \"node-ca-925tg\" (UID: \"49be8ffd-e1cf-46cf-b32e-fec25dce31a0\") " pod="openshift-image-registry/node-ca-925tg" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735812 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f85be694-2e55-4684-aee7-ece43d2433b3-agent-certs\") pod \"konnectivity-agent-k6dcc\" (UID: \"f85be694-2e55-4684-aee7-ece43d2433b3\") " pod="kube-system/konnectivity-agent-k6dcc" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735849 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmx6p\" (UniqueName: \"kubernetes.io/projected/973dde84-849e-4b5d-97f1-994ab561fe40-kube-api-access-vmx6p\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735875 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-sysconfig\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735890 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-sysctl-d\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-host\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.736062 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735923 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-socket-dir\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735947 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735964 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735978 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/263c0a29-d16b-4966-b92d-c348f2ab1e57-cni-binary-copy\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.735996 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-kubelet\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736021 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736027 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-socket-dir\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-etc-selinux\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736056 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e803e929-eed8-4115-a53d-1c3101e202bb-cni-binary-copy\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736092 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-multus-conf-dir\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:00.736120 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736164 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-etc-selinux\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:00.736193 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret podName:3ce4e623-49e2-4c40-ae0d-9683a4cd75fa nodeName:}" failed. No retries permitted until 2026-06-05 15:41:01.236179624 +0000 UTC m=+2.957753209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret") pod "global-pull-secret-syncer-6wbt4" (UID: "3ce4e623-49e2-4c40-ae0d-9683a4cd75fa") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736136 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/249f79f0-b1d9-440c-93ea-1044fc32a7d9-ovn-node-metrics-cert\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736223 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-var-lib-kubelet\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.736672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736254 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-run-ovn\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736271 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/334834c4-5f95-4000-936e-c777209dcbfd-host-slash\") pod \"iptables-alerter-s2c2n\" (UID: \"334834c4-5f95-4000-936e-c777209dcbfd\") " pod="openshift-network-operator/iptables-alerter-s2c2n" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736289 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-dbus\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736330 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-multus-cni-dir\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736332 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/334834c4-5f95-4000-936e-c777209dcbfd-host-slash\") pod \"iptables-alerter-s2c2n\" (UID: \"334834c4-5f95-4000-936e-c777209dcbfd\") " pod="openshift-network-operator/iptables-alerter-s2c2n" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736359 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-run-k8s-cni-cncf-io\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736384 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-dbus\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736395 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-run-netns\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-lib-modules\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736428 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-kubelet-config\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736448 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-registration-dir\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736468 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-device-dir\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736487 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e803e929-eed8-4115-a53d-1c3101e202bb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736497 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-registration-dir\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736498 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-kubelet-config\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-slash\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736536 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-cni-bin\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.737148 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736542 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ec86deb-d054-483f-b7de-1bf3a5accf75-device-dir\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.737599 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736558 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/49801bfa-cb30-4035-bcb1-96e59be88b6e-hosts-file\") pod \"node-resolver-tj9xd\" (UID: \"49801bfa-cb30-4035-bcb1-96e59be88b6e\") " pod="openshift-dns/node-resolver-tj9xd" Jun 05 15:41:00.737599 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbzdz\" (UniqueName: \"kubernetes.io/projected/0ec86deb-d054-483f-b7de-1bf3a5accf75-kube-api-access-kbzdz\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.737599 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e803e929-eed8-4115-a53d-1c3101e202bb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.737599 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736620 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/49801bfa-cb30-4035-bcb1-96e59be88b6e-hosts-file\") pod \"node-resolver-tj9xd\" (UID: \"49801bfa-cb30-4035-bcb1-96e59be88b6e\") " pod="openshift-dns/node-resolver-tj9xd" Jun 05 15:41:00.737599 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736617 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.737599 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736647 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-modprobe-d\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.737599 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736677 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-kubernetes\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.737599 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736695 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-sysctl-conf\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.737599 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736709 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-system-cni-dir\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.737599 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.736722 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-multus-socket-dir-parent\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.740579 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.740560 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 15:41:00.743509 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.743489 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vbmp\" (UniqueName: \"kubernetes.io/projected/334834c4-5f95-4000-936e-c777209dcbfd-kube-api-access-8vbmp\") pod \"iptables-alerter-s2c2n\" (UID: \"334834c4-5f95-4000-936e-c777209dcbfd\") " pod="openshift-network-operator/iptables-alerter-s2c2n" Jun 05 15:41:00.743509 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.743503 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzj9n\" (UniqueName: \"kubernetes.io/projected/49be8ffd-e1cf-46cf-b32e-fec25dce31a0-kube-api-access-rzj9n\") pod \"node-ca-925tg\" (UID: \"49be8ffd-e1cf-46cf-b32e-fec25dce31a0\") " pod="openshift-image-registry/node-ca-925tg" Jun 05 15:41:00.743683 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.743521 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqjdn\" (UniqueName: \"kubernetes.io/projected/49801bfa-cb30-4035-bcb1-96e59be88b6e-kube-api-access-hqjdn\") pod \"node-resolver-tj9xd\" (UID: \"49801bfa-cb30-4035-bcb1-96e59be88b6e\") " pod="openshift-dns/node-resolver-tj9xd" Jun 05 15:41:00.746789 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.746769 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbzdz\" (UniqueName: \"kubernetes.io/projected/0ec86deb-d054-483f-b7de-1bf3a5accf75-kube-api-access-kbzdz\") pod \"aws-ebs-csi-driver-node-9j726\" (UID: \"0ec86deb-d054-483f-b7de-1bf3a5accf75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.836984 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.836951 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e803e929-eed8-4115-a53d-1c3101e202bb-os-release\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.837189 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.836992 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-etc-kubernetes\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.837189 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837015 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-etc-openvswitch\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.837189 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837065 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e803e929-eed8-4115-a53d-1c3101e202bb-os-release\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.837189 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837091 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-etc-kubernetes\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.837189 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837146 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-etc-openvswitch\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.837189 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837192 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/249f79f0-b1d9-440c-93ea-1044fc32a7d9-env-overrides\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.837499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e803e929-eed8-4115-a53d-1c3101e202bb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.837499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837237 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-os-release\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.837499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837264 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fzhr\" (UniqueName: \"kubernetes.io/projected/263c0a29-d16b-4966-b92d-c348f2ab1e57-kube-api-access-9fzhr\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.837499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837286 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-systemd\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.837499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837311 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-run\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.837499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837323 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-os-release\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.837499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837332 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22404ca8-45ed-4fa2-9bc7-48ab456028ea-tmp\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.837499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837432 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e803e929-eed8-4115-a53d-1c3101e202bb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.837499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cdgx\" (UniqueName: \"kubernetes.io/projected/e803e929-eed8-4115-a53d-1c3101e202bb-kube-api-access-6cdgx\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.837499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837471 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-run\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.837499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837488 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/263c0a29-d16b-4966-b92d-c348f2ab1e57-multus-daemon-config\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837512 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-run-netns\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837516 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-systemd\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837535 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/249f79f0-b1d9-440c-93ea-1044fc32a7d9-ovnkube-script-lib\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837558 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-tuned\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837581 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-run-systemd\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837605 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-run-openvswitch\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837625 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e803e929-eed8-4115-a53d-1c3101e202bb-system-cni-dir\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837630 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-run-netns\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837646 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-var-lib-cni-bin\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837668 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-cni-netd\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837688 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-sys\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837732 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e803e929-eed8-4115-a53d-1c3101e202bb-system-cni-dir\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-sys\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837774 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e803e929-eed8-4115-a53d-1c3101e202bb-cnibin\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837776 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-run-openvswitch\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837787 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-run-systemd\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837799 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-cnibin\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.837985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837826 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-var-lib-cni-multus\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837834 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e803e929-eed8-4115-a53d-1c3101e202bb-cnibin\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837849 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-systemd-units\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837861 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-var-lib-cni-bin\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837873 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-node-log\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837896 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/249f79f0-b1d9-440c-93ea-1044fc32a7d9-ovnkube-config\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837904 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-var-lib-cni-multus\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837922 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-cnibin\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837922 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-hostroot\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837948 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-systemd-units\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837958 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-hostroot\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837964 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f85be694-2e55-4684-aee7-ece43d2433b3-konnectivity-ca\") pod \"konnectivity-agent-k6dcc\" (UID: \"f85be694-2e55-4684-aee7-ece43d2433b3\") " pod="kube-system/konnectivity-agent-k6dcc" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837826 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-cni-netd\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837971 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/249f79f0-b1d9-440c-93ea-1044fc32a7d9-env-overrides\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837992 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-node-log\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.837998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2694\" (UniqueName: \"kubernetes.io/projected/22404ca8-45ed-4fa2-9bc7-48ab456028ea-kube-api-access-z2694\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838037 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djlrn\" (UniqueName: \"kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn\") pod \"network-check-target-94nrk\" (UID: \"3614757c-42a4-46ae-940c-34226bfca9bd\") " pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838050 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/263c0a29-d16b-4966-b92d-c348f2ab1e57-multus-daemon-config\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.838876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838066 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-var-lib-kubelet\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838097 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-run-multus-certs\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838121 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-log-socket\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838161 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f85be694-2e55-4684-aee7-ece43d2433b3-agent-certs\") pod \"konnectivity-agent-k6dcc\" (UID: \"f85be694-2e55-4684-aee7-ece43d2433b3\") " pod="kube-system/konnectivity-agent-k6dcc" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838175 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-run-multus-certs\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838186 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmx6p\" (UniqueName: \"kubernetes.io/projected/973dde84-849e-4b5d-97f1-994ab561fe40-kube-api-access-vmx6p\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838210 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-sysconfig\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838217 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-log-socket\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838232 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-sysctl-d\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838253 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-host\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838277 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838304 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/263c0a29-d16b-4966-b92d-c348f2ab1e57-cni-binary-copy\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838307 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-var-lib-kubelet\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838338 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-kubelet\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838375 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e803e929-eed8-4115-a53d-1c3101e202bb-cni-binary-copy\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838398 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-multus-conf-dir\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838421 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/249f79f0-b1d9-440c-93ea-1044fc32a7d9-ovn-node-metrics-cert\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.839714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838444 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-var-lib-kubelet\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838443 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/249f79f0-b1d9-440c-93ea-1044fc32a7d9-ovnkube-script-lib\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838466 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-run-ovn\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838491 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-multus-cni-dir\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838507 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-multus-conf-dir\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838515 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-run-k8s-cni-cncf-io\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838526 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f85be694-2e55-4684-aee7-ece43d2433b3-konnectivity-ca\") pod \"konnectivity-agent-k6dcc\" (UID: \"f85be694-2e55-4684-aee7-ece43d2433b3\") " pod="kube-system/konnectivity-agent-k6dcc" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838533 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/249f79f0-b1d9-440c-93ea-1044fc32a7d9-ovnkube-config\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838541 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-run-netns\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838547 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-kubelet\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838566 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-lib-modules\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838629 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e803e929-eed8-4115-a53d-1c3101e202bb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838660 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-slash\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838685 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-cni-bin\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838714 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e803e929-eed8-4115-a53d-1c3101e202bb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838740 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838750 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/263c0a29-d16b-4966-b92d-c348f2ab1e57-cni-binary-copy\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.840489 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-modprobe-d\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838769 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-var-lib-kubelet\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838785 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-kubernetes\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838847 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-host\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838832 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-kubernetes\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838879 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-sysctl-conf\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838885 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-sysctl-d\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838908 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-system-cni-dir\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838917 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-multus-cni-dir\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838930 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838933 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-multus-socket-dir-parent\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838958 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-run-k8s-cni-cncf-io\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838966 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-var-lib-openvswitch\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.838991 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpv5k\" (UniqueName: \"kubernetes.io/projected/249f79f0-b1d9-440c-93ea-1044fc32a7d9-kube-api-access-zpv5k\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839008 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-host-run-netns\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839020 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839066 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e803e929-eed8-4115-a53d-1c3101e202bb-cni-binary-copy\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839099 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-lib-modules\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.841211 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:00.839116 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839159 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-run-ovn\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:00.839185 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs podName:973dde84-849e-4b5d-97f1-994ab561fe40 nodeName:}" failed. No retries permitted until 2026-06-05 15:41:01.339167494 +0000 UTC m=+3.060741080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs") pod "network-metrics-daemon-6qpcp" (UID: "973dde84-849e-4b5d-97f1-994ab561fe40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839219 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-var-lib-openvswitch\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839227 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-slash\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839273 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-cni-bin\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839498 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-multus-socket-dir-parent\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839578 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e803e929-eed8-4115-a53d-1c3101e202bb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839587 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/263c0a29-d16b-4966-b92d-c348f2ab1e57-system-cni-dir\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839639 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-sysconfig\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839657 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-sysctl-conf\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839682 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-modprobe-d\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839692 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e803e929-eed8-4115-a53d-1c3101e202bb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.839722 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/249f79f0-b1d9-440c-93ea-1044fc32a7d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.840277 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22404ca8-45ed-4fa2-9bc7-48ab456028ea-tmp\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.841068 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f85be694-2e55-4684-aee7-ece43d2433b3-agent-certs\") pod \"konnectivity-agent-k6dcc\" (UID: \"f85be694-2e55-4684-aee7-ece43d2433b3\") " pod="kube-system/konnectivity-agent-k6dcc" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.841159 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/22404ca8-45ed-4fa2-9bc7-48ab456028ea-etc-tuned\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.841878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.841846 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/249f79f0-b1d9-440c-93ea-1044fc32a7d9-ovn-node-metrics-cert\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.843573 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:00.843555 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:41:00.843573 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:00.843577 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:41:00.843711 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:00.843588 2566 projected.go:196] Error preparing data for projected volume kube-api-access-djlrn for pod openshift-network-diagnostics/network-check-target-94nrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:00.843711 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:00.843666 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn podName:3614757c-42a4-46ae-940c-34226bfca9bd nodeName:}" failed. No retries permitted until 2026-06-05 15:41:01.343652057 +0000 UTC m=+3.065225662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-djlrn" (UniqueName: "kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn") pod "network-check-target-94nrk" (UID: "3614757c-42a4-46ae-940c-34226bfca9bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:00.847017 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.846993 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fzhr\" (UniqueName: \"kubernetes.io/projected/263c0a29-d16b-4966-b92d-c348f2ab1e57-kube-api-access-9fzhr\") pod \"multus-v4zrt\" (UID: \"263c0a29-d16b-4966-b92d-c348f2ab1e57\") " pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.847310 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.847283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cdgx\" (UniqueName: \"kubernetes.io/projected/e803e929-eed8-4115-a53d-1c3101e202bb-kube-api-access-6cdgx\") pod \"multus-additional-cni-plugins-2j7tw\" (UID: \"e803e929-eed8-4115-a53d-1c3101e202bb\") " pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.848460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.848436 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpv5k\" (UniqueName: \"kubernetes.io/projected/249f79f0-b1d9-440c-93ea-1044fc32a7d9-kube-api-access-zpv5k\") pod \"ovnkube-node-5w77r\" (UID: \"249f79f0-b1d9-440c-93ea-1044fc32a7d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.849720 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.849697 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmx6p\" (UniqueName: \"kubernetes.io/projected/973dde84-849e-4b5d-97f1-994ab561fe40-kube-api-access-vmx6p\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:00.851060 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.851014 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2694\" (UniqueName: \"kubernetes.io/projected/22404ca8-45ed-4fa2-9bc7-48ab456028ea-kube-api-access-z2694\") pod \"tuned-d7tfg\" (UID: \"22404ca8-45ed-4fa2-9bc7-48ab456028ea\") " pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.924905 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.924868 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-925tg" Jun 05 15:41:00.931587 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.931559 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tj9xd" Jun 05 15:41:00.942235 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.942213 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s2c2n" Jun 05 15:41:00.946746 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.946726 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" Jun 05 15:41:00.954296 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.954276 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" Jun 05 15:41:00.959921 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.959905 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2j7tw" Jun 05 15:41:00.966560 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.966542 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v4zrt" Jun 05 15:41:00.973206 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.973184 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:00.977779 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:00.977751 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k6dcc" Jun 05 15:41:01.242382 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.242300 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:01.242553 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:01.242445 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:01.242553 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:01.242530 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret podName:3ce4e623-49e2-4c40-ae0d-9683a4cd75fa nodeName:}" failed. No retries permitted until 2026-06-05 15:41:02.242510911 +0000 UTC m=+3.964084504 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret") pod "global-pull-secret-syncer-6wbt4" (UID: "3ce4e623-49e2-4c40-ae0d-9683a4cd75fa") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:01.331993 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.331965 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:41:01.342895 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.342864 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:01.343049 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:01.343019 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:01.343109 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:01.343079 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs podName:973dde84-849e-4b5d-97f1-994ab561fe40 nodeName:}" failed. No retries permitted until 2026-06-05 15:41:02.343064003 +0000 UTC m=+4.064637593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs") pod "network-metrics-daemon-6qpcp" (UID: "973dde84-849e-4b5d-97f1-994ab561fe40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:01.439335 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:41:01.439224 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334834c4_5f95_4000_936e_c777209dcbfd.slice/crio-1f759de29229236d96caa92480968618942434243c77f88301cfb2d0cbd9f3e1 WatchSource:0}: Error finding container 1f759de29229236d96caa92480968618942434243c77f88301cfb2d0cbd9f3e1: Status 404 returned error can't find the container with id 1f759de29229236d96caa92480968618942434243c77f88301cfb2d0cbd9f3e1 Jun 05 15:41:01.440785 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:41:01.440761 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249f79f0_b1d9_440c_93ea_1044fc32a7d9.slice/crio-342cdeef7c2be39ab85121ed969ec8fd0de8916799ac2297c96d81e938603c13 WatchSource:0}: Error finding container 342cdeef7c2be39ab85121ed969ec8fd0de8916799ac2297c96d81e938603c13: Status 404 returned error can't find the container with id 342cdeef7c2be39ab85121ed969ec8fd0de8916799ac2297c96d81e938603c13 Jun 05 15:41:01.441279 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:41:01.441254 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85be694_2e55_4684_aee7_ece43d2433b3.slice/crio-6c59be0deaf2bf806829603c14213242a7c179236008183a39d21437cc842bf6 WatchSource:0}: Error finding container 6c59be0deaf2bf806829603c14213242a7c179236008183a39d21437cc842bf6: Status 404 returned error can't find the container with id 6c59be0deaf2bf806829603c14213242a7c179236008183a39d21437cc842bf6 Jun 05 15:41:01.443285 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.443261 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djlrn\" (UniqueName: \"kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn\") pod \"network-check-target-94nrk\" (UID: \"3614757c-42a4-46ae-940c-34226bfca9bd\") " pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:01.443459 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:01.443440 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:41:01.443569 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:01.443465 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:41:01.443569 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:01.443479 2566 projected.go:196] Error preparing data for projected volume kube-api-access-djlrn for pod openshift-network-diagnostics/network-check-target-94nrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:01.443569 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:01.443533 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn podName:3614757c-42a4-46ae-940c-34226bfca9bd nodeName:}" failed. No retries permitted until 2026-06-05 15:41:02.443512905 +0000 UTC m=+4.165086493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-djlrn" (UniqueName: "kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn") pod "network-check-target-94nrk" (UID: "3614757c-42a4-46ae-940c-34226bfca9bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:01.443784 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:41:01.443756 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec86deb_d054_483f_b7de_1bf3a5accf75.slice/crio-715d3624a5670ef95ff7aacf0f819b1a631612a889e6988c67319b4994f8c695 WatchSource:0}: Error finding container 715d3624a5670ef95ff7aacf0f819b1a631612a889e6988c67319b4994f8c695: Status 404 returned error can't find the container with id 715d3624a5670ef95ff7aacf0f819b1a631612a889e6988c67319b4994f8c695 Jun 05 15:41:01.444979 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:41:01.444801 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod263c0a29_d16b_4966_b92d_c348f2ab1e57.slice/crio-9e3921c4637b19fa3d35216d433dfd330376603f4b0194227c6b54fb5cce322f WatchSource:0}: Error finding container 9e3921c4637b19fa3d35216d433dfd330376603f4b0194227c6b54fb5cce322f: Status 404 returned error can't find the container with id 9e3921c4637b19fa3d35216d433dfd330376603f4b0194227c6b54fb5cce322f Jun 05 15:41:01.445951 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:41:01.445833 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22404ca8_45ed_4fa2_9bc7_48ab456028ea.slice/crio-3375189b36be79b505c1a988b17294ae09995dad4fe57c046bc5159ed37dcfa0 WatchSource:0}: Error finding container 3375189b36be79b505c1a988b17294ae09995dad4fe57c046bc5159ed37dcfa0: Status 404 returned error can't find the container with id 3375189b36be79b505c1a988b17294ae09995dad4fe57c046bc5159ed37dcfa0 Jun 05 15:41:01.447706 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:41:01.447687 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49be8ffd_e1cf_46cf_b32e_fec25dce31a0.slice/crio-85efe5e8430b170a015794a8571224310322792744df6b9976b760874802459b WatchSource:0}: Error finding container 85efe5e8430b170a015794a8571224310322792744df6b9976b760874802459b: Status 404 returned error can't find the container with id 85efe5e8430b170a015794a8571224310322792744df6b9976b760874802459b Jun 05 15:41:01.448111 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:41:01.448091 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode803e929_eed8_4115_a53d_1c3101e202bb.slice/crio-98ed3fd33ea9d8a96506306c310e7f87cf8fe6e8236b891028426be00c0dc299 WatchSource:0}: Error finding container 98ed3fd33ea9d8a96506306c310e7f87cf8fe6e8236b891028426be00c0dc299: Status 404 returned error can't find the container with id 98ed3fd33ea9d8a96506306c310e7f87cf8fe6e8236b891028426be00c0dc299 Jun 05 15:41:01.450623 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:41:01.450597 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49801bfa_cb30_4035_bcb1_96e59be88b6e.slice/crio-87a668f955709ccbe495f553ba6512ae276174294cf17ed7b22edc0547079b8b WatchSource:0}: Error finding container 87a668f955709ccbe495f553ba6512ae276174294cf17ed7b22edc0547079b8b: Status 404 returned error can't find the container with id 87a668f955709ccbe495f553ba6512ae276174294cf17ed7b22edc0547079b8b Jun 05 15:41:01.670351 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.670094 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 15:36:00 +0000 UTC" deadline="2027-11-16 12:54:18.544417086 +0000 UTC" Jun 05 15:41:01.670351 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.670350 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12693h13m16.874073629s" Jun 05 15:41:01.693557 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.693529 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:01.693691 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:01.693637 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:01.703172 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.703115 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" event={"ID":"0ec86deb-d054-483f-b7de-1bf3a5accf75","Type":"ContainerStarted","Data":"715d3624a5670ef95ff7aacf0f819b1a631612a889e6988c67319b4994f8c695"} Jun 05 15:41:01.704224 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.704200 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k6dcc" event={"ID":"f85be694-2e55-4684-aee7-ece43d2433b3","Type":"ContainerStarted","Data":"6c59be0deaf2bf806829603c14213242a7c179236008183a39d21437cc842bf6"} Jun 05 15:41:01.705171 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.705151 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" event={"ID":"249f79f0-b1d9-440c-93ea-1044fc32a7d9","Type":"ContainerStarted","Data":"342cdeef7c2be39ab85121ed969ec8fd0de8916799ac2297c96d81e938603c13"} Jun 05 15:41:01.706094 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.706069 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s2c2n" event={"ID":"334834c4-5f95-4000-936e-c777209dcbfd","Type":"ContainerStarted","Data":"1f759de29229236d96caa92480968618942434243c77f88301cfb2d0cbd9f3e1"} Jun 05 15:41:01.707088 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.707069 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tj9xd" event={"ID":"49801bfa-cb30-4035-bcb1-96e59be88b6e","Type":"ContainerStarted","Data":"87a668f955709ccbe495f553ba6512ae276174294cf17ed7b22edc0547079b8b"} Jun 05 15:41:01.708026 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.708007 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j7tw" event={"ID":"e803e929-eed8-4115-a53d-1c3101e202bb","Type":"ContainerStarted","Data":"98ed3fd33ea9d8a96506306c310e7f87cf8fe6e8236b891028426be00c0dc299"} Jun 05 15:41:01.708869 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.708840 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" event={"ID":"22404ca8-45ed-4fa2-9bc7-48ab456028ea","Type":"ContainerStarted","Data":"3375189b36be79b505c1a988b17294ae09995dad4fe57c046bc5159ed37dcfa0"} Jun 05 15:41:01.710321 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.710302 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-97.ec2.internal" event={"ID":"fd0cc1ed63e263716e517354ab58eacf","Type":"ContainerStarted","Data":"0bb7682e0fddd3950ac25fbf108e5fc3eeb77c19433e7e8825638860b1865181"} Jun 05 15:41:01.711742 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.711372 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-925tg" event={"ID":"49be8ffd-e1cf-46cf-b32e-fec25dce31a0","Type":"ContainerStarted","Data":"85efe5e8430b170a015794a8571224310322792744df6b9976b760874802459b"} Jun 05 15:41:01.712482 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.712459 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v4zrt" event={"ID":"263c0a29-d16b-4966-b92d-c348f2ab1e57","Type":"ContainerStarted","Data":"9e3921c4637b19fa3d35216d433dfd330376603f4b0194227c6b54fb5cce322f"} Jun 05 15:41:01.727312 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:01.727269 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-97.ec2.internal" podStartSLOduration=2.727254666 podStartE2EDuration="2.727254666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:40:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:01.72539425 +0000 UTC m=+3.446967856" watchObservedRunningTime="2026-06-05 15:41:01.727254666 +0000 UTC m=+3.448828271" Jun 05 15:41:02.249224 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:02.249183 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:02.249412 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:02.249359 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:02.249488 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:02.249422 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret podName:3ce4e623-49e2-4c40-ae0d-9683a4cd75fa nodeName:}" failed. No retries permitted until 2026-06-05 15:41:04.249403426 +0000 UTC m=+5.970977016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret") pod "global-pull-secret-syncer-6wbt4" (UID: "3ce4e623-49e2-4c40-ae0d-9683a4cd75fa") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:02.350087 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:02.349713 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:02.350087 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:02.349871 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:02.350087 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:02.349939 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs podName:973dde84-849e-4b5d-97f1-994ab561fe40 nodeName:}" failed. No retries permitted until 2026-06-05 15:41:04.349919989 +0000 UTC m=+6.071493574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs") pod "network-metrics-daemon-6qpcp" (UID: "973dde84-849e-4b5d-97f1-994ab561fe40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:02.450349 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:02.450310 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djlrn\" (UniqueName: \"kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn\") pod \"network-check-target-94nrk\" (UID: \"3614757c-42a4-46ae-940c-34226bfca9bd\") " pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:02.450561 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:02.450543 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:41:02.450660 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:02.450570 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:41:02.450660 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:02.450590 2566 projected.go:196] Error preparing data for projected volume kube-api-access-djlrn for pod openshift-network-diagnostics/network-check-target-94nrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:02.450660 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:02.450654 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn podName:3614757c-42a4-46ae-940c-34226bfca9bd nodeName:}" failed. No retries permitted until 2026-06-05 15:41:04.450635825 +0000 UTC m=+6.172209424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-djlrn" (UniqueName: "kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn") pod "network-check-target-94nrk" (UID: "3614757c-42a4-46ae-940c-34226bfca9bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:02.671267 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:02.671168 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 15:36:00 +0000 UTC" deadline="2027-12-19 15:20:03.419367114 +0000 UTC" Jun 05 15:41:02.671267 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:02.671212 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13487h39m0.748159694s" Jun 05 15:41:02.693302 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:02.693277 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:02.693470 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:02.693418 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:02.694139 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:02.694104 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:02.694233 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:02.694216 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:02.744214 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:02.742905 2566 generic.go:356] "Generic (PLEG): container finished" podID="c4e5bdca13dbab3fda0ef7d3c4a3c5e1" containerID="cdb10553a0b8dd338d65bb058dae78f27d4b7d633ac506e613cd22db58422fc5" exitCode=0 Jun 05 15:41:02.744214 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:02.743893 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal" event={"ID":"c4e5bdca13dbab3fda0ef7d3c4a3c5e1","Type":"ContainerDied","Data":"cdb10553a0b8dd338d65bb058dae78f27d4b7d633ac506e613cd22db58422fc5"} Jun 05 15:41:03.693277 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:03.693245 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:03.693791 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:03.693393 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:03.765540 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:03.765504 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal" event={"ID":"c4e5bdca13dbab3fda0ef7d3c4a3c5e1","Type":"ContainerStarted","Data":"f9b8ab6bd69404b87ecf5116e96a5b59338ec6e59befa0912d9c413ea81740ec"} Jun 05 15:41:04.267839 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:04.267251 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:04.267839 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:04.267441 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:04.267839 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:04.267501 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret podName:3ce4e623-49e2-4c40-ae0d-9683a4cd75fa nodeName:}" failed. No retries permitted until 2026-06-05 15:41:08.267483323 +0000 UTC m=+9.989056909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret") pod "global-pull-secret-syncer-6wbt4" (UID: "3ce4e623-49e2-4c40-ae0d-9683a4cd75fa") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:04.368373 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:04.368335 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:04.368545 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:04.368475 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:04.368612 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:04.368545 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs podName:973dde84-849e-4b5d-97f1-994ab561fe40 nodeName:}" failed. No retries permitted until 2026-06-05 15:41:08.368527944 +0000 UTC m=+10.090101541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs") pod "network-metrics-daemon-6qpcp" (UID: "973dde84-849e-4b5d-97f1-994ab561fe40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:04.469401 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:04.469296 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djlrn\" (UniqueName: \"kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn\") pod \"network-check-target-94nrk\" (UID: \"3614757c-42a4-46ae-940c-34226bfca9bd\") " pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:04.469598 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:04.469568 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:41:04.469598 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:04.469592 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:41:04.469777 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:04.469606 2566 projected.go:196] Error preparing data for projected volume kube-api-access-djlrn for pod openshift-network-diagnostics/network-check-target-94nrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:04.469777 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:04.469666 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn podName:3614757c-42a4-46ae-940c-34226bfca9bd nodeName:}" failed. No retries permitted until 2026-06-05 15:41:08.469647738 +0000 UTC m=+10.191221324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-djlrn" (UniqueName: "kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn") pod "network-check-target-94nrk" (UID: "3614757c-42a4-46ae-940c-34226bfca9bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:04.694246 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:04.693574 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:04.694246 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:04.693714 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:04.694246 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:04.694089 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:04.694246 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:04.694205 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:05.693254 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:05.693218 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:05.693413 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:05.693363 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:06.693024 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:06.692995 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:06.693486 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:06.693143 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:06.693486 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:06.693157 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:06.693486 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:06.693264 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:07.693072 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:07.693035 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:07.693527 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:07.693195 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:08.299795 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:08.299751 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:08.300045 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:08.299895 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:08.300045 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:08.299973 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret podName:3ce4e623-49e2-4c40-ae0d-9683a4cd75fa nodeName:}" failed. No retries permitted until 2026-06-05 15:41:16.299951503 +0000 UTC m=+18.021525101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret") pod "global-pull-secret-syncer-6wbt4" (UID: "3ce4e623-49e2-4c40-ae0d-9683a4cd75fa") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:08.400878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:08.400839 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:08.401051 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:08.401011 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:08.401139 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:08.401077 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs podName:973dde84-849e-4b5d-97f1-994ab561fe40 nodeName:}" failed. No retries permitted until 2026-06-05 15:41:16.401057661 +0000 UTC m=+18.122631247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs") pod "network-metrics-daemon-6qpcp" (UID: "973dde84-849e-4b5d-97f1-994ab561fe40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:08.501674 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:08.501631 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djlrn\" (UniqueName: \"kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn\") pod \"network-check-target-94nrk\" (UID: \"3614757c-42a4-46ae-940c-34226bfca9bd\") " pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:08.501854 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:08.501790 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:41:08.501854 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:08.501819 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:41:08.501854 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:08.501832 2566 projected.go:196] Error preparing data for projected volume kube-api-access-djlrn for pod openshift-network-diagnostics/network-check-target-94nrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:08.502004 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:08.501900 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn podName:3614757c-42a4-46ae-940c-34226bfca9bd nodeName:}" failed. No retries permitted until 2026-06-05 15:41:16.501881207 +0000 UTC m=+18.223454807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-djlrn" (UniqueName: "kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn") pod "network-check-target-94nrk" (UID: "3614757c-42a4-46ae-940c-34226bfca9bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:08.694169 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:08.694063 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:08.694668 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:08.694206 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:08.694668 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:08.694625 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:08.694788 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:08.694736 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:09.693883 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:09.693816 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:09.694066 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:09.693955 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:10.693376 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:10.693346 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:10.693730 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:10.693451 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:10.693730 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:10.693499 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:10.693730 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:10.693575 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:11.693849 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:11.693812 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:11.694325 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:11.693950 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:12.693493 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:12.693456 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:12.693651 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:12.693506 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:12.693651 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:12.693602 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:12.693747 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:12.693728 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:13.693747 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:13.693721 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:13.694215 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:13.693852 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:14.693582 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:14.693550 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:14.693751 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:14.693660 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:14.693751 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:14.693734 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:14.694152 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:14.693818 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:15.693398 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:15.693318 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:15.693584 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:15.693443 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:16.357803 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:16.357769 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:16.358241 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:16.357936 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:16.358241 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:16.358017 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret podName:3ce4e623-49e2-4c40-ae0d-9683a4cd75fa nodeName:}" failed. No retries permitted until 2026-06-05 15:41:32.357995102 +0000 UTC m=+34.079568704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret") pod "global-pull-secret-syncer-6wbt4" (UID: "3ce4e623-49e2-4c40-ae0d-9683a4cd75fa") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:16.458791 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:16.458756 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:16.458952 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:16.458931 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:16.459024 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:16.459013 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs podName:973dde84-849e-4b5d-97f1-994ab561fe40 nodeName:}" failed. No retries permitted until 2026-06-05 15:41:32.458990742 +0000 UTC m=+34.180564333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs") pod "network-metrics-daemon-6qpcp" (UID: "973dde84-849e-4b5d-97f1-994ab561fe40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:16.559922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:16.559867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djlrn\" (UniqueName: \"kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn\") pod \"network-check-target-94nrk\" (UID: \"3614757c-42a4-46ae-940c-34226bfca9bd\") " pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:16.560074 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:16.560036 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:41:16.560074 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:16.560067 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:41:16.560190 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:16.560081 2566 projected.go:196] Error preparing data for projected volume kube-api-access-djlrn for pod openshift-network-diagnostics/network-check-target-94nrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:16.560190 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:16.560158 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn podName:3614757c-42a4-46ae-940c-34226bfca9bd nodeName:}" failed. No retries permitted until 2026-06-05 15:41:32.56013952 +0000 UTC m=+34.281713118 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-djlrn" (UniqueName: "kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn") pod "network-check-target-94nrk" (UID: "3614757c-42a4-46ae-940c-34226bfca9bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:16.693347 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:16.693275 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:16.693499 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:16.693388 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:16.693499 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:16.693449 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:16.693589 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:16.693566 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:17.693553 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:17.693512 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:17.693955 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:17.693636 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:18.694617 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:18.694592 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:18.695058 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:18.694691 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:18.695058 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:18.694775 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:18.695058 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:18.694889 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:19.693231 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:19.693207 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:19.693358 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:19.693335 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:19.798776 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:19.798744 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k6dcc" event={"ID":"f85be694-2e55-4684-aee7-ece43d2433b3","Type":"ContainerStarted","Data":"92c2680048aa354a01a4560a41aa6c35cb483016dccdfe3a878fe4e20c99c357"} Jun 05 15:41:19.800032 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:19.800010 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" event={"ID":"0ec86deb-d054-483f-b7de-1bf3a5accf75","Type":"ContainerStarted","Data":"d28e7020190df51b2c0b8c9f3ebc6b7d953d3b7d233fecc23b2025464f15c600"} Jun 05 15:41:19.812100 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:19.812063 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k6dcc" podStartSLOduration=3.656661018 podStartE2EDuration="21.812036169s" totalImagesPullingTime="18.155375151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:19.811931841 +0000 UTC m=+21.533505458" watchObservedRunningTime="2026-06-05 15:41:19.812036169 +0000 UTC m=+21.533609767" Jun 05 15:41:19.812267 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:19.812247 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-97.ec2.internal" podStartSLOduration=20.812238875 podStartE2EDuration="20.812238875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:40:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:03.781268779 +0000 UTC m=+5.502842388" watchObservedRunningTime="2026-06-05 15:41:19.812238875 +0000 UTC m=+21.533812481" Jun 05 15:41:20.694097 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.693688 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:20.694273 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.693738 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:20.694273 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:20.694220 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:20.694354 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:20.694324 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:20.802909 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.802879 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-925tg" event={"ID":"49be8ffd-e1cf-46cf-b32e-fec25dce31a0","Type":"ContainerStarted","Data":"084e0eec57d385097979f5c6ff060fc043f490329b0f748b454209e7f5bacea6"} Jun 05 15:41:20.804494 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.804464 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v4zrt" event={"ID":"263c0a29-d16b-4966-b92d-c348f2ab1e57","Type":"ContainerStarted","Data":"8951f0ccbfcd40c90a526728dbfda947ed6bd747b6db61ffba0a64dbc5c720a8"} Jun 05 15:41:20.807415 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.807399 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 15:41:20.807683 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.807667 2566 generic.go:356] "Generic (PLEG): container finished" podID="249f79f0-b1d9-440c-93ea-1044fc32a7d9" containerID="2b31f9e451941a0322e525be54f9f6298d694da59d6cf5fa61de2fa8ee08dfa2" exitCode=1 Jun 05 15:41:20.807754 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.807732 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" event={"ID":"249f79f0-b1d9-440c-93ea-1044fc32a7d9","Type":"ContainerStarted","Data":"626b4b62833bac40f775f5067c5cb7412f6465f3f07c0e8e311bb92189c5c338"} Jun 05 15:41:20.807840 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.807827 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" event={"ID":"249f79f0-b1d9-440c-93ea-1044fc32a7d9","Type":"ContainerStarted","Data":"e32316b54e1819771cb39042df81de73d8be55078322ace78b1911dbd0d9d3a0"} Jun 05 15:41:20.807882 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.807874 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" event={"ID":"249f79f0-b1d9-440c-93ea-1044fc32a7d9","Type":"ContainerDied","Data":"2b31f9e451941a0322e525be54f9f6298d694da59d6cf5fa61de2fa8ee08dfa2"} Jun 05 15:41:20.807939 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.807925 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" event={"ID":"249f79f0-b1d9-440c-93ea-1044fc32a7d9","Type":"ContainerStarted","Data":"350e0c063e952aa4a4fb3311ec31920905321099bc05379bc1090fac2dfbb2ae"} Jun 05 15:41:20.809012 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.808993 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tj9xd" event={"ID":"49801bfa-cb30-4035-bcb1-96e59be88b6e","Type":"ContainerStarted","Data":"b32c717f13f8f57014acb3a5b535914a5499b93d23a9653782be6ded7de73dff"} Jun 05 15:41:20.810481 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.810460 2566 generic.go:356] "Generic (PLEG): container finished" podID="e803e929-eed8-4115-a53d-1c3101e202bb" containerID="a2e854c8fd7a34c0a93ca210c5ef5a388c6e5c73c6492f18a4d739492a899955" exitCode=0 Jun 05 15:41:20.810569 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.810535 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j7tw" event={"ID":"e803e929-eed8-4115-a53d-1c3101e202bb","Type":"ContainerDied","Data":"a2e854c8fd7a34c0a93ca210c5ef5a388c6e5c73c6492f18a4d739492a899955"} Jun 05 15:41:20.812040 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.812014 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" event={"ID":"22404ca8-45ed-4fa2-9bc7-48ab456028ea","Type":"ContainerStarted","Data":"d27af6ef5a1638dfa97d092fb104aba114fcc3f100bb094c254ab5a257d63af2"} Jun 05 15:41:20.816882 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.816840 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-925tg" podStartSLOduration=4.66934927 podStartE2EDuration="22.816823789s" totalImagesPullingTime="18.147474519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:20.815956045 +0000 UTC m=+22.537529681" watchObservedRunningTime="2026-06-05 15:41:20.816823789 +0000 UTC m=+22.538397397" Jun 05 15:41:20.836632 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.836596 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tj9xd" podStartSLOduration=4.690080179 podStartE2EDuration="22.836583134s" totalImagesPullingTime="18.146502955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:20.836427366 +0000 UTC m=+22.558000991" watchObservedRunningTime="2026-06-05 15:41:20.836583134 +0000 UTC m=+22.558156740" Jun 05 15:41:20.861555 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.861492 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d7tfg" podStartSLOduration=4.710464663 podStartE2EDuration="22.861477171s" totalImagesPullingTime="18.151012508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:20.861148293 +0000 UTC m=+22.582721916" watchObservedRunningTime="2026-06-05 15:41:20.861477171 +0000 UTC m=+22.583050778" Jun 05 15:41:20.896728 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:20.896688 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v4zrt" podStartSLOduration=4.692432553 podStartE2EDuration="22.896673867s" totalImagesPullingTime="18.204241314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:20.896307009 +0000 UTC m=+22.617880616" watchObservedRunningTime="2026-06-05 15:41:20.896673867 +0000 UTC m=+22.618247473" Jun 05 15:41:21.077229 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:21.077197 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 15:41:21.693505 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:21.693465 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:21.693786 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:21.693599 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:21.697601 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:21.697505 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T15:41:21.077215034Z","UUID":"cddc2f26-1ed1-4044-baba-ec5524d68258","Handler":null,"Name":"","Endpoint":""} Jun 05 15:41:21.699328 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:21.699291 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 15:41:21.699429 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:21.699336 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 15:41:21.817263 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:21.817228 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" event={"ID":"0ec86deb-d054-483f-b7de-1bf3a5accf75","Type":"ContainerStarted","Data":"18ba02c226a7b459aa5641d67608bc5584bed015185fb96772df0bf39bab96f2"} Jun 05 15:41:21.821827 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:21.821802 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 15:41:21.822288 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:21.822258 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" event={"ID":"249f79f0-b1d9-440c-93ea-1044fc32a7d9","Type":"ContainerStarted","Data":"9e80c1247573040ca31506934a080337e0f40d237bb134dc9a06149d3d894baa"} Jun 05 15:41:21.822401 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:21.822354 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" event={"ID":"249f79f0-b1d9-440c-93ea-1044fc32a7d9","Type":"ContainerStarted","Data":"f2919ff25f945b5db491b40e4c5c8f5105f0308b800005afb160eccd365d2eea"} Jun 05 15:41:21.823971 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:21.823913 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s2c2n" event={"ID":"334834c4-5f95-4000-936e-c777209dcbfd","Type":"ContainerStarted","Data":"e3af2f89a999e122a1408398927d0a467a1b3775d7c9d78f922bdf8011d26c6f"} Jun 05 15:41:21.839955 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:21.839907 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s2c2n" podStartSLOduration=5.682656711 podStartE2EDuration="23.839889706s" totalImagesPullingTime="18.157232995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:21.839595866 +0000 UTC m=+23.561169476" watchObservedRunningTime="2026-06-05 15:41:21.839889706 +0000 UTC m=+23.561463312" Jun 05 15:41:22.497054 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:22.497022 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k6dcc" Jun 05 15:41:22.497671 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:22.497651 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k6dcc" Jun 05 15:41:22.693906 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:22.693832 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:22.694065 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:22.693970 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:22.694153 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:22.694090 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:22.694243 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:22.694217 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:22.828878 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:22.828837 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" event={"ID":"0ec86deb-d054-483f-b7de-1bf3a5accf75","Type":"ContainerStarted","Data":"a80d12902c6d81853007256460f4a460e355b3f71312b1b851bf45457238b146"} Jun 05 15:41:22.846673 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:22.846615 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j726" podStartSLOduration=4.386103014 podStartE2EDuration="24.846597886s" totalImagesPullingTime="20.460494872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:40:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:22.846524774 +0000 UTC m=+24.568098406" watchObservedRunningTime="2026-06-05 15:41:22.846597886 +0000 UTC m=+24.568171472" Jun 05 15:41:23.038350 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:23.037972 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k6dcc" Jun 05 15:41:23.038648 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:23.038620 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k6dcc" Jun 05 15:41:23.693763 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:23.693723 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:23.693988 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:23.693857 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:23.834739 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:23.834710 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 15:41:23.835293 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:23.835160 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" event={"ID":"249f79f0-b1d9-440c-93ea-1044fc32a7d9","Type":"ContainerStarted","Data":"b2ea07147989e9cfba2e858b4f3a8e2db7fab67011249c3547871a9679961bae"} Jun 05 15:41:24.693996 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:24.693961 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:24.694198 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:24.693961 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:24.694198 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:24.694064 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:24.694198 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:24.694178 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:24.838892 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:24.838845 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j7tw" event={"ID":"e803e929-eed8-4115-a53d-1c3101e202bb","Type":"ContainerStarted","Data":"36576e301ff3682218c08855782d59bf0cfed03caf699d99da5b148e4088daf0"} Jun 05 15:41:25.693956 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:25.693781 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:25.694166 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:25.694033 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:25.844345 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:25.844316 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 15:41:25.844846 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:25.844715 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" event={"ID":"249f79f0-b1d9-440c-93ea-1044fc32a7d9","Type":"ContainerStarted","Data":"21ece272d756ef13f62c454a06cf034a15c43120bf3794d4a4bbfaeda35a3e71"} Jun 05 15:41:25.844987 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:25.844962 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:25.845152 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:25.845045 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:25.845218 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:25.845201 2566 scope.go:117] "RemoveContainer" containerID="2b31f9e451941a0322e525be54f9f6298d694da59d6cf5fa61de2fa8ee08dfa2" Jun 05 15:41:25.846624 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:25.846602 2566 generic.go:356] "Generic (PLEG): container finished" podID="e803e929-eed8-4115-a53d-1c3101e202bb" containerID="36576e301ff3682218c08855782d59bf0cfed03caf699d99da5b148e4088daf0" exitCode=0 Jun 05 15:41:25.846717 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:25.846634 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j7tw" event={"ID":"e803e929-eed8-4115-a53d-1c3101e202bb","Type":"ContainerDied","Data":"36576e301ff3682218c08855782d59bf0cfed03caf699d99da5b148e4088daf0"} Jun 05 15:41:25.862765 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:25.862744 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:26.697160 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:26.697117 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:26.697369 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:26.697227 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:26.697369 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:26.697276 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:26.697369 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:26.697354 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:26.853395 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:26.853363 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 15:41:26.853867 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:26.853835 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" event={"ID":"249f79f0-b1d9-440c-93ea-1044fc32a7d9","Type":"ContainerStarted","Data":"18f0daee479d622613ccd522a34f331e6e324aea8baf27c58663fa0596dd2601"} Jun 05 15:41:26.854179 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:26.854158 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:26.856345 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:26.856321 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j7tw" event={"ID":"e803e929-eed8-4115-a53d-1c3101e202bb","Type":"ContainerStarted","Data":"19a01866b81dfb65c02984f2f964b3c35ffab511a0cb870a63a6be435b279b50"} Jun 05 15:41:26.870751 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:26.870729 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:26.880435 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:26.880380 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" podStartSLOduration=10.243030631 podStartE2EDuration="28.880359275s" totalImagesPullingTime="18.637328644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:26.879771736 +0000 UTC m=+28.601345366" watchObservedRunningTime="2026-06-05 15:41:26.880359275 +0000 UTC m=+28.601932882" Jun 05 15:41:27.121679 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:27.121646 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6wbt4"] Jun 05 15:41:27.121865 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:27.121762 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:27.121928 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:27.121874 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:27.125507 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:27.125476 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-94nrk"] Jun 05 15:41:27.125666 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:27.125603 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:27.125729 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:27.125707 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:27.126079 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:27.126056 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6qpcp"] Jun 05 15:41:27.126224 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:27.126193 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:27.126325 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:27.126301 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:27.859744 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:27.859714 2566 generic.go:356] "Generic (PLEG): container finished" podID="e803e929-eed8-4115-a53d-1c3101e202bb" containerID="19a01866b81dfb65c02984f2f964b3c35ffab511a0cb870a63a6be435b279b50" exitCode=0 Jun 05 15:41:27.860113 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:27.859806 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j7tw" event={"ID":"e803e929-eed8-4115-a53d-1c3101e202bb","Type":"ContainerDied","Data":"19a01866b81dfb65c02984f2f964b3c35ffab511a0cb870a63a6be435b279b50"} Jun 05 15:41:28.694807 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:28.694633 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:28.694975 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:28.694721 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:28.694975 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:28.694754 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:28.695093 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:28.694990 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:28.695093 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:28.695050 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:28.695093 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:28.694865 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:29.866635 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:29.866602 2566 generic.go:356] "Generic (PLEG): container finished" podID="e803e929-eed8-4115-a53d-1c3101e202bb" containerID="2daafa3431cdeff0f5f4ecea310f6cfd3f97fb4980df6851536ed7dfa0f94fa4" exitCode=0 Jun 05 15:41:29.867137 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:29.866663 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j7tw" event={"ID":"e803e929-eed8-4115-a53d-1c3101e202bb","Type":"ContainerDied","Data":"2daafa3431cdeff0f5f4ecea310f6cfd3f97fb4980df6851536ed7dfa0f94fa4"} Jun 05 15:41:30.455718 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:30.455682 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:30.545019 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:30.544987 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:30.693515 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:30.693484 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:30.693709 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:30.693485 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:30.693709 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:30.693611 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wbt4" podUID="3ce4e623-49e2-4c40-ae0d-9683a4cd75fa" Jun 05 15:41:30.693834 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:30.693721 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:41:30.693834 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:30.693488 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:30.693950 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:30.693832 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-94nrk" podUID="3614757c-42a4-46ae-940c-34226bfca9bd" Jun 05 15:41:32.380866 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.380823 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:32.381433 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:32.381006 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:32.381433 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:32.381088 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret podName:3ce4e623-49e2-4c40-ae0d-9683a4cd75fa nodeName:}" failed. No retries permitted until 2026-06-05 15:42:04.381065549 +0000 UTC m=+66.102639146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret") pod "global-pull-secret-syncer-6wbt4" (UID: "3ce4e623-49e2-4c40-ae0d-9683a4cd75fa") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:41:32.481602 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.481515 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:32.481777 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:32.481667 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:32.481777 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:32.481748 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs podName:973dde84-849e-4b5d-97f1-994ab561fe40 nodeName:}" failed. No retries permitted until 2026-06-05 15:42:04.481726018 +0000 UTC m=+66.203299606 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs") pod "network-metrics-daemon-6qpcp" (UID: "973dde84-849e-4b5d-97f1-994ab561fe40") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:41:32.582437 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.582385 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djlrn\" (UniqueName: \"kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn\") pod \"network-check-target-94nrk\" (UID: \"3614757c-42a4-46ae-940c-34226bfca9bd\") " pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:32.582643 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:32.582575 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:41:32.582643 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:32.582603 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:41:32.582643 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:32.582615 2566 projected.go:196] Error preparing data for projected volume kube-api-access-djlrn for pod openshift-network-diagnostics/network-check-target-94nrk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:32.582800 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:32.582684 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn podName:3614757c-42a4-46ae-940c-34226bfca9bd nodeName:}" failed. No retries permitted until 2026-06-05 15:42:04.582663962 +0000 UTC m=+66.304237551 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-djlrn" (UniqueName: "kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn") pod "network-check-target-94nrk" (UID: "3614757c-42a4-46ae-940c-34226bfca9bd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:41:32.629429 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.629351 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-97.ec2.internal" event="NodeReady" Jun 05 15:41:32.629589 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.629508 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 15:41:32.663007 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.662801 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67cd49fc7-5brh9"] Jun 05 15:41:32.665185 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.665162 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.668973 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.667911 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 15:41:32.668973 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.668207 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 15:41:32.668973 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.668354 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dfl6x\"" Jun 05 15:41:32.668973 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.668442 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 15:41:32.671403 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.671036 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nhnzl"] Jun 05 15:41:32.673432 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.673395 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8snkx"] Jun 05 15:41:32.673626 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.673585 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nhnzl" Jun 05 15:41:32.674787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.674768 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 15:41:32.675307 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.675279 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:32.676926 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.676373 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 15:41:32.676926 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.676510 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 15:41:32.676926 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.676613 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-btdw6\"" Jun 05 15:41:32.676926 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.676881 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67cd49fc7-5brh9"] Jun 05 15:41:32.677265 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.676932 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 15:41:32.677512 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.677495 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 15:41:32.677584 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.677517 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n8cpf\"" Jun 05 15:41:32.677639 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.677496 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 15:41:32.680484 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.680277 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nhnzl"] Jun 05 15:41:32.688330 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.688306 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8snkx"] Jun 05 15:41:32.693329 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.693305 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:41:32.693559 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.693538 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:41:32.693945 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.693926 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:41:32.695838 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.695767 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 15:41:32.696038 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.696019 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 15:41:32.696144 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.696041 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 15:41:32.696144 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.696076 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v9nvv\"" Jun 05 15:41:32.696144 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.696029 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5plcz\"" Jun 05 15:41:32.696308 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.696293 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 15:41:32.783478 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783443 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lr24\" (UniqueName: \"kubernetes.io/projected/b59f8dd1-3894-45f9-9934-eda40274bfaf-kube-api-access-7lr24\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:32.783651 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783507 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a2bc419-c20b-42ad-9e06-c8473e05e810-image-registry-private-configuration\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.783651 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783534 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:32.783651 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783555 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b8db554-fe76-4d33-863d-183d1a2bba0d-cert\") pod \"ingress-canary-nhnzl\" (UID: \"4b8db554-fe76-4d33-863d-183d1a2bba0d\") " pod="openshift-ingress-canary/ingress-canary-nhnzl" Jun 05 15:41:32.783651 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783597 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a2bc419-c20b-42ad-9e06-c8473e05e810-ca-trust-extracted\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.783651 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783626 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b59f8dd1-3894-45f9-9934-eda40274bfaf-tmp-dir\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:32.783923 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.783923 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783690 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-certificates\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.783923 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783705 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b59f8dd1-3894-45f9-9934-eda40274bfaf-config-volume\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:32.783923 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783730 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a2bc419-c20b-42ad-9e06-c8473e05e810-trusted-ca\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.783923 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783755 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mztl9\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-kube-api-access-mztl9\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.783923 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783771 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98j7s\" (UniqueName: \"kubernetes.io/projected/4b8db554-fe76-4d33-863d-183d1a2bba0d-kube-api-access-98j7s\") pod \"ingress-canary-nhnzl\" (UID: \"4b8db554-fe76-4d33-863d-183d1a2bba0d\") " pod="openshift-ingress-canary/ingress-canary-nhnzl" Jun 05 15:41:32.783923 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783798 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a2bc419-c20b-42ad-9e06-c8473e05e810-installation-pull-secrets\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.783923 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.783838 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-bound-sa-token\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.793649 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.793614 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:32.844942 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.844907 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:32.885010 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.884925 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-bound-sa-token\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.885010 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.884967 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lr24\" (UniqueName: \"kubernetes.io/projected/b59f8dd1-3894-45f9-9934-eda40274bfaf-kube-api-access-7lr24\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:32.885320 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885016 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a2bc419-c20b-42ad-9e06-c8473e05e810-image-registry-private-configuration\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.885320 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885043 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:32.885320 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885065 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b8db554-fe76-4d33-863d-183d1a2bba0d-cert\") pod \"ingress-canary-nhnzl\" (UID: \"4b8db554-fe76-4d33-863d-183d1a2bba0d\") " pod="openshift-ingress-canary/ingress-canary-nhnzl" Jun 05 15:41:32.885320 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885090 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a2bc419-c20b-42ad-9e06-c8473e05e810-ca-trust-extracted\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.885320 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885145 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b59f8dd1-3894-45f9-9934-eda40274bfaf-tmp-dir\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:32.885320 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885185 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.885320 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885211 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-certificates\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.885320 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b59f8dd1-3894-45f9-9934-eda40274bfaf-config-volume\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:32.885320 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885309 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a2bc419-c20b-42ad-9e06-c8473e05e810-trusted-ca\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.885747 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885334 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mztl9\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-kube-api-access-mztl9\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.885747 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885371 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98j7s\" (UniqueName: \"kubernetes.io/projected/4b8db554-fe76-4d33-863d-183d1a2bba0d-kube-api-access-98j7s\") pod \"ingress-canary-nhnzl\" (UID: \"4b8db554-fe76-4d33-863d-183d1a2bba0d\") " pod="openshift-ingress-canary/ingress-canary-nhnzl" Jun 05 15:41:32.885747 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a2bc419-c20b-42ad-9e06-c8473e05e810-installation-pull-secrets\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.885747 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885498 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b59f8dd1-3894-45f9-9934-eda40274bfaf-tmp-dir\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:32.885747 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:32.885543 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:41:32.885747 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:32.885607 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls podName:b59f8dd1-3894-45f9-9934-eda40274bfaf nodeName:}" failed. No retries permitted until 2026-06-05 15:41:33.385587086 +0000 UTC m=+35.107160691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls") pod "dns-default-8snkx" (UID: "b59f8dd1-3894-45f9-9934-eda40274bfaf") : secret "dns-default-metrics-tls" not found Jun 05 15:41:32.886052 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.885759 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a2bc419-c20b-42ad-9e06-c8473e05e810-ca-trust-extracted\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.886194 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:32.886172 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:41:32.886194 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:32.886195 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cd49fc7-5brh9: secret "image-registry-tls" not found Jun 05 15:41:32.886330 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:32.886256 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls podName:9a2bc419-c20b-42ad-9e06-c8473e05e810 nodeName:}" failed. No retries permitted until 2026-06-05 15:41:33.386237819 +0000 UTC m=+35.107811418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls") pod "image-registry-67cd49fc7-5brh9" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810") : secret "image-registry-tls" not found Jun 05 15:41:32.886330 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.886311 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-certificates\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.886445 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.886427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a2bc419-c20b-42ad-9e06-c8473e05e810-trusted-ca\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.886445 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.886436 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b59f8dd1-3894-45f9-9934-eda40274bfaf-config-volume\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:32.889714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.889688 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a2bc419-c20b-42ad-9e06-c8473e05e810-image-registry-private-configuration\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.889814 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.889758 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a2bc419-c20b-42ad-9e06-c8473e05e810-installation-pull-secrets\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.889881 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.889820 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b8db554-fe76-4d33-863d-183d1a2bba0d-cert\") pod \"ingress-canary-nhnzl\" (UID: \"4b8db554-fe76-4d33-863d-183d1a2bba0d\") " pod="openshift-ingress-canary/ingress-canary-nhnzl" Jun 05 15:41:32.893900 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.893871 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-bound-sa-token\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.894111 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.894090 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lr24\" (UniqueName: \"kubernetes.io/projected/b59f8dd1-3894-45f9-9934-eda40274bfaf-kube-api-access-7lr24\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:32.894235 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.894218 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mztl9\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-kube-api-access-mztl9\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:32.894426 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.894402 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98j7s\" (UniqueName: \"kubernetes.io/projected/4b8db554-fe76-4d33-863d-183d1a2bba0d-kube-api-access-98j7s\") pod \"ingress-canary-nhnzl\" (UID: \"4b8db554-fe76-4d33-863d-183d1a2bba0d\") " pod="openshift-ingress-canary/ingress-canary-nhnzl" Jun 05 15:41:32.991578 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:32.991537 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nhnzl" Jun 05 15:41:33.389533 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:33.389490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:33.390114 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:33.389554 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:33.390114 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:33.389663 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:41:33.390114 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:33.389677 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:41:33.390114 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:33.389693 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cd49fc7-5brh9: secret "image-registry-tls" not found Jun 05 15:41:33.390114 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:33.389750 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls podName:b59f8dd1-3894-45f9-9934-eda40274bfaf nodeName:}" failed. No retries permitted until 2026-06-05 15:41:34.3897266 +0000 UTC m=+36.111300210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls") pod "dns-default-8snkx" (UID: "b59f8dd1-3894-45f9-9934-eda40274bfaf") : secret "dns-default-metrics-tls" not found Jun 05 15:41:33.390114 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:33.389772 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls podName:9a2bc419-c20b-42ad-9e06-c8473e05e810 nodeName:}" failed. No retries permitted until 2026-06-05 15:41:34.389761903 +0000 UTC m=+36.111335489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls") pod "image-registry-67cd49fc7-5brh9" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810") : secret "image-registry-tls" not found Jun 05 15:41:34.120355 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:34.120320 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nhnzl"] Jun 05 15:41:34.124427 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:41:34.124403 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8db554_fe76_4d33_863d_183d1a2bba0d.slice/crio-3a63378b09c531cec6446c7299ea0c06c999bfafe40e0eb63c44576b55e07c71 WatchSource:0}: Error finding container 3a63378b09c531cec6446c7299ea0c06c999bfafe40e0eb63c44576b55e07c71: Status 404 returned error can't find the container with id 3a63378b09c531cec6446c7299ea0c06c999bfafe40e0eb63c44576b55e07c71 Jun 05 15:41:34.220444 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:34.220409 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:34.320892 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:34.320788 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:34.400654 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:34.400618 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:34.401058 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:34.400675 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:34.401058 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:34.400766 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:41:34.401058 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:34.400831 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls podName:b59f8dd1-3894-45f9-9934-eda40274bfaf nodeName:}" failed. No retries permitted until 2026-06-05 15:41:36.400815338 +0000 UTC m=+38.122388926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls") pod "dns-default-8snkx" (UID: "b59f8dd1-3894-45f9-9934-eda40274bfaf") : secret "dns-default-metrics-tls" not found Jun 05 15:41:34.401058 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:34.400773 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:41:34.401058 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:34.400869 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cd49fc7-5brh9: secret "image-registry-tls" not found Jun 05 15:41:34.401058 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:34.400911 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls podName:9a2bc419-c20b-42ad-9e06-c8473e05e810 nodeName:}" failed. No retries permitted until 2026-06-05 15:41:36.400900068 +0000 UTC m=+38.122473658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls") pod "image-registry-67cd49fc7-5brh9" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810") : secret "image-registry-tls" not found Jun 05 15:41:34.885146 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:34.885093 2566 generic.go:356] "Generic (PLEG): container finished" podID="e803e929-eed8-4115-a53d-1c3101e202bb" containerID="efe155be31ed824a2ab25329a6a94fe99f5e95d2762dbcdca7caaca6e502390d" exitCode=0 Jun 05 15:41:34.885428 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:34.885164 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j7tw" event={"ID":"e803e929-eed8-4115-a53d-1c3101e202bb","Type":"ContainerDied","Data":"efe155be31ed824a2ab25329a6a94fe99f5e95d2762dbcdca7caaca6e502390d"} Jun 05 15:41:34.886474 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:34.886445 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nhnzl" event={"ID":"4b8db554-fe76-4d33-863d-183d1a2bba0d","Type":"ContainerStarted","Data":"3a63378b09c531cec6446c7299ea0c06c999bfafe40e0eb63c44576b55e07c71"} Jun 05 15:41:35.389915 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:35.389874 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:35.487709 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:35.487673 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:35.538684 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:35.538651 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:35.893111 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:35.892883 2566 generic.go:356] "Generic (PLEG): container finished" podID="e803e929-eed8-4115-a53d-1c3101e202bb" containerID="f77bbed140dc2972cec53aea0bfc6083b8bcf8e00588fbb9f076026b4f7afb70" exitCode=0 Jun 05 15:41:35.893282 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:35.892957 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j7tw" event={"ID":"e803e929-eed8-4115-a53d-1c3101e202bb","Type":"ContainerDied","Data":"f77bbed140dc2972cec53aea0bfc6083b8bcf8e00588fbb9f076026b4f7afb70"} Jun 05 15:41:35.894799 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:35.894762 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nhnzl" event={"ID":"4b8db554-fe76-4d33-863d-183d1a2bba0d","Type":"ContainerStarted","Data":"bf70bdb32127f0c2d4ed3b59dfa86e746d64d560dc4b67e946012837a78cc8f2"} Jun 05 15:41:35.928941 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:35.928884 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nhnzl" podStartSLOduration=2.31027382 podStartE2EDuration="3.928860035s" totalImagesPullingTime="1.618586215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:41:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:35.928113624 +0000 UTC m=+37.649687232" watchObservedRunningTime="2026-06-05 15:41:35.928860035 +0000 UTC m=+37.650433643" Jun 05 15:41:36.420980 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:36.419041 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:36.420980 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:36.419165 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:36.420980 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:36.419356 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:41:36.420980 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:36.419373 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cd49fc7-5brh9: secret "image-registry-tls" not found Jun 05 15:41:36.420980 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:36.419440 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls podName:9a2bc419-c20b-42ad-9e06-c8473e05e810 nodeName:}" failed. No retries permitted until 2026-06-05 15:41:40.419413775 +0000 UTC m=+42.140987360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls") pod "image-registry-67cd49fc7-5brh9" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810") : secret "image-registry-tls" not found Jun 05 15:41:36.420980 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:36.419941 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:41:36.420980 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:36.419998 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls podName:b59f8dd1-3894-45f9-9934-eda40274bfaf nodeName:}" failed. No retries permitted until 2026-06-05 15:41:40.419981673 +0000 UTC m=+42.141555261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls") pod "dns-default-8snkx" (UID: "b59f8dd1-3894-45f9-9934-eda40274bfaf") : secret "dns-default-metrics-tls" not found Jun 05 15:41:36.429112 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:36.429081 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:36.529667 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:36.529633 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:36.901605 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:36.901568 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2j7tw" event={"ID":"e803e929-eed8-4115-a53d-1c3101e202bb","Type":"ContainerStarted","Data":"76fe1037c46c782bec11c2da1d893569609420ad94610febc1b3ccb349869d0a"} Jun 05 15:41:36.924284 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:36.924234 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2j7tw" podStartSLOduration=10.754937126 podStartE2EDuration="38.924217882s" totalImagesPullingTime="28.169280756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:40:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:36.923055308 +0000 UTC m=+38.644628914" watchObservedRunningTime="2026-06-05 15:41:36.924217882 +0000 UTC m=+38.645791489" Jun 05 15:41:37.043097 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:37.043050 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:37.143379 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:37.143347 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:37.357961 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:37.357872 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:37.459166 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:37.459112 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:37.560248 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:37.560214 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:38.160908 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:38.160875 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:38.263590 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:38.263547 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:40.448372 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:40.448328 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:40.448971 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:40.448421 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:40.448971 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:40.448484 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:41:40.448971 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:40.448500 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cd49fc7-5brh9: secret "image-registry-tls" not found Jun 05 15:41:40.448971 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:40.448524 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:41:40.448971 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:40.448566 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls podName:9a2bc419-c20b-42ad-9e06-c8473e05e810 nodeName:}" failed. No retries permitted until 2026-06-05 15:41:48.448545991 +0000 UTC m=+50.170119580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls") pod "image-registry-67cd49fc7-5brh9" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810") : secret "image-registry-tls" not found Jun 05 15:41:40.448971 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:40.448581 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls podName:b59f8dd1-3894-45f9-9934-eda40274bfaf nodeName:}" failed. No retries permitted until 2026-06-05 15:41:48.448575599 +0000 UTC m=+50.170149184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls") pod "dns-default-8snkx" (UID: "b59f8dd1-3894-45f9-9934-eda40274bfaf") : secret "dns-default-metrics-tls" not found Jun 05 15:41:47.809783 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:47.809750 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:47.858763 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:47.858732 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:48.514312 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:48.514267 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:41:48.514516 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:48.514339 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:41:48.514516 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:48.514416 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:41:48.514516 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:48.514464 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:41:48.514516 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:48.514477 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cd49fc7-5brh9: secret "image-registry-tls" not found Jun 05 15:41:48.514516 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:48.514491 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls podName:b59f8dd1-3894-45f9-9934-eda40274bfaf nodeName:}" failed. No retries permitted until 2026-06-05 15:42:04.514474034 +0000 UTC m=+66.236047624 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls") pod "dns-default-8snkx" (UID: "b59f8dd1-3894-45f9-9934-eda40274bfaf") : secret "dns-default-metrics-tls" not found Jun 05 15:41:48.514717 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:41:48.514534 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls podName:9a2bc419-c20b-42ad-9e06-c8473e05e810 nodeName:}" failed. No retries permitted until 2026-06-05 15:42:04.514517698 +0000 UTC m=+66.236091292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls") pod "image-registry-67cd49fc7-5brh9" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810") : secret "image-registry-tls" not found Jun 05 15:41:51.478014 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:51.477935 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:51.574592 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:51.574549 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:52.035905 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:52.035873 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:55.178091 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:55.178060 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:55.226335 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:55.226307 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:58.879771 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:58.879739 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5w77r" Jun 05 15:41:59.024861 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:59.024826 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:41:59.125507 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:41:59.125475 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:42:04.431645 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.431597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:42:04.434416 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.434396 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 15:42:04.446049 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.446026 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce4e623-49e2-4c40-ae0d-9683a4cd75fa-original-pull-secret\") pod \"global-pull-secret-syncer-6wbt4\" (UID: \"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa\") " pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:42:04.507306 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.507266 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wbt4" Jun 05 15:42:04.532952 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.532918 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:42:04.532952 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.532956 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:42:04.533243 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.532983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:42:04.533243 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:42:04.533073 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:42:04.533243 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:42:04.533090 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:42:04.533243 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:42:04.533104 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cd49fc7-5brh9: secret "image-registry-tls" not found Jun 05 15:42:04.533243 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:42:04.533159 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls podName:b59f8dd1-3894-45f9-9934-eda40274bfaf nodeName:}" failed. No retries permitted until 2026-06-05 15:42:36.533119111 +0000 UTC m=+98.254692717 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls") pod "dns-default-8snkx" (UID: "b59f8dd1-3894-45f9-9934-eda40274bfaf") : secret "dns-default-metrics-tls" not found Jun 05 15:42:04.533243 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:42:04.533178 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls podName:9a2bc419-c20b-42ad-9e06-c8473e05e810 nodeName:}" failed. No retries permitted until 2026-06-05 15:42:36.533169418 +0000 UTC m=+98.254743021 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls") pod "image-registry-67cd49fc7-5brh9" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810") : secret "image-registry-tls" not found Jun 05 15:42:04.535971 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.535948 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 15:42:04.544137 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:42:04.544099 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 15:42:04.544234 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:42:04.544222 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs podName:973dde84-849e-4b5d-97f1-994ab561fe40 nodeName:}" failed. No retries permitted until 2026-06-05 15:43:08.544195566 +0000 UTC m=+130.265769166 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs") pod "network-metrics-daemon-6qpcp" (UID: "973dde84-849e-4b5d-97f1-994ab561fe40") : secret "metrics-daemon-secret" not found Jun 05 15:42:04.631560 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.631529 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6wbt4"] Jun 05 15:42:04.633443 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.633416 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djlrn\" (UniqueName: \"kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn\") pod \"network-check-target-94nrk\" (UID: \"3614757c-42a4-46ae-940c-34226bfca9bd\") " pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:42:04.634781 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:42:04.634748 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce4e623_49e2_4c40_ae0d_9683a4cd75fa.slice/crio-033145fd6474d97650f86bfe99929dafeba02baec00e7a7bcbfa2725922779d8 WatchSource:0}: Error finding container 033145fd6474d97650f86bfe99929dafeba02baec00e7a7bcbfa2725922779d8: Status 404 returned error can't find the container with id 033145fd6474d97650f86bfe99929dafeba02baec00e7a7bcbfa2725922779d8 Jun 05 15:42:04.635729 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.635715 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 15:42:04.645622 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.645599 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 15:42:04.656725 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.656700 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djlrn\" (UniqueName: \"kubernetes.io/projected/3614757c-42a4-46ae-940c-34226bfca9bd-kube-api-access-djlrn\") pod \"network-check-target-94nrk\" (UID: \"3614757c-42a4-46ae-940c-34226bfca9bd\") " pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:42:04.822884 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.822853 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v9nvv\"" Jun 05 15:42:04.830672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.830639 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:42:04.967456 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.967427 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6wbt4" event={"ID":"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa","Type":"ContainerStarted","Data":"033145fd6474d97650f86bfe99929dafeba02baec00e7a7bcbfa2725922779d8"} Jun 05 15:42:04.973293 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:04.973263 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-94nrk"] Jun 05 15:42:04.975782 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:42:04.975757 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3614757c_42a4_46ae_940c_34226bfca9bd.slice/crio-75b1b35f8e08fc2d635a1ecd67cb21d267dd1144e7f1803492bae0d9533a58a1 WatchSource:0}: Error finding container 75b1b35f8e08fc2d635a1ecd67cb21d267dd1144e7f1803492bae0d9533a58a1: Status 404 returned error can't find the container with id 75b1b35f8e08fc2d635a1ecd67cb21d267dd1144e7f1803492bae0d9533a58a1 Jun 05 15:42:05.971969 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:05.971929 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-94nrk" event={"ID":"3614757c-42a4-46ae-940c-34226bfca9bd","Type":"ContainerStarted","Data":"75b1b35f8e08fc2d635a1ecd67cb21d267dd1144e7f1803492bae0d9533a58a1"} Jun 05 15:42:09.984443 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:09.984410 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6wbt4" event={"ID":"3ce4e623-49e2-4c40-ae0d-9683a4cd75fa","Type":"ContainerStarted","Data":"e83067fecc7770f926dbfbe42124c00ed3d6357439e591e1cb1227cd4cc2ba4a"} Jun 05 15:42:09.985854 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:09.985827 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-94nrk" event={"ID":"3614757c-42a4-46ae-940c-34226bfca9bd","Type":"ContainerStarted","Data":"233207a019a07521113ae0bc12b0c2f668f35bf1a82fe0efa1d333c5a5d48298"} Jun 05 15:42:09.985977 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:09.985879 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:42:09.998988 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:09.998938 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6wbt4" podStartSLOduration=67.5433292 podStartE2EDuration="1m11.998921776s" totalImagesPullingTime="4.455592576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:42:09.998229156 +0000 UTC m=+71.719802776" watchObservedRunningTime="2026-06-05 15:42:09.998921776 +0000 UTC m=+71.720495430" Jun 05 15:42:10.010853 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:10.010807 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-94nrk" podStartSLOduration=67.899149948 podStartE2EDuration="1m12.01079406s" totalImagesPullingTime="4.111644112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:42:10.010403779 +0000 UTC m=+71.731977388" watchObservedRunningTime="2026-06-05 15:42:10.01079406 +0000 UTC m=+71.732367645" Jun 05 15:42:13.448684 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:13.448630 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:42:13.549298 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:13.549270 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:42:13.596087 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:13.596057 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:42:36.559540 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:36.559402 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:42:36.559540 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:36.559471 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:42:36.560146 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:42:36.559566 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:42:36.560146 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:42:36.559592 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cd49fc7-5brh9: secret "image-registry-tls" not found Jun 05 15:42:36.560146 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:42:36.559564 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:42:36.560146 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:42:36.559670 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls podName:b59f8dd1-3894-45f9-9934-eda40274bfaf nodeName:}" failed. No retries permitted until 2026-06-05 15:43:40.559650775 +0000 UTC m=+162.281224375 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls") pod "dns-default-8snkx" (UID: "b59f8dd1-3894-45f9-9934-eda40274bfaf") : secret "dns-default-metrics-tls" not found Jun 05 15:42:36.560146 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:42:36.559687 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls podName:9a2bc419-c20b-42ad-9e06-c8473e05e810 nodeName:}" failed. No retries permitted until 2026-06-05 15:43:40.559678472 +0000 UTC m=+162.281252058 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls") pod "image-registry-67cd49fc7-5brh9" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810") : secret "image-registry-tls" not found Jun 05 15:42:40.990920 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:42:40.990894 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-94nrk" Jun 05 15:43:08.576851 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:43:08.576813 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:43:08.577326 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:43:08.576958 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 15:43:08.577326 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:43:08.577031 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs podName:973dde84-849e-4b5d-97f1-994ab561fe40 nodeName:}" failed. No retries permitted until 2026-06-05 15:45:10.577015849 +0000 UTC m=+252.298589434 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs") pod "network-metrics-daemon-6qpcp" (UID: "973dde84-849e-4b5d-97f1-994ab561fe40") : secret "metrics-daemon-secret" not found Jun 05 15:43:35.684437 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:43:35.684396 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" podUID="9a2bc419-c20b-42ad-9e06-c8473e05e810" Jun 05 15:43:35.699667 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:43:35.699638 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8snkx" podUID="b59f8dd1-3894-45f9-9934-eda40274bfaf" Jun 05 15:43:35.714791 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:43:35.714773 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6qpcp" podUID="973dde84-849e-4b5d-97f1-994ab561fe40" Jun 05 15:43:36.179292 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:43:36.179267 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8snkx" Jun 05 15:43:36.179440 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:43:36.179267 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:43:40.582673 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:43:40.582633 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls\") pod \"image-registry-67cd49fc7-5brh9\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:43:40.583100 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:43:40.582698 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:43:40.583100 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:43:40.582785 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:43:40.583100 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:43:40.582789 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:43:40.583100 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:43:40.582804 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cd49fc7-5brh9: secret "image-registry-tls" not found Jun 05 15:43:40.583100 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:43:40.582850 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls podName:b59f8dd1-3894-45f9-9934-eda40274bfaf nodeName:}" failed. No retries permitted until 2026-06-05 15:45:42.58283145 +0000 UTC m=+284.304405037 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls") pod "dns-default-8snkx" (UID: "b59f8dd1-3894-45f9-9934-eda40274bfaf") : secret "dns-default-metrics-tls" not found Jun 05 15:43:40.583100 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:43:40.582863 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls podName:9a2bc419-c20b-42ad-9e06-c8473e05e810 nodeName:}" failed. No retries permitted until 2026-06-05 15:45:42.582857118 +0000 UTC m=+284.304430704 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls") pod "image-registry-67cd49fc7-5brh9" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810") : secret "image-registry-tls" not found Jun 05 15:43:48.694336 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:43:48.694255 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:44:20.944711 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:20.944673 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:46.436769 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.436737 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn"] Jun 05 15:44:46.438734 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.438718 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" Jun 05 15:44:46.440997 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.440970 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 05 15:44:46.441111 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.440978 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-98lpd\"" Jun 05 15:44:46.441805 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.441789 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:44:46.441860 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.441842 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 05 15:44:46.449999 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.449976 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn"] Jun 05 15:44:46.513926 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.513901 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjrtc\" (UniqueName: \"kubernetes.io/projected/b17ccb19-6544-4024-9082-729b8277ca1f-kube-api-access-bjrtc\") pod \"cluster-samples-operator-854f8b96b6-rkstn\" (UID: \"b17ccb19-6544-4024-9082-729b8277ca1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" Jun 05 15:44:46.514042 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.513940 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-rkstn\" (UID: \"b17ccb19-6544-4024-9082-729b8277ca1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" Jun 05 15:44:46.528109 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.528084 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9zfcq"] Jun 05 15:44:46.529983 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.529960 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9zfcq" Jun 05 15:44:46.531224 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.531205 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-29wzh"] Jun 05 15:44:46.532332 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.532312 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9czbw\"" Jun 05 15:44:46.532332 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.532329 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 05 15:44:46.532447 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.532321 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:44:46.533047 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.533032 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-29wzh" Jun 05 15:44:46.534753 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.534736 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8"] Jun 05 15:44:46.535233 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.535215 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-x5bdz\"" Jun 05 15:44:46.537632 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.537614 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb"] Jun 05 15:44:46.537720 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.537708 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" Jun 05 15:44:46.539592 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.539573 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9zfcq"] Jun 05 15:44:46.539694 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.539651 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:44:46.540027 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.540009 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:44:46.540255 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.540120 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-sz8vs\"" Jun 05 15:44:46.540255 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.540176 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 05 15:44:46.540255 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.540197 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 05 15:44:46.540255 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.540032 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 05 15:44:46.541922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.541692 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 15:44:46.541922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.541696 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 05 15:44:46.542257 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.542238 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-h9q5z\"" Jun 05 15:44:46.542399 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.542377 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-29wzh"] Jun 05 15:44:46.542745 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.542722 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 15:44:46.543143 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.543111 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 05 15:44:46.552009 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.551989 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb"] Jun 05 15:44:46.555272 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.555091 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8"] Jun 05 15:44:46.583730 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.583702 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:46.615196 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.615175 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-rkstn\" (UID: \"b17ccb19-6544-4024-9082-729b8277ca1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" Jun 05 15:44:46.615308 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.615205 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f52mv\" (UniqueName: \"kubernetes.io/projected/cec4570b-6b43-4593-a55d-f60c20b212ec-kube-api-access-f52mv\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:44:46.615308 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.615224 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cec4570b-6b43-4593-a55d-f60c20b212ec-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:44:46.615308 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.615243 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-496sh\" (UniqueName: \"kubernetes.io/projected/deea7a0b-d7b8-4e75-b5f5-abdeae71cb54-kube-api-access-496sh\") pod \"volume-data-source-validator-78dd696465-9zfcq\" (UID: \"deea7a0b-d7b8-4e75-b5f5-abdeae71cb54\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9zfcq" Jun 05 15:44:46.615452 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:46.615313 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 15:44:46.615452 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.615331 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bkwk\" (UniqueName: \"kubernetes.io/projected/4ed088fb-2961-42d5-bc2f-56ef34be887c-kube-api-access-7bkwk\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jvqw8\" (UID: \"4ed088fb-2961-42d5-bc2f-56ef34be887c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" Jun 05 15:44:46.615452 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.615360 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz48x\" (UniqueName: \"kubernetes.io/projected/04ed8fcb-77ae-41d3-a274-8a259ace61f6-kube-api-access-tz48x\") pod \"network-check-source-dbd9cf844-29wzh\" (UID: \"04ed8fcb-77ae-41d3-a274-8a259ace61f6\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-29wzh" Jun 05 15:44:46.615452 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.615377 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ed088fb-2961-42d5-bc2f-56ef34be887c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jvqw8\" (UID: \"4ed088fb-2961-42d5-bc2f-56ef34be887c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" Jun 05 15:44:46.615452 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.615393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:44:46.615452 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.615415 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ed088fb-2961-42d5-bc2f-56ef34be887c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jvqw8\" (UID: \"4ed088fb-2961-42d5-bc2f-56ef34be887c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" Jun 05 15:44:46.615452 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:46.615443 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls podName:b17ccb19-6544-4024-9082-729b8277ca1f nodeName:}" failed. No retries permitted until 2026-06-05 15:44:47.115423925 +0000 UTC m=+228.836997510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-rkstn" (UID: "b17ccb19-6544-4024-9082-729b8277ca1f") : secret "samples-operator-tls" not found Jun 05 15:44:46.615661 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.615493 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjrtc\" (UniqueName: \"kubernetes.io/projected/b17ccb19-6544-4024-9082-729b8277ca1f-kube-api-access-bjrtc\") pod \"cluster-samples-operator-854f8b96b6-rkstn\" (UID: \"b17ccb19-6544-4024-9082-729b8277ca1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" Jun 05 15:44:46.624730 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.624707 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjrtc\" (UniqueName: \"kubernetes.io/projected/b17ccb19-6544-4024-9082-729b8277ca1f-kube-api-access-bjrtc\") pod \"cluster-samples-operator-854f8b96b6-rkstn\" (UID: \"b17ccb19-6544-4024-9082-729b8277ca1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" Jun 05 15:44:46.640833 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.640801 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:46.716801 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.716742 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52mv\" (UniqueName: \"kubernetes.io/projected/cec4570b-6b43-4593-a55d-f60c20b212ec-kube-api-access-f52mv\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:44:46.716801 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.716773 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cec4570b-6b43-4593-a55d-f60c20b212ec-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:44:46.716945 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.716800 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-496sh\" (UniqueName: \"kubernetes.io/projected/deea7a0b-d7b8-4e75-b5f5-abdeae71cb54-kube-api-access-496sh\") pod \"volume-data-source-validator-78dd696465-9zfcq\" (UID: \"deea7a0b-d7b8-4e75-b5f5-abdeae71cb54\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9zfcq" Jun 05 15:44:46.716945 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.716853 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bkwk\" (UniqueName: \"kubernetes.io/projected/4ed088fb-2961-42d5-bc2f-56ef34be887c-kube-api-access-7bkwk\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jvqw8\" (UID: \"4ed088fb-2961-42d5-bc2f-56ef34be887c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" Jun 05 15:44:46.716945 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.716878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz48x\" (UniqueName: \"kubernetes.io/projected/04ed8fcb-77ae-41d3-a274-8a259ace61f6-kube-api-access-tz48x\") pod \"network-check-source-dbd9cf844-29wzh\" (UID: \"04ed8fcb-77ae-41d3-a274-8a259ace61f6\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-29wzh" Jun 05 15:44:46.716945 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.716903 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ed088fb-2961-42d5-bc2f-56ef34be887c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jvqw8\" (UID: \"4ed088fb-2961-42d5-bc2f-56ef34be887c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" Jun 05 15:44:46.716945 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.716928 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:44:46.717261 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.716954 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ed088fb-2961-42d5-bc2f-56ef34be887c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jvqw8\" (UID: \"4ed088fb-2961-42d5-bc2f-56ef34be887c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" Jun 05 15:44:46.717261 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:46.717060 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 15:44:46.717261 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:46.717116 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls podName:cec4570b-6b43-4593-a55d-f60c20b212ec nodeName:}" failed. No retries permitted until 2026-06-05 15:44:47.217101642 +0000 UTC m=+228.938675228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qcrqb" (UID: "cec4570b-6b43-4593-a55d-f60c20b212ec") : secret "cluster-monitoring-operator-tls" not found Jun 05 15:44:46.717510 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.717494 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ed088fb-2961-42d5-bc2f-56ef34be887c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jvqw8\" (UID: \"4ed088fb-2961-42d5-bc2f-56ef34be887c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" Jun 05 15:44:46.717562 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.717547 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cec4570b-6b43-4593-a55d-f60c20b212ec-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:44:46.718961 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.718948 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ed088fb-2961-42d5-bc2f-56ef34be887c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jvqw8\" (UID: \"4ed088fb-2961-42d5-bc2f-56ef34be887c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" Jun 05 15:44:46.727008 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.726977 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz48x\" (UniqueName: \"kubernetes.io/projected/04ed8fcb-77ae-41d3-a274-8a259ace61f6-kube-api-access-tz48x\") pod \"network-check-source-dbd9cf844-29wzh\" (UID: \"04ed8fcb-77ae-41d3-a274-8a259ace61f6\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-29wzh" Jun 05 15:44:46.727109 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.727034 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bkwk\" (UniqueName: \"kubernetes.io/projected/4ed088fb-2961-42d5-bc2f-56ef34be887c-kube-api-access-7bkwk\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jvqw8\" (UID: \"4ed088fb-2961-42d5-bc2f-56ef34be887c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" Jun 05 15:44:46.727109 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.727082 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f52mv\" (UniqueName: \"kubernetes.io/projected/cec4570b-6b43-4593-a55d-f60c20b212ec-kube-api-access-f52mv\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:44:46.727261 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.727245 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-496sh\" (UniqueName: \"kubernetes.io/projected/deea7a0b-d7b8-4e75-b5f5-abdeae71cb54-kube-api-access-496sh\") pod \"volume-data-source-validator-78dd696465-9zfcq\" (UID: \"deea7a0b-d7b8-4e75-b5f5-abdeae71cb54\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9zfcq" Jun 05 15:44:46.839668 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.839635 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9zfcq" Jun 05 15:44:46.847001 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.846980 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-29wzh" Jun 05 15:44:46.852828 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.852803 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" Jun 05 15:44:46.973063 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:46.972948 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9zfcq"] Jun 05 15:44:46.976366 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:44:46.976340 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeea7a0b_d7b8_4e75_b5f5_abdeae71cb54.slice/crio-e7e8541f24c28f81810b2ae408c3b9db3bfdcacbe09132f3d972f68493d58cf1 WatchSource:0}: Error finding container e7e8541f24c28f81810b2ae408c3b9db3bfdcacbe09132f3d972f68493d58cf1: Status 404 returned error can't find the container with id e7e8541f24c28f81810b2ae408c3b9db3bfdcacbe09132f3d972f68493d58cf1 Jun 05 15:44:47.119363 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:47.119337 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-rkstn\" (UID: \"b17ccb19-6544-4024-9082-729b8277ca1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" Jun 05 15:44:47.119471 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:47.119449 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 15:44:47.119511 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:47.119500 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls podName:b17ccb19-6544-4024-9082-729b8277ca1f nodeName:}" failed. No retries permitted until 2026-06-05 15:44:48.119484355 +0000 UTC m=+229.841057942 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-rkstn" (UID: "b17ccb19-6544-4024-9082-729b8277ca1f") : secret "samples-operator-tls" not found Jun 05 15:44:47.194963 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:47.194938 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8"] Jun 05 15:44:47.195908 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:47.195890 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-29wzh"] Jun 05 15:44:47.198014 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:44:47.197992 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ed8fcb_77ae_41d3_a274_8a259ace61f6.slice/crio-134642a84ba4f73196e449f49fc64a351b71a88cbd1abcb07a809026463709ec WatchSource:0}: Error finding container 134642a84ba4f73196e449f49fc64a351b71a88cbd1abcb07a809026463709ec: Status 404 returned error can't find the container with id 134642a84ba4f73196e449f49fc64a351b71a88cbd1abcb07a809026463709ec Jun 05 15:44:47.198732 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:44:47.198710 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ed088fb_2961_42d5_bc2f_56ef34be887c.slice/crio-85234f9545283232e2f0b1850794af0de86e2eaa6af831175df91a6ce63a5b65 WatchSource:0}: Error finding container 85234f9545283232e2f0b1850794af0de86e2eaa6af831175df91a6ce63a5b65: Status 404 returned error can't find the container with id 85234f9545283232e2f0b1850794af0de86e2eaa6af831175df91a6ce63a5b65 Jun 05 15:44:47.219732 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:47.219706 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:44:47.219828 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:47.219816 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 15:44:47.219871 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:47.219865 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls podName:cec4570b-6b43-4593-a55d-f60c20b212ec nodeName:}" failed. No retries permitted until 2026-06-05 15:44:48.219848102 +0000 UTC m=+229.941421688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qcrqb" (UID: "cec4570b-6b43-4593-a55d-f60c20b212ec") : secret "cluster-monitoring-operator-tls" not found Jun 05 15:44:47.337048 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:47.337020 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" event={"ID":"4ed088fb-2961-42d5-bc2f-56ef34be887c","Type":"ContainerStarted","Data":"85234f9545283232e2f0b1850794af0de86e2eaa6af831175df91a6ce63a5b65"} Jun 05 15:44:47.338048 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:47.338019 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9zfcq" event={"ID":"deea7a0b-d7b8-4e75-b5f5-abdeae71cb54","Type":"ContainerStarted","Data":"e7e8541f24c28f81810b2ae408c3b9db3bfdcacbe09132f3d972f68493d58cf1"} Jun 05 15:44:47.339386 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:47.339365 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-29wzh" event={"ID":"04ed8fcb-77ae-41d3-a274-8a259ace61f6","Type":"ContainerStarted","Data":"42cac474c339e954e5b4f4029a4731d4ec486ed3efcdd3bce52520bec96a2316"} Jun 05 15:44:47.339479 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:47.339399 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-29wzh" event={"ID":"04ed8fcb-77ae-41d3-a274-8a259ace61f6","Type":"ContainerStarted","Data":"134642a84ba4f73196e449f49fc64a351b71a88cbd1abcb07a809026463709ec"} Jun 05 15:44:47.353973 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:47.353935 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-29wzh" podStartSLOduration=1.353922699 podStartE2EDuration="1.353922699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:44:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:44:47.353139163 +0000 UTC m=+229.074712781" watchObservedRunningTime="2026-06-05 15:44:47.353922699 +0000 UTC m=+229.075496299" Jun 05 15:44:48.127476 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:48.127437 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-rkstn\" (UID: \"b17ccb19-6544-4024-9082-729b8277ca1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" Jun 05 15:44:48.127950 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:48.127674 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 15:44:48.127950 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:48.127750 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls podName:b17ccb19-6544-4024-9082-729b8277ca1f nodeName:}" failed. No retries permitted until 2026-06-05 15:44:50.12772911 +0000 UTC m=+231.849302695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-rkstn" (UID: "b17ccb19-6544-4024-9082-729b8277ca1f") : secret "samples-operator-tls" not found Jun 05 15:44:48.227985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:48.227957 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:44:48.228100 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:48.228078 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 15:44:48.228180 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:48.228170 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls podName:cec4570b-6b43-4593-a55d-f60c20b212ec nodeName:}" failed. No retries permitted until 2026-06-05 15:44:50.228147994 +0000 UTC m=+231.949721581 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qcrqb" (UID: "cec4570b-6b43-4593-a55d-f60c20b212ec") : secret "cluster-monitoring-operator-tls" not found Jun 05 15:44:48.344926 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:48.344888 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9zfcq" event={"ID":"deea7a0b-d7b8-4e75-b5f5-abdeae71cb54","Type":"ContainerStarted","Data":"4527410ee4610d1a5d66d1cc8101792a18c195101ac3bd1002d3ae7eb5717e65"} Jun 05 15:44:48.360516 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:48.360404 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9zfcq" podStartSLOduration=1.157679717 podStartE2EDuration="2.360384755s" totalImagesPullingTime="1.202705038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:44:48.359412476 +0000 UTC m=+230.080986083" watchObservedRunningTime="2026-06-05 15:44:48.360384755 +0000 UTC m=+230.081958363" Jun 05 15:44:48.460865 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:48.460779 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:48.513160 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:48.513106 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:49.349431 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:49.349395 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" event={"ID":"4ed088fb-2961-42d5-bc2f-56ef34be887c","Type":"ContainerStarted","Data":"7885fa0072066ecf91c33cab9e564375b2d5e945071579f82579d75184139781"} Jun 05 15:44:49.364689 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:49.364637 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" podStartSLOduration=1.3212489 podStartE2EDuration="3.364618816s" totalImagesPullingTime="2.043369916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:44:49.363374242 +0000 UTC m=+231.084947850" watchObservedRunningTime="2026-06-05 15:44:49.364618816 +0000 UTC m=+231.086192423" Jun 05 15:44:50.143961 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:50.143930 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-rkstn\" (UID: \"b17ccb19-6544-4024-9082-729b8277ca1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" Jun 05 15:44:50.144155 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:50.144088 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 15:44:50.144232 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:50.144189 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls podName:b17ccb19-6544-4024-9082-729b8277ca1f nodeName:}" failed. No retries permitted until 2026-06-05 15:44:54.144162466 +0000 UTC m=+235.865736077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-rkstn" (UID: "b17ccb19-6544-4024-9082-729b8277ca1f") : secret "samples-operator-tls" not found Jun 05 15:44:50.245118 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:50.245066 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:44:50.245263 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:50.245219 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 15:44:50.245311 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:50.245276 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls podName:cec4570b-6b43-4593-a55d-f60c20b212ec nodeName:}" failed. No retries permitted until 2026-06-05 15:44:54.245262371 +0000 UTC m=+235.966835961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qcrqb" (UID: "cec4570b-6b43-4593-a55d-f60c20b212ec") : secret "cluster-monitoring-operator-tls" not found Jun 05 15:44:50.849994 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:50.849945 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:50.945662 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:50.945633 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:51.045142 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:51.045107 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:51.619899 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:51.619866 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:51.683542 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:51.683509 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:51.823356 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:51.823313 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:52.298102 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:52.298070 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:52.398492 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:52.398463 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:52.855475 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:52.855443 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:52.905605 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:52.905582 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:53.992942 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:53.992908 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:54.045205 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:54.045167 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:54.175042 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:54.175020 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-rkstn\" (UID: \"b17ccb19-6544-4024-9082-729b8277ca1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" Jun 05 15:44:54.175184 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:54.175168 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 15:44:54.175244 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:54.175226 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls podName:b17ccb19-6544-4024-9082-729b8277ca1f nodeName:}" failed. No retries permitted until 2026-06-05 15:45:02.175211772 +0000 UTC m=+243.896785362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-rkstn" (UID: "b17ccb19-6544-4024-9082-729b8277ca1f") : secret "samples-operator-tls" not found Jun 05 15:44:54.276263 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:54.276205 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:44:54.276348 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:54.276332 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 15:44:54.276383 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:44:54.276377 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls podName:cec4570b-6b43-4593-a55d-f60c20b212ec nodeName:}" failed. No retries permitted until 2026-06-05 15:45:02.276365217 +0000 UTC m=+243.997938806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qcrqb" (UID: "cec4570b-6b43-4593-a55d-f60c20b212ec") : secret "cluster-monitoring-operator-tls" not found Jun 05 15:44:54.331069 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:54.331045 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tj9xd_49801bfa-cb30-4035-bcb1-96e59be88b6e/dns-node-resolver/0.log" Jun 05 15:44:55.084325 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:55.084290 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:55.130921 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:55.130898 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-925tg_49be8ffd-e1cf-46cf-b32e-fec25dce31a0/node-ca/0.log" Jun 05 15:44:55.184089 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:55.184067 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:55.350750 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:55.350681 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:55.451096 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:55.451067 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:55.554121 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:55.554091 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:55.659418 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:55.659349 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:55.734356 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:55.734328 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:55.835729 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:55.835707 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:56.331403 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:56.331377 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nhnzl_4b8db554-fe76-4d33-863d-183d1a2bba0d/serve-healthcheck-canary/0.log" Jun 05 15:44:56.933353 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:56.933326 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-jvqw8_4ed088fb-2961-42d5-bc2f-56ef34be887c/kube-storage-version-migrator-operator/0.log" Jun 05 15:44:56.985801 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:56.985773 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:57.173527 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:57.173489 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:57.234149 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:57.234115 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:57.386240 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:57.386213 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:57.587100 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:57.587038 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:57.778995 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:57.778965 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:58.585277 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:58.585245 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:58.882425 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:58.882359 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:58.983199 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:58.983168 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:59.186618 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:59.186551 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:59.385641 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:59.385611 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:59.783370 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:59.783341 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:44:59.986261 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:44:59.986232 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:00.385414 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:00.385379 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:00.982914 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:00.982881 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:01.382181 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:01.382069 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:01.489975 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:01.489939 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:01.788086 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:01.788058 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:01.839960 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:01.839929 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:02.186681 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:02.186598 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:02.234673 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:02.234650 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-rkstn\" (UID: \"b17ccb19-6544-4024-9082-729b8277ca1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" Jun 05 15:45:02.236957 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:02.236941 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b17ccb19-6544-4024-9082-729b8277ca1f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-rkstn\" (UID: \"b17ccb19-6544-4024-9082-729b8277ca1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" Jun 05 15:45:02.335308 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:02.335273 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:45:02.337337 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:02.337313 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cec4570b-6b43-4593-a55d-f60c20b212ec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qcrqb\" (UID: \"cec4570b-6b43-4593-a55d-f60c20b212ec\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:45:02.349910 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:02.349893 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-98lpd\"" Jun 05 15:45:02.357732 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:02.357717 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" Jun 05 15:45:02.459897 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:02.459841 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-h9q5z\"" Jun 05 15:45:02.468521 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:02.468501 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" Jun 05 15:45:02.472606 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:02.472574 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn"] Jun 05 15:45:02.584859 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:02.584832 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb"] Jun 05 15:45:02.586433 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:02.586409 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:02.587900 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:45:02.587872 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec4570b_6b43_4593_a55d_f60c20b212ec.slice/crio-12aaa518dc3e6dba32a8ed5da8c00cbfa1efae3b466b73fcc30311cde9c89bf5 WatchSource:0}: Error finding container 12aaa518dc3e6dba32a8ed5da8c00cbfa1efae3b466b73fcc30311cde9c89bf5: Status 404 returned error can't find the container with id 12aaa518dc3e6dba32a8ed5da8c00cbfa1efae3b466b73fcc30311cde9c89bf5 Jun 05 15:45:02.783263 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:02.783232 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:03.186064 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:03.185987 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:03.393552 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:03.393505 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" event={"ID":"cec4570b-6b43-4593-a55d-f60c20b212ec","Type":"ContainerStarted","Data":"12aaa518dc3e6dba32a8ed5da8c00cbfa1efae3b466b73fcc30311cde9c89bf5"} Jun 05 15:45:03.395566 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:03.395534 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" event={"ID":"b17ccb19-6544-4024-9082-729b8277ca1f","Type":"ContainerStarted","Data":"a7aa4216871ad5359e5947b0119507d7038a6b7572ca05da7c76d7fd06ab59ad"} Jun 05 15:45:03.786750 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:03.786710 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:03.901625 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:03.901590 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:04.182353 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:04.182277 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:04.585602 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:04.585561 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:04.990877 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:04.990838 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:05.149604 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:05.149528 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:05.246503 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:05.246474 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:05.349388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:05.349358 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:05.404458 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:05.404382 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" event={"ID":"cec4570b-6b43-4593-a55d-f60c20b212ec","Type":"ContainerStarted","Data":"e023d9189b25c8c58683d9c677d58f3ba2ca73d09b3df426911503674f74cc46"} Jun 05 15:45:05.406172 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:05.406148 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" event={"ID":"b17ccb19-6544-4024-9082-729b8277ca1f","Type":"ContainerStarted","Data":"75a940682dc72a1a7a378b740e0725a86fbbf3d18c8df96e2d7b2f08f6db45bf"} Jun 05 15:45:05.406306 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:05.406184 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" event={"ID":"b17ccb19-6544-4024-9082-729b8277ca1f","Type":"ContainerStarted","Data":"946b07302832dfb6205459e692466d8b1dfda007e40a81e93e6be33cf43d8a81"} Jun 05 15:45:05.419017 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:05.418972 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qcrqb" podStartSLOduration=17.185674687 podStartE2EDuration="19.418956846s" totalImagesPullingTime="2.233282159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:05.417787671 +0000 UTC m=+247.139361298" watchObservedRunningTime="2026-06-05 15:45:05.418956846 +0000 UTC m=+247.140530458" Jun 05 15:45:05.422008 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:05.421985 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:05.431404 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:05.431370 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-rkstn" podStartSLOduration=17.122134644 podStartE2EDuration="19.431358356s" totalImagesPullingTime="2.309223712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:05.431223347 +0000 UTC m=+247.152796973" watchObservedRunningTime="2026-06-05 15:45:05.431358356 +0000 UTC m=+247.152931962" Jun 05 15:45:05.582830 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:05.582805 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:05.781815 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:05.781785 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:06.185768 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:06.185686 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:10.595002 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:10.594974 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:45:10.597068 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:10.597050 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/973dde84-849e-4b5d-97f1-994ab561fe40-metrics-certs\") pod \"network-metrics-daemon-6qpcp\" (UID: \"973dde84-849e-4b5d-97f1-994ab561fe40\") " pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:45:10.897067 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:10.897004 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5plcz\"" Jun 05 15:45:10.905730 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:10.905716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qpcp" Jun 05 15:45:11.021607 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.021578 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6qpcp"] Jun 05 15:45:11.024696 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:45:11.024660 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973dde84_849e_4b5d_97f1_994ab561fe40.slice/crio-12959f8c67f3d322e456a780d180fb10475e35d905540c69e5ea468a8da61b9c WatchSource:0}: Error finding container 12959f8c67f3d322e456a780d180fb10475e35d905540c69e5ea468a8da61b9c: Status 404 returned error can't find the container with id 12959f8c67f3d322e456a780d180fb10475e35d905540c69e5ea468a8da61b9c Jun 05 15:45:11.424412 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.424379 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qpcp" event={"ID":"973dde84-849e-4b5d-97f1-994ab561fe40","Type":"ContainerStarted","Data":"12959f8c67f3d322e456a780d180fb10475e35d905540c69e5ea468a8da61b9c"} Jun 05 15:45:11.666933 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.665187 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j7x7q"] Jun 05 15:45:11.669474 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.669446 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.672170 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.672146 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 15:45:11.673275 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.673249 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 15:45:11.673275 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.673274 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nrrcx\"" Jun 05 15:45:11.673448 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.673309 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 15:45:11.673448 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.673313 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 15:45:11.681988 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.681963 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7ck4"] Jun 05 15:45:11.684183 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.684159 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j7x7q"] Jun 05 15:45:11.684291 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.684245 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7ck4" Jun 05 15:45:11.686632 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.686585 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-459r6\"" Jun 05 15:45:11.686734 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.686712 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 05 15:45:11.695604 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.695586 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67cd49fc7-5brh9"] Jun 05 15:45:11.695770 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:45:11.695751 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" podUID="9a2bc419-c20b-42ad-9e06-c8473e05e810" Jun 05 15:45:11.703312 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.703291 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7ck4"] Jun 05 15:45:11.759212 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.759178 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-666974fcdc-zp28f"] Jun 05 15:45:11.761851 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.761831 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:11.778713 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.778663 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-666974fcdc-zp28f"] Jun 05 15:45:11.785752 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.785728 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:11.802570 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.802541 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.802696 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.802588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-data-volume\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.802696 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.802669 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/450b95f5-1232-4ca1-a58e-154d35d0f178-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-t7ck4\" (UID: \"450b95f5-1232-4ca1-a58e-154d35d0f178\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7ck4" Jun 05 15:45:11.802807 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.802715 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.802859 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.802815 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c6w4\" (UniqueName: \"kubernetes.io/projected/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-kube-api-access-8c6w4\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.802859 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.802850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-crio-socket\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.875492 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.875445 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:11.903979 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.903949 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b025e7ee-332b-4706-8d68-69dc93baedbf-installation-pull-secrets\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:11.904069 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.903989 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b025e7ee-332b-4706-8d68-69dc93baedbf-image-registry-private-configuration\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:11.904069 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904008 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b025e7ee-332b-4706-8d68-69dc93baedbf-trusted-ca\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:11.904069 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904025 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b025e7ee-332b-4706-8d68-69dc93baedbf-bound-sa-token\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:11.904069 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904060 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.904214 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b025e7ee-332b-4706-8d68-69dc93baedbf-ca-trust-extracted\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:11.904214 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904148 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-data-volume\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.904214 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904196 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/450b95f5-1232-4ca1-a58e-154d35d0f178-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-t7ck4\" (UID: \"450b95f5-1232-4ca1-a58e-154d35d0f178\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7ck4" Jun 05 15:45:11.904316 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904220 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.904316 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904261 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b025e7ee-332b-4706-8d68-69dc93baedbf-registry-tls\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:11.904316 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904288 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b025e7ee-332b-4706-8d68-69dc93baedbf-registry-certificates\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:11.904451 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c6w4\" (UniqueName: \"kubernetes.io/projected/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-kube-api-access-8c6w4\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.904451 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904377 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-crio-socket\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.904451 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904419 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2k9n\" (UniqueName: \"kubernetes.io/projected/b025e7ee-332b-4706-8d68-69dc93baedbf-kube-api-access-v2k9n\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:11.904553 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904476 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-data-volume\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.904553 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904479 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-crio-socket\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.904750 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.904735 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.906245 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.906228 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.906345 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.906331 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/450b95f5-1232-4ca1-a58e-154d35d0f178-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-t7ck4\" (UID: \"450b95f5-1232-4ca1-a58e-154d35d0f178\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7ck4" Jun 05 15:45:11.915046 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.915024 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c6w4\" (UniqueName: \"kubernetes.io/projected/4e93bc1e-6e90-4caf-8ee2-3b75f92db389-kube-api-access-8c6w4\") pod \"insights-runtime-extractor-j7x7q\" (UID: \"4e93bc1e-6e90-4caf-8ee2-3b75f92db389\") " pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.974159 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.974094 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:11.980944 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.980768 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j7x7q" Jun 05 15:45:11.994384 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:11.994221 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7ck4" Jun 05 15:45:12.005230 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.005202 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b025e7ee-332b-4706-8d68-69dc93baedbf-ca-trust-extracted\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.005335 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.005261 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b025e7ee-332b-4706-8d68-69dc93baedbf-registry-tls\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.005335 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.005279 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b025e7ee-332b-4706-8d68-69dc93baedbf-registry-certificates\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.005335 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.005317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2k9n\" (UniqueName: \"kubernetes.io/projected/b025e7ee-332b-4706-8d68-69dc93baedbf-kube-api-access-v2k9n\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.005487 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.005344 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b025e7ee-332b-4706-8d68-69dc93baedbf-installation-pull-secrets\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.005487 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.005368 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b025e7ee-332b-4706-8d68-69dc93baedbf-image-registry-private-configuration\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.005487 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.005391 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b025e7ee-332b-4706-8d68-69dc93baedbf-trusted-ca\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.005487 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.005418 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b025e7ee-332b-4706-8d68-69dc93baedbf-bound-sa-token\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.006177 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.006153 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b025e7ee-332b-4706-8d68-69dc93baedbf-ca-trust-extracted\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.006416 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.006360 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b025e7ee-332b-4706-8d68-69dc93baedbf-registry-certificates\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.006644 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.006621 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b025e7ee-332b-4706-8d68-69dc93baedbf-trusted-ca\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.008533 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.008507 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b025e7ee-332b-4706-8d68-69dc93baedbf-registry-tls\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.008610 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.008559 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b025e7ee-332b-4706-8d68-69dc93baedbf-installation-pull-secrets\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.008789 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.008768 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b025e7ee-332b-4706-8d68-69dc93baedbf-image-registry-private-configuration\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.016914 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.016876 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2k9n\" (UniqueName: \"kubernetes.io/projected/b025e7ee-332b-4706-8d68-69dc93baedbf-kube-api-access-v2k9n\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.017383 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.017362 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b025e7ee-332b-4706-8d68-69dc93baedbf-bound-sa-token\") pod \"image-registry-666974fcdc-zp28f\" (UID: \"b025e7ee-332b-4706-8d68-69dc93baedbf\") " pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.074581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.074550 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dfl6x\"" Jun 05 15:45:12.082673 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.082645 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.118179 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.118147 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j7x7q"] Jun 05 15:45:12.121729 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:45:12.121700 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e93bc1e_6e90_4caf_8ee2_3b75f92db389.slice/crio-c285f2aac9d5bd88eec80bfcffbea4d1c9e441d566a7351533f017ddd2f79ea4 WatchSource:0}: Error finding container c285f2aac9d5bd88eec80bfcffbea4d1c9e441d566a7351533f017ddd2f79ea4: Status 404 returned error can't find the container with id c285f2aac9d5bd88eec80bfcffbea4d1c9e441d566a7351533f017ddd2f79ea4 Jun 05 15:45:12.136567 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.136441 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7ck4"] Jun 05 15:45:12.150352 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:45:12.150327 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450b95f5_1232_4ca1_a58e_154d35d0f178.slice/crio-3dc167dc08f8ab2f0a3692bbe2dbcf2e3913a043450ea40f269aeacc44c226fc WatchSource:0}: Error finding container 3dc167dc08f8ab2f0a3692bbe2dbcf2e3913a043450ea40f269aeacc44c226fc: Status 404 returned error can't find the container with id 3dc167dc08f8ab2f0a3692bbe2dbcf2e3913a043450ea40f269aeacc44c226fc Jun 05 15:45:12.217251 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.217161 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-666974fcdc-zp28f"] Jun 05 15:45:12.219077 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:45:12.219056 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb025e7ee_332b_4706_8d68_69dc93baedbf.slice/crio-497f4fc1d3e8efcbcb3561afcea664adb31fde2e5996d598bec64b103d479832 WatchSource:0}: Error finding container 497f4fc1d3e8efcbcb3561afcea664adb31fde2e5996d598bec64b103d479832: Status 404 returned error can't find the container with id 497f4fc1d3e8efcbcb3561afcea664adb31fde2e5996d598bec64b103d479832 Jun 05 15:45:12.430643 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.430604 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qpcp" event={"ID":"973dde84-849e-4b5d-97f1-994ab561fe40","Type":"ContainerStarted","Data":"7fc4ad732d17e3a85525cca43d81a8d0ee5743fb630ff355a01eb5410484b210"} Jun 05 15:45:12.430835 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.430681 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qpcp" event={"ID":"973dde84-849e-4b5d-97f1-994ab561fe40","Type":"ContainerStarted","Data":"675c55646f182a5deb4da18e2f03fe2414fbb2ffd34bc7bab436fc100da93647"} Jun 05 15:45:12.432201 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.432173 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" event={"ID":"b025e7ee-332b-4706-8d68-69dc93baedbf","Type":"ContainerStarted","Data":"7e38d3b034d124cb4861ca82bc8404bd4875c6d9abd6230812c11f49c060a6b3"} Jun 05 15:45:12.432315 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.432222 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" event={"ID":"b025e7ee-332b-4706-8d68-69dc93baedbf","Type":"ContainerStarted","Data":"497f4fc1d3e8efcbcb3561afcea664adb31fde2e5996d598bec64b103d479832"} Jun 05 15:45:12.432315 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.432251 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:12.433339 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.433315 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7ck4" event={"ID":"450b95f5-1232-4ca1-a58e-154d35d0f178","Type":"ContainerStarted","Data":"3dc167dc08f8ab2f0a3692bbe2dbcf2e3913a043450ea40f269aeacc44c226fc"} Jun 05 15:45:12.434695 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.434675 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j7x7q" event={"ID":"4e93bc1e-6e90-4caf-8ee2-3b75f92db389","Type":"ContainerStarted","Data":"7321ee884309d74fd4d1ea23553b64212136ac9cd9f14d53b0e26f9116af4737"} Jun 05 15:45:12.434770 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.434726 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j7x7q" event={"ID":"4e93bc1e-6e90-4caf-8ee2-3b75f92db389","Type":"ContainerStarted","Data":"c285f2aac9d5bd88eec80bfcffbea4d1c9e441d566a7351533f017ddd2f79ea4"} Jun 05 15:45:12.434770 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.434686 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:45:12.440789 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.440735 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:45:12.445678 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.445643 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6qpcp" podStartSLOduration=253.617910087 podStartE2EDuration="4m14.445630541s" totalImagesPullingTime="827.720454ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:12.444577261 +0000 UTC m=+254.166150869" watchObservedRunningTime="2026-06-05 15:45:12.445630541 +0000 UTC m=+254.167204196" Jun 05 15:45:12.479443 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.479392 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" podStartSLOduration=1.479373458 podStartE2EDuration="1.479373458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:12.478269886 +0000 UTC m=+254.199843518" watchObservedRunningTime="2026-06-05 15:45:12.479373458 +0000 UTC m=+254.200947065" Jun 05 15:45:12.531531 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.531506 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:12.609691 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.609663 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a2bc419-c20b-42ad-9e06-c8473e05e810-image-registry-private-configuration\") pod \"9a2bc419-c20b-42ad-9e06-c8473e05e810\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " Jun 05 15:45:12.609851 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.609710 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mztl9\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-kube-api-access-mztl9\") pod \"9a2bc419-c20b-42ad-9e06-c8473e05e810\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " Jun 05 15:45:12.609851 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.609741 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a2bc419-c20b-42ad-9e06-c8473e05e810-ca-trust-extracted\") pod \"9a2bc419-c20b-42ad-9e06-c8473e05e810\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " Jun 05 15:45:12.609851 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.609765 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a2bc419-c20b-42ad-9e06-c8473e05e810-installation-pull-secrets\") pod \"9a2bc419-c20b-42ad-9e06-c8473e05e810\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " Jun 05 15:45:12.609851 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.609795 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-bound-sa-token\") pod \"9a2bc419-c20b-42ad-9e06-c8473e05e810\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " Jun 05 15:45:12.609851 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.609851 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a2bc419-c20b-42ad-9e06-c8473e05e810-trusted-ca\") pod \"9a2bc419-c20b-42ad-9e06-c8473e05e810\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " Jun 05 15:45:12.610144 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.609874 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-certificates\") pod \"9a2bc419-c20b-42ad-9e06-c8473e05e810\" (UID: \"9a2bc419-c20b-42ad-9e06-c8473e05e810\") " Jun 05 15:45:12.610324 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.610287 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2bc419-c20b-42ad-9e06-c8473e05e810-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9a2bc419-c20b-42ad-9e06-c8473e05e810" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:45:12.611183 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.610579 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9a2bc419-c20b-42ad-9e06-c8473e05e810" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:45:12.611183 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.610812 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a2bc419-c20b-42ad-9e06-c8473e05e810-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9a2bc419-c20b-42ad-9e06-c8473e05e810" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:45:12.612353 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.612286 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a2bc419-c20b-42ad-9e06-c8473e05e810-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9a2bc419-c20b-42ad-9e06-c8473e05e810" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:45:12.613063 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.613021 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a2bc419-c20b-42ad-9e06-c8473e05e810-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9a2bc419-c20b-42ad-9e06-c8473e05e810" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:45:12.613357 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.613319 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9a2bc419-c20b-42ad-9e06-c8473e05e810" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:45:12.613496 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.613474 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-kube-api-access-mztl9" (OuterVolumeSpecName: "kube-api-access-mztl9") pod "9a2bc419-c20b-42ad-9e06-c8473e05e810" (UID: "9a2bc419-c20b-42ad-9e06-c8473e05e810"). InnerVolumeSpecName "kube-api-access-mztl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:45:12.631821 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.631787 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:12.711387 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.711365 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-certificates\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:45:12.711689 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.711391 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a2bc419-c20b-42ad-9e06-c8473e05e810-image-registry-private-configuration\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:45:12.711689 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.711408 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mztl9\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-kube-api-access-mztl9\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:45:12.711689 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.711417 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a2bc419-c20b-42ad-9e06-c8473e05e810-ca-trust-extracted\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:45:12.711689 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.711425 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a2bc419-c20b-42ad-9e06-c8473e05e810-installation-pull-secrets\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:45:12.711689 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.711433 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-bound-sa-token\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:45:12.711689 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.711441 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a2bc419-c20b-42ad-9e06-c8473e05e810-trusted-ca\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:45:12.733700 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:12.733675 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:13.443368 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:13.443342 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7ck4" event={"ID":"450b95f5-1232-4ca1-a58e-154d35d0f178","Type":"ContainerStarted","Data":"41ad215e277dbe08a6d621659daddd2c6738fb414629a0aacec386438793a1f7"} Jun 05 15:45:13.443516 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:13.443471 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7ck4" Jun 05 15:45:13.445484 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:13.445445 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j7x7q" event={"ID":"4e93bc1e-6e90-4caf-8ee2-3b75f92db389","Type":"ContainerStarted","Data":"0403857c49662e81133ca5dc012b899e706d2cc4fafe918380f0814563d29ee6"} Jun 05 15:45:13.445673 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:13.445652 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67cd49fc7-5brh9" Jun 05 15:45:13.449230 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:13.449210 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7ck4" Jun 05 15:45:13.460672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:13.460633 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t7ck4" podStartSLOduration=1.286521661 podStartE2EDuration="2.460620854s" totalImagesPullingTime="1.174099193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:13.459454726 +0000 UTC m=+255.181028332" watchObservedRunningTime="2026-06-05 15:45:13.460620854 +0000 UTC m=+255.182194460" Jun 05 15:45:13.483812 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:13.483780 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67cd49fc7-5brh9"] Jun 05 15:45:13.484784 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:13.484762 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67cd49fc7-5brh9"] Jun 05 15:45:13.619051 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:13.618980 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a2bc419-c20b-42ad-9e06-c8473e05e810-registry-tls\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:45:14.333537 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.333498 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:14.363597 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.363570 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms"] Jun 05 15:45:14.367892 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.367873 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.371054 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.371034 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 15:45:14.371179 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.371089 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 05 15:45:14.371179 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.371034 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 05 15:45:14.371179 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.371114 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xdgv2\"" Jun 05 15:45:14.375991 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.375972 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms"] Jun 05 15:45:14.400818 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.400788 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:14.526712 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.526683 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18666497-7821-4df1-8cdb-f8c38ebd631b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-4m4ms\" (UID: \"18666497-7821-4df1-8cdb-f8c38ebd631b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.526887 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.526738 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18666497-7821-4df1-8cdb-f8c38ebd631b-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-4m4ms\" (UID: \"18666497-7821-4df1-8cdb-f8c38ebd631b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.526887 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.526779 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/18666497-7821-4df1-8cdb-f8c38ebd631b-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-4m4ms\" (UID: \"18666497-7821-4df1-8cdb-f8c38ebd631b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.526887 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.526806 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbfxn\" (UniqueName: \"kubernetes.io/projected/18666497-7821-4df1-8cdb-f8c38ebd631b-kube-api-access-sbfxn\") pod \"prometheus-operator-7f7d445d84-4m4ms\" (UID: \"18666497-7821-4df1-8cdb-f8c38ebd631b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.578107 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.578067 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:14.627900 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.627844 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18666497-7821-4df1-8cdb-f8c38ebd631b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-4m4ms\" (UID: \"18666497-7821-4df1-8cdb-f8c38ebd631b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.628030 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.627900 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18666497-7821-4df1-8cdb-f8c38ebd631b-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-4m4ms\" (UID: \"18666497-7821-4df1-8cdb-f8c38ebd631b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.628030 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.628008 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/18666497-7821-4df1-8cdb-f8c38ebd631b-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-4m4ms\" (UID: \"18666497-7821-4df1-8cdb-f8c38ebd631b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.628159 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.628054 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbfxn\" (UniqueName: \"kubernetes.io/projected/18666497-7821-4df1-8cdb-f8c38ebd631b-kube-api-access-sbfxn\") pod \"prometheus-operator-7f7d445d84-4m4ms\" (UID: \"18666497-7821-4df1-8cdb-f8c38ebd631b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.628568 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.628550 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18666497-7821-4df1-8cdb-f8c38ebd631b-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-4m4ms\" (UID: \"18666497-7821-4df1-8cdb-f8c38ebd631b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.630232 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.630212 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/18666497-7821-4df1-8cdb-f8c38ebd631b-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-4m4ms\" (UID: \"18666497-7821-4df1-8cdb-f8c38ebd631b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.630317 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.630261 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18666497-7821-4df1-8cdb-f8c38ebd631b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-4m4ms\" (UID: \"18666497-7821-4df1-8cdb-f8c38ebd631b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.634940 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.634918 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbfxn\" (UniqueName: \"kubernetes.io/projected/18666497-7821-4df1-8cdb-f8c38ebd631b-kube-api-access-sbfxn\") pod \"prometheus-operator-7f7d445d84-4m4ms\" (UID: \"18666497-7821-4df1-8cdb-f8c38ebd631b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.696686 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.696655 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" Jun 05 15:45:14.699280 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.699253 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a2bc419-c20b-42ad-9e06-c8473e05e810" path="/var/lib/kubelet/pods/9a2bc419-c20b-42ad-9e06-c8473e05e810/volumes" Jun 05 15:45:14.814618 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:14.814579 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms"] Jun 05 15:45:14.817240 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:45:14.817208 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18666497_7821_4df1_8cdb_f8c38ebd631b.slice/crio-9a8d7005bf3f28110e844f4a4ff93228c1672d17444a4822abf122a6a14c9209 WatchSource:0}: Error finding container 9a8d7005bf3f28110e844f4a4ff93228c1672d17444a4822abf122a6a14c9209: Status 404 returned error can't find the container with id 9a8d7005bf3f28110e844f4a4ff93228c1672d17444a4822abf122a6a14c9209 Jun 05 15:45:15.455327 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:15.455294 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j7x7q" event={"ID":"4e93bc1e-6e90-4caf-8ee2-3b75f92db389","Type":"ContainerStarted","Data":"cf87c1012534d4dc2eca6b60339704c008056f5a751ada17ec968c5b1372d62e"} Jun 05 15:45:15.456461 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:15.456437 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" event={"ID":"18666497-7821-4df1-8cdb-f8c38ebd631b","Type":"ContainerStarted","Data":"9a8d7005bf3f28110e844f4a4ff93228c1672d17444a4822abf122a6a14c9209"} Jun 05 15:45:15.471675 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:15.471254 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j7x7q" podStartSLOduration=2.0627187 podStartE2EDuration="4.47123738s" totalImagesPullingTime="2.40851868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:45:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:15.470390523 +0000 UTC m=+257.191964129" watchObservedRunningTime="2026-06-05 15:45:15.47123738 +0000 UTC m=+257.192810987" Jun 05 15:45:16.462449 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:16.462415 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" event={"ID":"18666497-7821-4df1-8cdb-f8c38ebd631b","Type":"ContainerStarted","Data":"5cd72b1830160030d56403f63a2a379cb51bb3c37761af1951b0341786956457"} Jun 05 15:45:16.462805 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:16.462468 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" event={"ID":"18666497-7821-4df1-8cdb-f8c38ebd631b","Type":"ContainerStarted","Data":"ed6dbfc264ea329089f9e12456006bc7a372f1d3799bc9dbf95141d122dde42a"} Jun 05 15:45:16.478728 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:16.478671 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-4m4ms" podStartSLOduration=0.999809257 podStartE2EDuration="2.478650889s" totalImagesPullingTime="1.478841632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:45:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:16.476601682 +0000 UTC m=+258.198175309" watchObservedRunningTime="2026-06-05 15:45:16.478650889 +0000 UTC m=+258.200224500" Jun 05 15:45:16.547637 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:16.547552 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:18.465350 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.465267 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:18.565616 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.565582 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:18.683443 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.683412 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:18.710621 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.710595 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z"] Jun 05 15:45:18.712623 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.712609 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:18.714829 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.714798 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 05 15:45:18.714903 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.714895 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 05 15:45:18.714953 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.714903 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9vdxp\"" Jun 05 15:45:18.719105 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.719033 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk"] Jun 05 15:45:18.721504 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.721489 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.723869 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.723826 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 05 15:45:18.724048 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.723889 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2b4c7\"" Jun 05 15:45:18.724048 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.723826 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 05 15:45:18.724228 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.723830 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 05 15:45:18.725305 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.725288 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z"] Jun 05 15:45:18.737195 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.737176 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk"] Jun 05 15:45:18.738326 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.738310 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x8tcs"] Jun 05 15:45:18.740490 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.740473 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.742794 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.742755 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 15:45:18.742917 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.742897 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zd9f8\"" Jun 05 15:45:18.742993 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.742953 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 15:45:18.743118 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.743092 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 15:45:18.756476 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756456 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66j4c\" (UniqueName: \"kubernetes.io/projected/96bf825c-8b70-4605-9788-e98cea334f5f-kube-api-access-66j4c\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.756560 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756485 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-accelerators-collector-config\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.756560 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-wtmp\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.756560 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756530 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bb10760-ffc8-4e98-b602-5bebf974f28f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-dvs8z\" (UID: \"8bb10760-ffc8-4e98-b602-5bebf974f28f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:18.756663 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756592 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e8e113b-6285-45bd-9066-81c3c56b54ca-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.756663 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756631 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e8e113b-6285-45bd-9066-81c3c56b54ca-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.756663 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756657 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e8e113b-6285-45bd-9066-81c3c56b54ca-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.756751 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756675 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96bf825c-8b70-4605-9788-e98cea334f5f-root\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.756751 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756690 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96bf825c-8b70-4605-9788-e98cea334f5f-sys\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.756751 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756709 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.756751 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756731 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bb10760-ffc8-4e98-b602-5bebf974f28f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-dvs8z\" (UID: \"8bb10760-ffc8-4e98-b602-5bebf974f28f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:18.756859 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756750 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e8e113b-6285-45bd-9066-81c3c56b54ca-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.756859 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756764 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fg8h\" (UniqueName: \"kubernetes.io/projected/2e8e113b-6285-45bd-9066-81c3c56b54ca-kube-api-access-2fg8h\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.756859 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e8e113b-6285-45bd-9066-81c3c56b54ca-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.756859 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756802 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-tls\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.756975 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756855 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m9dx\" (UniqueName: \"kubernetes.io/projected/8bb10760-ffc8-4e98-b602-5bebf974f28f-kube-api-access-5m9dx\") pod \"openshift-state-metrics-65f78d5c66-dvs8z\" (UID: \"8bb10760-ffc8-4e98-b602-5bebf974f28f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:18.756975 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-textfile\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.756975 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756902 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96bf825c-8b70-4605-9788-e98cea334f5f-metrics-client-ca\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.756975 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.756921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bb10760-ffc8-4e98-b602-5bebf974f28f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-dvs8z\" (UID: \"8bb10760-ffc8-4e98-b602-5bebf974f28f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:18.770272 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.770242 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:18.828719 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.828694 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:18.857948 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.857927 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e8e113b-6285-45bd-9066-81c3c56b54ca-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.858047 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.857954 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e8e113b-6285-45bd-9066-81c3c56b54ca-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.858047 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.857972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96bf825c-8b70-4605-9788-e98cea334f5f-root\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.858047 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.857988 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96bf825c-8b70-4605-9788-e98cea334f5f-sys\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.858047 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858027 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96bf825c-8b70-4605-9788-e98cea334f5f-root\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.858279 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858112 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.858279 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858152 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96bf825c-8b70-4605-9788-e98cea334f5f-sys\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.858279 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858164 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bb10760-ffc8-4e98-b602-5bebf974f28f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-dvs8z\" (UID: \"8bb10760-ffc8-4e98-b602-5bebf974f28f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:18.858279 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858187 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e8e113b-6285-45bd-9066-81c3c56b54ca-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.858279 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858202 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fg8h\" (UniqueName: \"kubernetes.io/projected/2e8e113b-6285-45bd-9066-81c3c56b54ca-kube-api-access-2fg8h\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.858279 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858222 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e8e113b-6285-45bd-9066-81c3c56b54ca-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.858279 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858249 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-tls\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.858279 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m9dx\" (UniqueName: \"kubernetes.io/projected/8bb10760-ffc8-4e98-b602-5bebf974f28f-kube-api-access-5m9dx\") pod \"openshift-state-metrics-65f78d5c66-dvs8z\" (UID: \"8bb10760-ffc8-4e98-b602-5bebf974f28f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:18.858640 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858309 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-textfile\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.858640 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858330 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96bf825c-8b70-4605-9788-e98cea334f5f-metrics-client-ca\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.858640 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858364 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bb10760-ffc8-4e98-b602-5bebf974f28f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-dvs8z\" (UID: \"8bb10760-ffc8-4e98-b602-5bebf974f28f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:18.858640 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858408 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66j4c\" (UniqueName: \"kubernetes.io/projected/96bf825c-8b70-4605-9788-e98cea334f5f-kube-api-access-66j4c\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.858640 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858439 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-accelerators-collector-config\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.858640 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858463 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-wtmp\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.858640 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858495 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bb10760-ffc8-4e98-b602-5bebf974f28f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-dvs8z\" (UID: \"8bb10760-ffc8-4e98-b602-5bebf974f28f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:18.858640 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858538 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e8e113b-6285-45bd-9066-81c3c56b54ca-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.858990 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858727 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e8e113b-6285-45bd-9066-81c3c56b54ca-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.858990 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858759 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-textfile\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.858990 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858902 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e8e113b-6285-45bd-9066-81c3c56b54ca-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.858990 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.858979 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-wtmp\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.859411 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.859379 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e8e113b-6285-45bd-9066-81c3c56b54ca-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.859519 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.859449 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-accelerators-collector-config\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.859613 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.859587 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bb10760-ffc8-4e98-b602-5bebf974f28f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-dvs8z\" (UID: \"8bb10760-ffc8-4e98-b602-5bebf974f28f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:18.859812 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.859786 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96bf825c-8b70-4605-9788-e98cea334f5f-metrics-client-ca\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.860698 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.860675 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e8e113b-6285-45bd-9066-81c3c56b54ca-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.861466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.861430 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bb10760-ffc8-4e98-b602-5bebf974f28f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-dvs8z\" (UID: \"8bb10760-ffc8-4e98-b602-5bebf974f28f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:18.861558 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.861526 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.861558 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.861548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bb10760-ffc8-4e98-b602-5bebf974f28f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-dvs8z\" (UID: \"8bb10760-ffc8-4e98-b602-5bebf974f28f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:18.861688 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.861678 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96bf825c-8b70-4605-9788-e98cea334f5f-node-exporter-tls\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.861796 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.861777 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e8e113b-6285-45bd-9066-81c3c56b54ca-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.865432 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.865411 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fg8h\" (UniqueName: \"kubernetes.io/projected/2e8e113b-6285-45bd-9066-81c3c56b54ca-kube-api-access-2fg8h\") pod \"kube-state-metrics-57bbf8bfb5-nnqxk\" (UID: \"2e8e113b-6285-45bd-9066-81c3c56b54ca\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:18.865678 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.865663 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m9dx\" (UniqueName: \"kubernetes.io/projected/8bb10760-ffc8-4e98-b602-5bebf974f28f-kube-api-access-5m9dx\") pod \"openshift-state-metrics-65f78d5c66-dvs8z\" (UID: \"8bb10760-ffc8-4e98-b602-5bebf974f28f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:18.865744 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.865723 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66j4c\" (UniqueName: \"kubernetes.io/projected/96bf825c-8b70-4605-9788-e98cea334f5f-kube-api-access-66j4c\") pod \"node-exporter-x8tcs\" (UID: \"96bf825c-8b70-4605-9788-e98cea334f5f\") " pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:18.926554 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:18.926515 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:19.021156 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.021116 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" Jun 05 15:45:19.030463 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.030434 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" Jun 05 15:45:19.050330 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.050303 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x8tcs" Jun 05 15:45:19.061639 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:45:19.061609 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96bf825c_8b70_4605_9788_e98cea334f5f.slice/crio-57890325784b5809ea979e8d20c94147e7213df3a356fa5be36abf29fb24812a WatchSource:0}: Error finding container 57890325784b5809ea979e8d20c94147e7213df3a356fa5be36abf29fb24812a: Status 404 returned error can't find the container with id 57890325784b5809ea979e8d20c94147e7213df3a356fa5be36abf29fb24812a Jun 05 15:45:19.071808 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.071779 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:19.162238 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.162204 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z"] Jun 05 15:45:19.165258 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:45:19.165230 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb10760_ffc8_4e98_b602_5bebf974f28f.slice/crio-d0116d535c9d7fbf95fb3f73e9ac825cc8405e6e7b4cf383154da401821f594c WatchSource:0}: Error finding container d0116d535c9d7fbf95fb3f73e9ac825cc8405e6e7b4cf383154da401821f594c: Status 404 returned error can't find the container with id d0116d535c9d7fbf95fb3f73e9ac825cc8405e6e7b4cf383154da401821f594c Jun 05 15:45:19.176662 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.176641 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk"] Jun 05 15:45:19.179386 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:45:19.179363 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e8e113b_6285_45bd_9066_81c3c56b54ca.slice/crio-6283fe5ae225ae84fb263ed0c6dbc793f382602591bb0504ebe02882f3998c76 WatchSource:0}: Error finding container 6283fe5ae225ae84fb263ed0c6dbc793f382602591bb0504ebe02882f3998c76: Status 404 returned error can't find the container with id 6283fe5ae225ae84fb263ed0c6dbc793f382602591bb0504ebe02882f3998c76 Jun 05 15:45:19.300492 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.300425 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:19.472564 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.472528 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" event={"ID":"2e8e113b-6285-45bd-9066-81c3c56b54ca","Type":"ContainerStarted","Data":"6283fe5ae225ae84fb263ed0c6dbc793f382602591bb0504ebe02882f3998c76"} Jun 05 15:45:19.474390 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.474367 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" event={"ID":"8bb10760-ffc8-4e98-b602-5bebf974f28f","Type":"ContainerStarted","Data":"026ac3e29fb4e34f5178fe76de8baa03bb99188954854488e6f1d32662e6f8a9"} Jun 05 15:45:19.474521 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.474421 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" event={"ID":"8bb10760-ffc8-4e98-b602-5bebf974f28f","Type":"ContainerStarted","Data":"7173f16b11fe84ac1a356713cab92ba5edb598bf1f22bb7a07e8b5471be64b43"} Jun 05 15:45:19.474521 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.474450 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" event={"ID":"8bb10760-ffc8-4e98-b602-5bebf974f28f","Type":"ContainerStarted","Data":"d0116d535c9d7fbf95fb3f73e9ac825cc8405e6e7b4cf383154da401821f594c"} Jun 05 15:45:19.475376 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.475356 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8tcs" event={"ID":"96bf825c-8b70-4605-9788-e98cea334f5f","Type":"ContainerStarted","Data":"57890325784b5809ea979e8d20c94147e7213df3a356fa5be36abf29fb24812a"} Jun 05 15:45:19.684117 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.683898 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:19.781658 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.780509 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 15:45:19.781658 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.780557 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:19.784607 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.784580 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.790556 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.788371 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 15:45:19.790556 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.788638 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 15:45:19.790556 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.788653 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 15:45:19.790556 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.788871 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c6m7v\"" Jun 05 15:45:19.790556 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.788888 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 15:45:19.790556 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.789064 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 15:45:19.790556 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.789075 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 15:45:19.790937 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.790612 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 15:45:19.791522 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.791151 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 15:45:19.791522 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.791358 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 15:45:19.796596 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.796556 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 15:45:19.870460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.869910 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.870460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.869956 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.870460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.869981 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ff4c62d-5b32-4670-85f0-730145193db6-config-out\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.870460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.870004 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.870460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.870032 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.870460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.870097 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.870460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.870137 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.870460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.870170 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.870460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.870200 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-web-config\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.870460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.870228 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.870460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.870248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ff4c62d-5b32-4670-85f0-730145193db6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.870460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.870275 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4vqm\" (UniqueName: \"kubernetes.io/projected/5ff4c62d-5b32-4670-85f0-730145193db6-kube-api-access-q4vqm\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.870460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.870306 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.971052 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.970948 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.971052 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.970993 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-web-config\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.971052 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.971023 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.971052 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.971047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ff4c62d-5b32-4670-85f0-730145193db6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.971393 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:45:19.971145 2566 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 05 15:45:19.971393 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:45:19.971215 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-main-tls podName:5ff4c62d-5b32-4670-85f0-730145193db6 nodeName:}" failed. No retries permitted until 2026-06-05 15:45:20.47119384 +0000 UTC m=+262.192767438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6") : secret "alertmanager-main-tls" not found Jun 05 15:45:19.971393 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.971338 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4vqm\" (UniqueName: \"kubernetes.io/projected/5ff4c62d-5b32-4670-85f0-730145193db6-kube-api-access-q4vqm\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.971544 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.971390 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.971544 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.971435 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.971544 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.971468 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.971544 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.971495 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ff4c62d-5b32-4670-85f0-730145193db6-config-out\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.971544 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.971520 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.971767 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.971551 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.971767 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:45:19.971579 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-trusted-ca-bundle podName:5ff4c62d-5b32-4670-85f0-730145193db6 nodeName:}" failed. No retries permitted until 2026-06-05 15:45:20.471560674 +0000 UTC m=+262.193134263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6") : configmap references non-existent config key: ca-bundle.crt Jun 05 15:45:19.971767 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.971674 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.971767 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.971714 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.973449 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.972871 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.973449 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.973118 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.974533 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.974495 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ff4c62d-5b32-4670-85f0-730145193db6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.974632 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.974562 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.974971 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.974906 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.975172 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.975150 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.975612 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.975586 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-web-config\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.977085 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.976974 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.977085 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.977049 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ff4c62d-5b32-4670-85f0-730145193db6-config-out\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.977371 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.977342 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:19.981852 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:19.981831 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4vqm\" (UniqueName: \"kubernetes.io/projected/5ff4c62d-5b32-4670-85f0-730145193db6-kube-api-access-q4vqm\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:20.077946 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:20.077887 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:20.476545 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:20.476499 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:20.477003 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:20.476575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:20.477555 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:20.477529 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:20.479552 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:20.479452 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:20.700714 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:20.700687 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:45:20.894398 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:20.894294 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 15:45:21.493225 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.493108 2566 generic.go:356] "Generic (PLEG): container finished" podID="96bf825c-8b70-4605-9788-e98cea334f5f" containerID="f847438ca28886ea7be4e5fbce011aede2ad74e205c13f3221938d38a219ef14" exitCode=0 Jun 05 15:45:21.493225 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.493166 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8tcs" event={"ID":"96bf825c-8b70-4605-9788-e98cea334f5f","Type":"ContainerDied","Data":"f847438ca28886ea7be4e5fbce011aede2ad74e205c13f3221938d38a219ef14"} Jun 05 15:45:21.494584 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.494560 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerStarted","Data":"c2a405a61e38dec3997717b06b8f292612b8dee6996794402b2c034865eb079f"} Jun 05 15:45:21.496793 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.496765 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" event={"ID":"2e8e113b-6285-45bd-9066-81c3c56b54ca","Type":"ContainerStarted","Data":"5be2964f005b084621c8f10b89b1fe4b0134d4f4edee316ed687c562154c7a81"} Jun 05 15:45:21.496881 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.496812 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" event={"ID":"2e8e113b-6285-45bd-9066-81c3c56b54ca","Type":"ContainerStarted","Data":"46f5ed9bd557d802c5f9b2c2f36bbc94b64a246a55f5d32491fff0813a1d70f9"} Jun 05 15:45:21.496881 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.496842 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" event={"ID":"2e8e113b-6285-45bd-9066-81c3c56b54ca","Type":"ContainerStarted","Data":"12fb07c59c85da4a13a5a004058210231e979802b5835b5dc60a5c1efefeaeed"} Jun 05 15:45:21.499194 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.499167 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" event={"ID":"8bb10760-ffc8-4e98-b602-5bebf974f28f","Type":"ContainerStarted","Data":"fb140bfaec656e640c6d82791328c0d155e2bfcda0ef9cfde5778b9fda4cf259"} Jun 05 15:45:21.527603 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.527559 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-nnqxk" podStartSLOduration=1.968836662 podStartE2EDuration="3.527541605s" totalImagesPullingTime="1.558704943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:45:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:21.52643758 +0000 UTC m=+263.248011185" watchObservedRunningTime="2026-06-05 15:45:21.527541605 +0000 UTC m=+263.249115211" Jun 05 15:45:21.543619 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.543574 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-dvs8z" podStartSLOduration=2.070069672 podStartE2EDuration="3.54355731s" totalImagesPullingTime="1.473487638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:45:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:21.542841985 +0000 UTC m=+263.264415593" watchObservedRunningTime="2026-06-05 15:45:21.54355731 +0000 UTC m=+263.265130953" Jun 05 15:45:21.614314 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.614268 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:21.688580 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.688530 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:21.692350 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.692328 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99"] Jun 05 15:45:21.696631 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.696603 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.698848 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.698826 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 05 15:45:21.698949 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.698911 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-27x8b\"" Jun 05 15:45:21.699016 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.698940 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 05 15:45:21.699249 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.699231 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 05 15:45:21.699491 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.699463 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 05 15:45:21.699491 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.699484 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eps3ufb1va6n7\"" Jun 05 15:45:21.699650 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.699499 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 05 15:45:21.707640 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.707620 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99"] Jun 05 15:45:21.787168 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.787070 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-grpc-tls\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.787309 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.787208 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-tls\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.787309 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.787238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.787309 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.787290 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.787431 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.787331 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dvvx\" (UniqueName: \"kubernetes.io/projected/d2ecb801-1f5f-4131-b896-02b6e2d93235-kube-api-access-5dvvx\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.787431 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.787367 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2ecb801-1f5f-4131-b896-02b6e2d93235-metrics-client-ca\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.787532 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.787509 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.787591 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.787563 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.888567 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.888535 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.888712 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.888573 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-grpc-tls\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.888712 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.888627 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-tls\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.888712 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.888643 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.888712 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.888668 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.888712 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.888690 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dvvx\" (UniqueName: \"kubernetes.io/projected/d2ecb801-1f5f-4131-b896-02b6e2d93235-kube-api-access-5dvvx\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.888963 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.888719 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2ecb801-1f5f-4131-b896-02b6e2d93235-metrics-client-ca\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.888963 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.888751 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.889564 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.889530 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2ecb801-1f5f-4131-b896-02b6e2d93235-metrics-client-ca\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.891196 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.891121 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.891475 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.891454 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.891557 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.891543 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-tls\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.891760 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.891734 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.891841 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.891739 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.891897 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.891842 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2ecb801-1f5f-4131-b896-02b6e2d93235-secret-grpc-tls\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:21.896919 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:21.896902 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dvvx\" (UniqueName: \"kubernetes.io/projected/d2ecb801-1f5f-4131-b896-02b6e2d93235-kube-api-access-5dvvx\") pod \"thanos-querier-7f5d57c9d5-6kw99\" (UID: \"d2ecb801-1f5f-4131-b896-02b6e2d93235\") " pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:22.008727 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:22.008704 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:22.137613 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:22.137583 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99"] Jun 05 15:45:22.140195 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:45:22.140168 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ecb801_1f5f_4131_b896_02b6e2d93235.slice/crio-2f00c8e4660176d65880ff7c36c98f92f296fbf9de2a6504c20970fb04f45133 WatchSource:0}: Error finding container 2f00c8e4660176d65880ff7c36c98f92f296fbf9de2a6504c20970fb04f45133: Status 404 returned error can't find the container with id 2f00c8e4660176d65880ff7c36c98f92f296fbf9de2a6504c20970fb04f45133 Jun 05 15:45:22.191244 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:22.191215 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:22.504998 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:22.504968 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8tcs" event={"ID":"96bf825c-8b70-4605-9788-e98cea334f5f","Type":"ContainerStarted","Data":"ceac9caf1f3874208de8c8599b1b1d4585afab08200e464a9d8fb0e1dda3d167"} Jun 05 15:45:22.505407 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:22.505026 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x8tcs" event={"ID":"96bf825c-8b70-4605-9788-e98cea334f5f","Type":"ContainerStarted","Data":"fefd5444e6f5c18d86f624d9545c84dbfd620095393e65f2d8e0148203770a7e"} Jun 05 15:45:22.506450 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:22.506428 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ff4c62d-5b32-4670-85f0-730145193db6" containerID="05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6" exitCode=0 Jun 05 15:45:22.506502 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:22.506492 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerDied","Data":"05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6"} Jun 05 15:45:22.507609 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:22.507586 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" event={"ID":"d2ecb801-1f5f-4131-b896-02b6e2d93235","Type":"ContainerStarted","Data":"2f00c8e4660176d65880ff7c36c98f92f296fbf9de2a6504c20970fb04f45133"} Jun 05 15:45:22.521804 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:22.521767 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x8tcs" podStartSLOduration=2.7517799739999997 podStartE2EDuration="4.521753563s" totalImagesPullingTime="1.673262283s" totalInitContainerRuntime="96.711306ms" isStatefulPod=true podCreationTimestamp="2026-06-05 15:45:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:22.520410306 +0000 UTC m=+264.241983926" watchObservedRunningTime="2026-06-05 15:45:22.521753563 +0000 UTC m=+264.243327169" Jun 05 15:45:22.727680 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:22.727649 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:23.481847 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:23.481809 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:24.138988 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:24.138947 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:24.524394 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:24.524367 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerStarted","Data":"191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5"} Jun 05 15:45:24.524520 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:24.524469 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerStarted","Data":"2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883"} Jun 05 15:45:24.524520 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:24.524502 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerStarted","Data":"18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296"} Jun 05 15:45:24.524622 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:24.524531 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerStarted","Data":"93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94"} Jun 05 15:45:24.524622 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:24.524556 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerStarted","Data":"4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a"} Jun 05 15:45:24.526437 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:24.526414 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" event={"ID":"d2ecb801-1f5f-4131-b896-02b6e2d93235","Type":"ContainerStarted","Data":"eccf447db3edb3105e53307d86ea5aeda5ef295b81ff516b84ded6d8077d63db"} Jun 05 15:45:24.526527 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:24.526482 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" event={"ID":"d2ecb801-1f5f-4131-b896-02b6e2d93235","Type":"ContainerStarted","Data":"b7e4acbc7bbe7e882c64512146d21a78080a278375b10c7a6e7f6fb56fe060db"} Jun 05 15:45:24.526527 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:24.526522 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" event={"ID":"d2ecb801-1f5f-4131-b896-02b6e2d93235","Type":"ContainerStarted","Data":"5f1dc8ae2fe9f225c8e7a3bbc4d039e3b68580ce98feb7c95795f6d13884524e"} Jun 05 15:45:24.871180 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:24.871107 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:25.532601 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:25.532570 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerStarted","Data":"efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff"} Jun 05 15:45:25.535320 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:25.535294 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" event={"ID":"d2ecb801-1f5f-4131-b896-02b6e2d93235","Type":"ContainerStarted","Data":"4931ec1b5bea1be136ab87f3fba282b54de5b77016ef24e9d26bf62cbb25711a"} Jun 05 15:45:25.535440 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:25.535348 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" event={"ID":"d2ecb801-1f5f-4131-b896-02b6e2d93235","Type":"ContainerStarted","Data":"c3041f34abfc57ca0018d0d0e6461fe4afa8d9ece58b04fcf3660bd2996e4e72"} Jun 05 15:45:25.535440 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:25.535377 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:25.535440 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:25.535402 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" event={"ID":"d2ecb801-1f5f-4131-b896-02b6e2d93235","Type":"ContainerStarted","Data":"2cbfd38878d1e7b86162ba66a4be48e11996427c16587d9367b68f938153b11c"} Jun 05 15:45:25.559254 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:25.559209 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.110851386 podStartE2EDuration="6.559196857s" totalImagesPullingTime="3.431051641s" totalInitContainerRuntime="17.29383ms" isStatefulPod=false podCreationTimestamp="2026-06-05 15:45:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:25.557330219 +0000 UTC m=+267.278903831" watchObservedRunningTime="2026-06-05 15:45:25.559196857 +0000 UTC m=+267.280770522" Jun 05 15:45:25.579085 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:25.579044 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" podStartSLOduration=1.688071025 podStartE2EDuration="4.579031468s" totalImagesPullingTime="2.890960443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:45:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:25.576391681 +0000 UTC m=+267.297965348" watchObservedRunningTime="2026-06-05 15:45:25.579031468 +0000 UTC m=+267.300605073" Jun 05 15:45:28.007900 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:28.007864 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:28.060553 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:28.060521 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:31.546233 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:31.546208 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f5d57c9d5-6kw99" Jun 05 15:45:32.088210 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:32.088178 2566 patch_prober.go:28] interesting pod/image-registry-666974fcdc-zp28f container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:45:32.088359 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:32.088241 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" podUID="b025e7ee-332b-4706-8d68-69dc93baedbf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:45:33.112926 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:33.112874 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:33.170555 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:33.170509 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:33.449641 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:33.449569 2566 patch_prober.go:28] interesting pod/image-registry-666974fcdc-zp28f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:45:33.449641 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:33.449631 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" podUID="b025e7ee-332b-4706-8d68-69dc93baedbf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:45:39.180472 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:45:39.180421 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8snkx" podUID="b59f8dd1-3894-45f9-9934-eda40274bfaf" Jun 05 15:45:39.588915 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:39.588884 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8snkx" Jun 05 15:45:42.087890 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.087860 2566 patch_prober.go:28] interesting pod/image-registry-666974fcdc-zp28f container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:45:42.088250 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.087912 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" podUID="b025e7ee-332b-4706-8d68-69dc93baedbf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:45:42.652289 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.652261 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:45:42.654441 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.654416 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b59f8dd1-3894-45f9-9934-eda40274bfaf-metrics-tls\") pod \"dns-default-8snkx\" (UID: \"b59f8dd1-3894-45f9-9934-eda40274bfaf\") " pod="openshift-dns/dns-default-8snkx" Jun 05 15:45:42.774139 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.774099 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-xtstf"] Jun 05 15:45:42.777732 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.777716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-xtstf" Jun 05 15:45:42.780054 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.780033 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 15:45:42.780177 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.780164 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-pr7m2\"" Jun 05 15:45:42.780405 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.780392 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 15:45:42.786366 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.786345 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-xtstf"] Jun 05 15:45:42.788912 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.788889 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:42.853761 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.853741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsvcj\" (UniqueName: \"kubernetes.io/projected/437cd6e9-8d1d-4b83-9185-5d87adecc324-kube-api-access-vsvcj\") pod \"downloads-6657875f97-xtstf\" (UID: \"437cd6e9-8d1d-4b83-9185-5d87adecc324\") " pod="openshift-console/downloads-6657875f97-xtstf" Jun 05 15:45:42.892642 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.892622 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n8cpf\"" Jun 05 15:45:42.896275 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.896252 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:42.901080 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.901065 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8snkx" Jun 05 15:45:42.954915 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.954892 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsvcj\" (UniqueName: \"kubernetes.io/projected/437cd6e9-8d1d-4b83-9185-5d87adecc324-kube-api-access-vsvcj\") pod \"downloads-6657875f97-xtstf\" (UID: \"437cd6e9-8d1d-4b83-9185-5d87adecc324\") " pod="openshift-console/downloads-6657875f97-xtstf" Jun 05 15:45:42.961741 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.961707 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:42.964992 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:42.964823 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsvcj\" (UniqueName: \"kubernetes.io/projected/437cd6e9-8d1d-4b83-9185-5d87adecc324-kube-api-access-vsvcj\") pod \"downloads-6657875f97-xtstf\" (UID: \"437cd6e9-8d1d-4b83-9185-5d87adecc324\") " pod="openshift-console/downloads-6657875f97-xtstf" Jun 05 15:45:43.028702 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.028681 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8snkx"] Jun 05 15:45:43.031285 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:45:43.031257 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb59f8dd1_3894_45f9_9934_eda40274bfaf.slice/crio-79ed70fdd508127a978e9eee63a1f5ab8d07fc7287c74fc53b067bd23bd3d14d WatchSource:0}: Error finding container 79ed70fdd508127a978e9eee63a1f5ab8d07fc7287c74fc53b067bd23bd3d14d: Status 404 returned error can't find the container with id 79ed70fdd508127a978e9eee63a1f5ab8d07fc7287c74fc53b067bd23bd3d14d Jun 05 15:45:43.031585 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.031561 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:43.081201 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.081174 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:43.087697 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.087674 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-xtstf" Jun 05 15:45:43.131366 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.131327 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:43.205330 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.205307 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-xtstf"] Jun 05 15:45:43.207153 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:45:43.207111 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod437cd6e9_8d1d_4b83_9185_5d87adecc324.slice/crio-50f5fa6fdfbe62baf89eedadbc2a93633d9c2ce6f1a5a8fb06de37df564daa46 WatchSource:0}: Error finding container 50f5fa6fdfbe62baf89eedadbc2a93633d9c2ce6f1a5a8fb06de37df564daa46: Status 404 returned error can't find the container with id 50f5fa6fdfbe62baf89eedadbc2a93633d9c2ce6f1a5a8fb06de37df564daa46 Jun 05 15:45:43.245000 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.244975 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:43.450312 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.450232 2566 patch_prober.go:28] interesting pod/image-registry-666974fcdc-zp28f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:45:43.450312 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.450280 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" podUID="b025e7ee-332b-4706-8d68-69dc93baedbf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:45:43.458883 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.458856 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:43.604830 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.604796 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8snkx" event={"ID":"b59f8dd1-3894-45f9-9934-eda40274bfaf","Type":"ContainerStarted","Data":"79ed70fdd508127a978e9eee63a1f5ab8d07fc7287c74fc53b067bd23bd3d14d"} Jun 05 15:45:43.606007 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.605977 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-xtstf" event={"ID":"437cd6e9-8d1d-4b83-9185-5d87adecc324","Type":"ContainerStarted","Data":"50f5fa6fdfbe62baf89eedadbc2a93633d9c2ce6f1a5a8fb06de37df564daa46"} Jun 05 15:45:43.650299 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.650242 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:43.699390 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:43.699355 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:44.617164 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:44.617120 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8snkx" event={"ID":"b59f8dd1-3894-45f9-9934-eda40274bfaf","Type":"ContainerStarted","Data":"0836ac76543a1d3e43fd1e5e7343610fa93910ed4f80eb9a66e99001e5192e1c"} Jun 05 15:45:44.656071 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:44.656035 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:44.858515 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:44.858473 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:44.959025 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:44.958992 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:45.269072 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:45.269041 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:45.318542 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:45.318507 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:45.624163 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:45.624070 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8snkx" event={"ID":"b59f8dd1-3894-45f9-9934-eda40274bfaf","Type":"ContainerStarted","Data":"df061138893e49737a4b8de71573cc2a531c360b1a3853f65e11535894702c8c"} Jun 05 15:45:45.624568 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:45.624188 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8snkx" Jun 05 15:45:45.639319 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:45.639247 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8snkx" podStartSLOduration=252.241072816 podStartE2EDuration="4m13.639228582s" totalImagesPullingTime="1.398155766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:41:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:45:45.638810152 +0000 UTC m=+287.360383771" watchObservedRunningTime="2026-06-05 15:45:45.639228582 +0000 UTC m=+287.360802192" Jun 05 15:45:52.089515 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.089476 2566 patch_prober.go:28] interesting pod/image-registry-666974fcdc-zp28f container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:45:52.089989 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.089537 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" podUID="b025e7ee-332b-4706-8d68-69dc93baedbf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:45:52.089989 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.089587 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:45:52.090145 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.090089 2566 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"7e38d3b034d124cb4861ca82bc8404bd4875c6d9abd6230812c11f49c060a6b3"} pod="openshift-image-registry/image-registry-666974fcdc-zp28f" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 15:45:52.093989 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.093961 2566 patch_prober.go:28] interesting pod/image-registry-666974fcdc-zp28f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:45:52.094084 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.094012 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" podUID="b025e7ee-332b-4706-8d68-69dc93baedbf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:45:52.492840 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.492796 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54fc498487-7ns5r"] Jun 05 15:45:52.499376 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.499351 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.503472 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.503350 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 15:45:52.503979 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.503844 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dqdrz\"" Jun 05 15:45:52.503979 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.503911 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 15:45:52.504420 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.504080 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 15:45:52.504420 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.504112 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 15:45:52.504420 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.504192 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 15:45:52.504586 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.504447 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fc498487-7ns5r"] Jun 05 15:45:52.636822 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.636791 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-console-config\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.636968 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.636831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b59503b-27a5-4a25-a70d-483f4585604f-console-serving-cert\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.636968 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.636862 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-service-ca\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.636968 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.636921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-oauth-serving-cert\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.636968 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.636938 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b59503b-27a5-4a25-a70d-483f4585604f-console-oauth-config\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.636968 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.636963 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99m5c\" (UniqueName: \"kubernetes.io/projected/9b59503b-27a5-4a25-a70d-483f4585604f-kube-api-access-99m5c\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.738228 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.738199 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-service-ca\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.738412 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.738263 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-oauth-serving-cert\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.738412 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.738289 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b59503b-27a5-4a25-a70d-483f4585604f-console-oauth-config\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.738412 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.738326 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99m5c\" (UniqueName: \"kubernetes.io/projected/9b59503b-27a5-4a25-a70d-483f4585604f-kube-api-access-99m5c\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.738566 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.738461 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-console-config\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.738566 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.738506 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b59503b-27a5-4a25-a70d-483f4585604f-console-serving-cert\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.739047 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.739000 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-oauth-serving-cert\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.739047 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.739014 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-service-ca\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.739268 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.739251 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-console-config\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.741444 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.741421 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b59503b-27a5-4a25-a70d-483f4585604f-console-oauth-config\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.741555 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.741476 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b59503b-27a5-4a25-a70d-483f4585604f-console-serving-cert\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.746738 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.746688 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99m5c\" (UniqueName: \"kubernetes.io/projected/9b59503b-27a5-4a25-a70d-483f4585604f-kube-api-access-99m5c\") pod \"console-54fc498487-7ns5r\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.811270 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.811239 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:45:52.963050 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:52.962966 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fc498487-7ns5r"] Jun 05 15:45:52.965356 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:45:52.965326 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b59503b_27a5_4a25_a70d_483f4585604f.slice/crio-c6a2953d5dca1b02c8ccbf2dd93a0da650cd95daeea1c9962c9a351ddb3fabc9 WatchSource:0}: Error finding container c6a2953d5dca1b02c8ccbf2dd93a0da650cd95daeea1c9962c9a351ddb3fabc9: Status 404 returned error can't find the container with id c6a2953d5dca1b02c8ccbf2dd93a0da650cd95daeea1c9962c9a351ddb3fabc9 Jun 05 15:45:53.661092 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:53.661049 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fc498487-7ns5r" event={"ID":"9b59503b-27a5-4a25-a70d-483f4585604f","Type":"ContainerStarted","Data":"c6a2953d5dca1b02c8ccbf2dd93a0da650cd95daeea1c9962c9a351ddb3fabc9"} Jun 05 15:45:55.631922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:55.631890 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8snkx" Jun 05 15:45:57.599728 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:57.599691 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:57.699681 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:57.699649 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:57.748970 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:57.748933 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:45:59.930556 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:59.930526 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 15:45:59.930556 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:59.930554 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 15:45:59.933376 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:45:59.933356 2566 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 15:46:00.701663 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:00.701635 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-xtstf" Jun 05 15:46:00.701853 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:00.701682 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-xtstf" event={"ID":"437cd6e9-8d1d-4b83-9185-5d87adecc324","Type":"ContainerStarted","Data":"a84fc39481bc6a5858be431a7765277fb9b263d458e7d461195539f10525a943"} Jun 05 15:46:00.707846 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:00.707817 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-xtstf" Jun 05 15:46:00.713791 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:00.713733 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-xtstf" podStartSLOduration=1.928820996 podStartE2EDuration="18.71371553s" totalImagesPullingTime="16.784894534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:46:00.713418045 +0000 UTC m=+302.434991665" watchObservedRunningTime="2026-06-05 15:46:00.71371553 +0000 UTC m=+302.435289138" Jun 05 15:46:01.272277 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.272242 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64d8479b76-7sv5r"] Jun 05 15:46:01.276873 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.276838 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.284059 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.283997 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d8479b76-7sv5r"] Jun 05 15:46:01.285544 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.285520 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 15:46:01.420595 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.420554 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-console-config\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.420788 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.420601 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-trusted-ca-bundle\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.420788 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.420684 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e51c5747-e061-40e1-8ea1-49852986e36b-console-oauth-config\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.420788 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.420733 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzn4x\" (UniqueName: \"kubernetes.io/projected/e51c5747-e061-40e1-8ea1-49852986e36b-kube-api-access-pzn4x\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.420956 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.420835 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e51c5747-e061-40e1-8ea1-49852986e36b-console-serving-cert\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.420956 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.420858 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-oauth-serving-cert\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.420956 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.420888 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-service-ca\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.474306 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.474263 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:01.521724 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.521675 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-console-config\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.521724 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.521725 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-trusted-ca-bundle\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.522031 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.521765 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e51c5747-e061-40e1-8ea1-49852986e36b-console-oauth-config\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.522031 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.521793 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzn4x\" (UniqueName: \"kubernetes.io/projected/e51c5747-e061-40e1-8ea1-49852986e36b-kube-api-access-pzn4x\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.522031 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.521898 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e51c5747-e061-40e1-8ea1-49852986e36b-console-serving-cert\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.522031 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.521923 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-oauth-serving-cert\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.522031 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.521957 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-service-ca\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.523119 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.523007 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-service-ca\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.523119 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.523066 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-oauth-serving-cert\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.524172 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.523758 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-console-config\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.524172 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.524113 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-trusted-ca-bundle\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.525987 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.525927 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e51c5747-e061-40e1-8ea1-49852986e36b-console-serving-cert\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.527541 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.527500 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e51c5747-e061-40e1-8ea1-49852986e36b-console-oauth-config\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.531651 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.531609 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzn4x\" (UniqueName: \"kubernetes.io/projected/e51c5747-e061-40e1-8ea1-49852986e36b-kube-api-access-pzn4x\") pod \"console-64d8479b76-7sv5r\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.592626 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.592585 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:01.765089 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.765058 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d8479b76-7sv5r"] Jun 05 15:46:01.767161 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:46:01.767109 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode51c5747_e061_40e1_8ea1_49852986e36b.slice/crio-859de77568a23e8932f7aae0fa9d451738cb9a73d98c68e2a071bd24e72212d4 WatchSource:0}: Error finding container 859de77568a23e8932f7aae0fa9d451738cb9a73d98c68e2a071bd24e72212d4: Status 404 returned error can't find the container with id 859de77568a23e8932f7aae0fa9d451738cb9a73d98c68e2a071bd24e72212d4 Jun 05 15:46:01.769686 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.769666 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 15:46:01.980068 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:01.979981 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:02.065679 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:02.065642 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:02.096073 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:02.096041 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:46:02.211898 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:02.211805 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:02.312039 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:02.312003 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:02.362814 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:02.362782 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:02.550281 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:02.550182 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8snkx_b59f8dd1-3894-45f9-9934-eda40274bfaf/dns/0.log" Jun 05 15:46:02.711345 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:02.711232 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d8479b76-7sv5r" event={"ID":"e51c5747-e061-40e1-8ea1-49852986e36b","Type":"ContainerStarted","Data":"859de77568a23e8932f7aae0fa9d451738cb9a73d98c68e2a071bd24e72212d4"} Jun 05 15:46:02.749490 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:02.749461 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8snkx_b59f8dd1-3894-45f9-9934-eda40274bfaf/kube-rbac-proxy/0.log" Jun 05 15:46:03.549109 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:03.549079 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tj9xd_49801bfa-cb30-4035-bcb1-96e59be88b6e/dns-node-resolver/0.log" Jun 05 15:46:04.150401 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:04.150294 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-666974fcdc-zp28f_b025e7ee-332b-4706-8d68-69dc93baedbf/registry/0.log" Jun 05 15:46:04.351558 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:04.351528 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-925tg_49be8ffd-e1cf-46cf-b32e-fec25dce31a0/node-ca/0.log" Jun 05 15:46:04.722852 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:04.722812 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d8479b76-7sv5r" event={"ID":"e51c5747-e061-40e1-8ea1-49852986e36b","Type":"ContainerStarted","Data":"46292310b5c4f89ae3a3b8e19ca063679565648611603180f4795132cf12f98a"} Jun 05 15:46:04.724656 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:04.724622 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fc498487-7ns5r" event={"ID":"9b59503b-27a5-4a25-a70d-483f4585604f","Type":"ContainerStarted","Data":"58a2e5c3ab5537382cb6214d720b9a20d072c86d307f49c45f57971bfe5f24f7"} Jun 05 15:46:04.739816 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:04.739770 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64d8479b76-7sv5r" podStartSLOduration=1.834258931 podStartE2EDuration="3.739738727s" totalImagesPullingTime="1.905479796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:46:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:46:04.738163498 +0000 UTC m=+306.459737130" watchObservedRunningTime="2026-06-05 15:46:04.739738727 +0000 UTC m=+306.461312315" Jun 05 15:46:04.753352 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:04.753308 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54fc498487-7ns5r" podStartSLOduration=2.046734977 podStartE2EDuration="12.75329084s" totalImagesPullingTime="10.706555863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:45:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:46:04.752668194 +0000 UTC m=+306.474241817" watchObservedRunningTime="2026-06-05 15:46:04.75329084 +0000 UTC m=+306.474864448" Jun 05 15:46:05.549239 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:05.549205 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nhnzl_4b8db554-fe76-4d33-863d-183d1a2bba0d/serve-healthcheck-canary/0.log" Jun 05 15:46:08.200690 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:08.200653 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:08.254996 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:08.254959 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:10.139607 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:10.139570 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:10.192257 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:10.192230 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:10.282240 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:10.282207 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:10.333521 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:10.333501 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:10.484193 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:10.484170 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:10.751324 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:10.751269 2566 generic.go:356] "Generic (PLEG): container finished" podID="4ed088fb-2961-42d5-bc2f-56ef34be887c" containerID="7885fa0072066ecf91c33cab9e564375b2d5e945071579f82579d75184139781" exitCode=0 Jun 05 15:46:10.751427 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:10.751344 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" event={"ID":"4ed088fb-2961-42d5-bc2f-56ef34be887c","Type":"ContainerDied","Data":"7885fa0072066ecf91c33cab9e564375b2d5e945071579f82579d75184139781"} Jun 05 15:46:10.751615 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:10.751600 2566 scope.go:117] "RemoveContainer" containerID="7885fa0072066ecf91c33cab9e564375b2d5e945071579f82579d75184139781" Jun 05 15:46:11.593814 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:11.593779 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:11.594325 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:11.593882 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:11.598375 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:11.598357 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:11.757743 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:11.757709 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jvqw8" event={"ID":"4ed088fb-2961-42d5-bc2f-56ef34be887c","Type":"ContainerStarted","Data":"94f091f5115f37dc926936dad08106b2c7ca0baffde5abb5b5bc30fb7369ef7b"} Jun 05 15:46:11.761574 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:11.761553 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:46:11.812813 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:11.812780 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54fc498487-7ns5r"] Jun 05 15:46:12.104679 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:12.104639 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:12.205723 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:12.205690 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:12.610191 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:12.610159 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:12.706684 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:12.706636 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:12.812014 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:12.811985 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:46:13.320085 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:13.320046 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:17.112055 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:17.112019 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" podUID="b025e7ee-332b-4706-8d68-69dc93baedbf" containerName="registry" containerID="cri-o://7e38d3b034d124cb4861ca82bc8404bd4875c6d9abd6230812c11f49c060a6b3" gracePeriod=30 Jun 05 15:46:17.265503 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:17.265471 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:17.318871 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:17.318841 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:18.791526 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:18.791497 2566 generic.go:356] "Generic (PLEG): container finished" podID="b025e7ee-332b-4706-8d68-69dc93baedbf" containerID="7e38d3b034d124cb4861ca82bc8404bd4875c6d9abd6230812c11f49c060a6b3" exitCode=0 Jun 05 15:46:18.791885 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:18.791587 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" event={"ID":"b025e7ee-332b-4706-8d68-69dc93baedbf","Type":"ContainerDied","Data":"7e38d3b034d124cb4861ca82bc8404bd4875c6d9abd6230812c11f49c060a6b3"} Jun 05 15:46:18.791885 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:18.791703 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:46:18.791885 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:18.791723 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" event={"ID":"b025e7ee-332b-4706-8d68-69dc93baedbf","Type":"ContainerStarted","Data":"896c46d41641ee8874cc9a8f7c82ae236cd4efe60215ad4cc88651a6da3e592d"} Jun 05 15:46:19.075580 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:19.075501 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:19.176909 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:19.176878 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:19.996983 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:19.996951 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:20.046612 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:20.046582 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:27.533825 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:27.533785 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:27.634501 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:27.634473 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:27.682984 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:27.682953 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:33.997565 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:33.997534 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:34.094951 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:34.094916 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:34.143869 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:34.143840 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:34.746756 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:34.746726 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:34.798362 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:34.798334 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:35.247156 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.247111 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f7b75fc54-tqgbt"] Jun 05 15:46:35.288508 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.288477 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:35.298211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.298176 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7b75fc54-tqgbt"] Jun 05 15:46:35.298349 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.298318 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.399618 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.399591 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-oauth-config\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.399719 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.399623 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-trusted-ca-bundle\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.399719 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.399662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kczgv\" (UniqueName: \"kubernetes.io/projected/46aec6c9-ea66-4328-a5dd-30d35add21c8-kube-api-access-kczgv\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.399803 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.399724 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-oauth-serving-cert\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.399803 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.399767 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-config\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.399876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.399800 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-serving-cert\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.399876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.399824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-service-ca\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.500771 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.500711 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kczgv\" (UniqueName: \"kubernetes.io/projected/46aec6c9-ea66-4328-a5dd-30d35add21c8-kube-api-access-kczgv\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.500771 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.500740 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-oauth-serving-cert\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.500771 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.500758 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-config\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.500977 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.500782 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-serving-cert\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.500977 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.500922 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-service-ca\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.501072 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.501001 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-oauth-config\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.501072 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.501027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-trusted-ca-bundle\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.501471 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.501452 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-config\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.501577 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.501486 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-oauth-serving-cert\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.501658 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.501635 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-service-ca\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.501808 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.501793 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-trusted-ca-bundle\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.503172 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.503157 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-serving-cert\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.503263 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.503247 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-oauth-config\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.508060 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.508036 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kczgv\" (UniqueName: \"kubernetes.io/projected/46aec6c9-ea66-4328-a5dd-30d35add21c8-kube-api-access-kczgv\") pod \"console-5f7b75fc54-tqgbt\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.607338 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.607314 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:35.748628 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.748608 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7b75fc54-tqgbt"] Jun 05 15:46:35.750428 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:46:35.750407 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46aec6c9_ea66_4328_a5dd_30d35add21c8.slice/crio-a328868b0050c5bf2b34677932e0861e1eeb9bf792f2d5ad11ccc6bb3d251d6f WatchSource:0}: Error finding container a328868b0050c5bf2b34677932e0861e1eeb9bf792f2d5ad11ccc6bb3d251d6f: Status 404 returned error can't find the container with id a328868b0050c5bf2b34677932e0861e1eeb9bf792f2d5ad11ccc6bb3d251d6f Jun 05 15:46:35.858657 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:35.858632 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7b75fc54-tqgbt" event={"ID":"46aec6c9-ea66-4328-a5dd-30d35add21c8","Type":"ContainerStarted","Data":"a328868b0050c5bf2b34677932e0861e1eeb9bf792f2d5ad11ccc6bb3d251d6f"} Jun 05 15:46:36.702035 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:36.702002 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:36.751792 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:36.751749 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:36.836280 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:36.836252 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54fc498487-7ns5r" podUID="9b59503b-27a5-4a25-a70d-483f4585604f" containerName="console" containerID="cri-o://58a2e5c3ab5537382cb6214d720b9a20d072c86d307f49c45f57971bfe5f24f7" gracePeriod=15 Jun 05 15:46:36.868576 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:36.868544 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7b75fc54-tqgbt" event={"ID":"46aec6c9-ea66-4328-a5dd-30d35add21c8","Type":"ContainerStarted","Data":"2ec1a67976742e4f3a41456b3e5f7f5752b341d8902c2be4980496b474913af3"} Jun 05 15:46:36.885171 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:36.885083 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f7b75fc54-tqgbt" podStartSLOduration=1.8850712920000001 podStartE2EDuration="1.885071292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:46:36.883417458 +0000 UTC m=+338.604991100" watchObservedRunningTime="2026-06-05 15:46:36.885071292 +0000 UTC m=+338.606644899" Jun 05 15:46:37.106601 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.106578 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:46:37.216874 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.216815 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99m5c\" (UniqueName: \"kubernetes.io/projected/9b59503b-27a5-4a25-a70d-483f4585604f-kube-api-access-99m5c\") pod \"9b59503b-27a5-4a25-a70d-483f4585604f\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " Jun 05 15:46:37.216874 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.216867 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-oauth-serving-cert\") pod \"9b59503b-27a5-4a25-a70d-483f4585604f\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " Jun 05 15:46:37.217044 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.216905 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-service-ca\") pod \"9b59503b-27a5-4a25-a70d-483f4585604f\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " Jun 05 15:46:37.217044 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.216960 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b59503b-27a5-4a25-a70d-483f4585604f-console-serving-cert\") pod \"9b59503b-27a5-4a25-a70d-483f4585604f\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " Jun 05 15:46:37.217044 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.216990 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b59503b-27a5-4a25-a70d-483f4585604f-console-oauth-config\") pod \"9b59503b-27a5-4a25-a70d-483f4585604f\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " Jun 05 15:46:37.217044 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.217035 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-console-config\") pod \"9b59503b-27a5-4a25-a70d-483f4585604f\" (UID: \"9b59503b-27a5-4a25-a70d-483f4585604f\") " Jun 05 15:46:37.217374 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.217345 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9b59503b-27a5-4a25-a70d-483f4585604f" (UID: "9b59503b-27a5-4a25-a70d-483f4585604f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:46:37.217461 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.217352 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-service-ca" (OuterVolumeSpecName: "service-ca") pod "9b59503b-27a5-4a25-a70d-483f4585604f" (UID: "9b59503b-27a5-4a25-a70d-483f4585604f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:46:37.217461 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.217438 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-console-config" (OuterVolumeSpecName: "console-config") pod "9b59503b-27a5-4a25-a70d-483f4585604f" (UID: "9b59503b-27a5-4a25-a70d-483f4585604f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:46:37.219028 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.219005 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b59503b-27a5-4a25-a70d-483f4585604f-kube-api-access-99m5c" (OuterVolumeSpecName: "kube-api-access-99m5c") pod "9b59503b-27a5-4a25-a70d-483f4585604f" (UID: "9b59503b-27a5-4a25-a70d-483f4585604f"). InnerVolumeSpecName "kube-api-access-99m5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:46:37.219138 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.219006 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b59503b-27a5-4a25-a70d-483f4585604f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9b59503b-27a5-4a25-a70d-483f4585604f" (UID: "9b59503b-27a5-4a25-a70d-483f4585604f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:46:37.219138 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.219036 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b59503b-27a5-4a25-a70d-483f4585604f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9b59503b-27a5-4a25-a70d-483f4585604f" (UID: "9b59503b-27a5-4a25-a70d-483f4585604f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:46:37.317986 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.317965 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-console-config\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:37.317986 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.317984 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99m5c\" (UniqueName: \"kubernetes.io/projected/9b59503b-27a5-4a25-a70d-483f4585604f-kube-api-access-99m5c\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:37.318116 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.317993 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-oauth-serving-cert\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:37.318116 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.318001 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b59503b-27a5-4a25-a70d-483f4585604f-service-ca\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:37.318116 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.318011 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b59503b-27a5-4a25-a70d-483f4585604f-console-serving-cert\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:37.318116 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.318019 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b59503b-27a5-4a25-a70d-483f4585604f-console-oauth-config\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:37.874980 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.874947 2566 generic.go:356] "Generic (PLEG): container finished" podID="9b59503b-27a5-4a25-a70d-483f4585604f" containerID="58a2e5c3ab5537382cb6214d720b9a20d072c86d307f49c45f57971bfe5f24f7" exitCode=0 Jun 05 15:46:37.875543 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.874982 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fc498487-7ns5r" event={"ID":"9b59503b-27a5-4a25-a70d-483f4585604f","Type":"ContainerDied","Data":"58a2e5c3ab5537382cb6214d720b9a20d072c86d307f49c45f57971bfe5f24f7"} Jun 05 15:46:37.875543 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.875004 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fc498487-7ns5r" Jun 05 15:46:37.875543 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.875032 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fc498487-7ns5r" event={"ID":"9b59503b-27a5-4a25-a70d-483f4585604f","Type":"ContainerDied","Data":"c6a2953d5dca1b02c8ccbf2dd93a0da650cd95daeea1c9962c9a351ddb3fabc9"} Jun 05 15:46:37.875543 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.875062 2566 scope.go:117] "RemoveContainer" containerID="58a2e5c3ab5537382cb6214d720b9a20d072c86d307f49c45f57971bfe5f24f7" Jun 05 15:46:37.884984 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.884965 2566 scope.go:117] "RemoveContainer" containerID="58a2e5c3ab5537382cb6214d720b9a20d072c86d307f49c45f57971bfe5f24f7" Jun 05 15:46:37.885296 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:46:37.885278 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58a2e5c3ab5537382cb6214d720b9a20d072c86d307f49c45f57971bfe5f24f7\": container with ID starting with 58a2e5c3ab5537382cb6214d720b9a20d072c86d307f49c45f57971bfe5f24f7 not found: ID does not exist" containerID="58a2e5c3ab5537382cb6214d720b9a20d072c86d307f49c45f57971bfe5f24f7" Jun 05 15:46:37.885381 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.885308 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a2e5c3ab5537382cb6214d720b9a20d072c86d307f49c45f57971bfe5f24f7"} err="failed to get container status \"58a2e5c3ab5537382cb6214d720b9a20d072c86d307f49c45f57971bfe5f24f7\": rpc error: code = NotFound desc = could not find container \"58a2e5c3ab5537382cb6214d720b9a20d072c86d307f49c45f57971bfe5f24f7\": container with ID starting with 58a2e5c3ab5537382cb6214d720b9a20d072c86d307f49c45f57971bfe5f24f7 not found: ID does not exist" Jun 05 15:46:37.895604 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.895575 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54fc498487-7ns5r"] Jun 05 15:46:37.899281 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:37.899253 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54fc498487-7ns5r"] Jun 05 15:46:38.698200 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:38.698165 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b59503b-27a5-4a25-a70d-483f4585604f" path="/var/lib/kubelet/pods/9b59503b-27a5-4a25-a70d-483f4585604f/volumes" Jun 05 15:46:38.975153 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:38.975037 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 15:46:38.975736 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:38.975699 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="alertmanager" containerID="cri-o://4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a" gracePeriod=120 Jun 05 15:46:38.976056 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:38.976003 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="kube-rbac-proxy" containerID="cri-o://2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883" gracePeriod=120 Jun 05 15:46:38.976221 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:38.976201 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="prom-label-proxy" containerID="cri-o://efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff" gracePeriod=120 Jun 05 15:46:38.976309 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:38.976277 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="kube-rbac-proxy-web" containerID="cri-o://18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296" gracePeriod=120 Jun 05 15:46:38.976681 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:38.976280 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="kube-rbac-proxy-metric" containerID="cri-o://191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5" gracePeriod=120 Jun 05 15:46:38.976787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:38.976319 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="config-reloader" containerID="cri-o://93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94" gracePeriod=120 Jun 05 15:46:39.800296 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:39.800269 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-666974fcdc-zp28f" Jun 05 15:46:39.886991 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:39.886954 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ff4c62d-5b32-4670-85f0-730145193db6" containerID="efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff" exitCode=0 Jun 05 15:46:39.886991 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:39.886985 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ff4c62d-5b32-4670-85f0-730145193db6" containerID="2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883" exitCode=0 Jun 05 15:46:39.886991 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:39.886992 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ff4c62d-5b32-4670-85f0-730145193db6" containerID="93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94" exitCode=0 Jun 05 15:46:39.886991 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:39.886997 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ff4c62d-5b32-4670-85f0-730145193db6" containerID="4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a" exitCode=0 Jun 05 15:46:39.887295 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:39.887024 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerDied","Data":"efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff"} Jun 05 15:46:39.887295 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:39.887082 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerDied","Data":"2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883"} Jun 05 15:46:39.887295 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:39.887109 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerDied","Data":"93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94"} Jun 05 15:46:39.887295 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:39.887154 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerDied","Data":"4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a"} Jun 05 15:46:40.068681 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.068655 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:40.116237 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.116211 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:40.254085 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.254062 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:40.342640 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.342578 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5ff4c62d-5b32-4670-85f0-730145193db6\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " Jun 05 15:46:40.342640 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.342613 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-trusted-ca-bundle\") pod \"5ff4c62d-5b32-4670-85f0-730145193db6\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " Jun 05 15:46:40.342808 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.342667 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-web-config\") pod \"5ff4c62d-5b32-4670-85f0-730145193db6\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " Jun 05 15:46:40.342808 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.342693 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4vqm\" (UniqueName: \"kubernetes.io/projected/5ff4c62d-5b32-4670-85f0-730145193db6-kube-api-access-q4vqm\") pod \"5ff4c62d-5b32-4670-85f0-730145193db6\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " Jun 05 15:46:40.342808 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.342737 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-metrics-client-ca\") pod \"5ff4c62d-5b32-4670-85f0-730145193db6\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " Jun 05 15:46:40.342933 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.342871 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ff4c62d-5b32-4670-85f0-730145193db6-config-out\") pod \"5ff4c62d-5b32-4670-85f0-730145193db6\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " Jun 05 15:46:40.342933 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.342914 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy\") pod \"5ff4c62d-5b32-4670-85f0-730145193db6\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " Jun 05 15:46:40.343031 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.342955 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-cluster-tls-config\") pod \"5ff4c62d-5b32-4670-85f0-730145193db6\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " Jun 05 15:46:40.343031 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.342996 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-main-db\") pod \"5ff4c62d-5b32-4670-85f0-730145193db6\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " Jun 05 15:46:40.343161 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.343037 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-main-tls\") pod \"5ff4c62d-5b32-4670-85f0-730145193db6\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " Jun 05 15:46:40.343161 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.343072 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5ff4c62d-5b32-4670-85f0-730145193db6" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:46:40.343161 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.343080 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-config-volume\") pod \"5ff4c62d-5b32-4670-85f0-730145193db6\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " Jun 05 15:46:40.343161 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.343096 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5ff4c62d-5b32-4670-85f0-730145193db6" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:46:40.343161 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.343153 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ff4c62d-5b32-4670-85f0-730145193db6-tls-assets\") pod \"5ff4c62d-5b32-4670-85f0-730145193db6\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " Jun 05 15:46:40.343414 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.343187 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy-web\") pod \"5ff4c62d-5b32-4670-85f0-730145193db6\" (UID: \"5ff4c62d-5b32-4670-85f0-730145193db6\") " Jun 05 15:46:40.343414 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.343441 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5ff4c62d-5b32-4670-85f0-730145193db6" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:46:40.343414 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.343559 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-metrics-client-ca\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:40.343414 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.343578 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-main-db\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:40.343414 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.343593 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ff4c62d-5b32-4670-85f0-730145193db6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:40.345800 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.345776 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ff4c62d-5b32-4670-85f0-730145193db6-kube-api-access-q4vqm" (OuterVolumeSpecName: "kube-api-access-q4vqm") pod "5ff4c62d-5b32-4670-85f0-730145193db6" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6"). InnerVolumeSpecName "kube-api-access-q4vqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:46:40.346226 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.346070 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5ff4c62d-5b32-4670-85f0-730145193db6" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:46:40.346226 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.346120 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5ff4c62d-5b32-4670-85f0-730145193db6" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:46:40.346226 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.346193 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-config-volume" (OuterVolumeSpecName: "config-volume") pod "5ff4c62d-5b32-4670-85f0-730145193db6" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:46:40.346484 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.346460 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5ff4c62d-5b32-4670-85f0-730145193db6" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:46:40.346566 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.346481 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5ff4c62d-5b32-4670-85f0-730145193db6" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:46:40.346783 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.346766 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ff4c62d-5b32-4670-85f0-730145193db6-config-out" (OuterVolumeSpecName: "config-out") pod "5ff4c62d-5b32-4670-85f0-730145193db6" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:46:40.347623 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.347606 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ff4c62d-5b32-4670-85f0-730145193db6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5ff4c62d-5b32-4670-85f0-730145193db6" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:46:40.349712 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.349688 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5ff4c62d-5b32-4670-85f0-730145193db6" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:46:40.356834 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.356812 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-web-config" (OuterVolumeSpecName: "web-config") pod "5ff4c62d-5b32-4670-85f0-730145193db6" (UID: "5ff4c62d-5b32-4670-85f0-730145193db6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:46:40.444193 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.444171 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:40.444193 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.444194 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-web-config\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:40.444314 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.444205 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4vqm\" (UniqueName: \"kubernetes.io/projected/5ff4c62d-5b32-4670-85f0-730145193db6-kube-api-access-q4vqm\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:40.444314 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.444212 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ff4c62d-5b32-4670-85f0-730145193db6-config-out\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:40.444314 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.444220 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:40.444314 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.444229 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-cluster-tls-config\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:40.444314 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.444237 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-main-tls\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:40.444314 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.444245 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-config-volume\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:40.444314 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.444252 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ff4c62d-5b32-4670-85f0-730145193db6-tls-assets\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:40.444314 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.444260 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ff4c62d-5b32-4670-85f0-730145193db6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:46:40.893429 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.893397 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ff4c62d-5b32-4670-85f0-730145193db6" containerID="191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5" exitCode=0 Jun 05 15:46:40.893429 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.893419 2566 generic.go:356] "Generic (PLEG): container finished" podID="5ff4c62d-5b32-4670-85f0-730145193db6" containerID="18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296" exitCode=0 Jun 05 15:46:40.893587 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.893443 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerDied","Data":"191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5"} Jun 05 15:46:40.893587 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.893478 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:40.893587 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.893526 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerDied","Data":"18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296"} Jun 05 15:46:40.893587 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.893570 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ff4c62d-5b32-4670-85f0-730145193db6","Type":"ContainerDied","Data":"c2a405a61e38dec3997717b06b8f292612b8dee6996794402b2c034865eb079f"} Jun 05 15:46:40.893723 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.893590 2566 scope.go:117] "RemoveContainer" containerID="efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff" Jun 05 15:46:40.906158 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.906140 2566 scope.go:117] "RemoveContainer" containerID="191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5" Jun 05 15:46:40.913509 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.913494 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 15:46:40.913566 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.913532 2566 scope.go:117] "RemoveContainer" containerID="2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883" Jun 05 15:46:40.916894 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.916869 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 15:46:40.921087 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.921069 2566 scope.go:117] "RemoveContainer" containerID="18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296" Jun 05 15:46:40.927736 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.927721 2566 scope.go:117] "RemoveContainer" containerID="93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94" Jun 05 15:46:40.934307 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.934291 2566 scope.go:117] "RemoveContainer" containerID="4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a" Jun 05 15:46:40.940924 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.940908 2566 scope.go:117] "RemoveContainer" containerID="05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6" Jun 05 15:46:40.945247 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945227 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 15:46:40.945681 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945663 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="prom-label-proxy" Jun 05 15:46:40.945721 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945688 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="prom-label-proxy" Jun 05 15:46:40.945721 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945703 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="kube-rbac-proxy-metric" Jun 05 15:46:40.945721 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945713 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="kube-rbac-proxy-metric" Jun 05 15:46:40.945809 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945731 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b59503b-27a5-4a25-a70d-483f4585604f" containerName="console" Jun 05 15:46:40.945809 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945740 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b59503b-27a5-4a25-a70d-483f4585604f" containerName="console" Jun 05 15:46:40.945809 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945752 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="kube-rbac-proxy" Jun 05 15:46:40.945809 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945759 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="kube-rbac-proxy" Jun 05 15:46:40.945809 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945773 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="init-config-reloader" Jun 05 15:46:40.945809 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945783 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="init-config-reloader" Jun 05 15:46:40.945974 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945812 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="alertmanager" Jun 05 15:46:40.945974 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945821 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="alertmanager" Jun 05 15:46:40.945974 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945828 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="config-reloader" Jun 05 15:46:40.945974 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945835 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="config-reloader" Jun 05 15:46:40.945974 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945844 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="kube-rbac-proxy-web" Jun 05 15:46:40.945974 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945852 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="kube-rbac-proxy-web" Jun 05 15:46:40.945974 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945934 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="prom-label-proxy" Jun 05 15:46:40.945974 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945949 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b59503b-27a5-4a25-a70d-483f4585604f" containerName="console" Jun 05 15:46:40.945974 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945960 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="kube-rbac-proxy-metric" Jun 05 15:46:40.945974 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945969 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="kube-rbac-proxy" Jun 05 15:46:40.946281 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945978 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="config-reloader" Jun 05 15:46:40.946281 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945987 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="alertmanager" Jun 05 15:46:40.946281 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.945999 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" containerName="kube-rbac-proxy-web" Jun 05 15:46:40.948845 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.948821 2566 scope.go:117] "RemoveContainer" containerID="efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff" Jun 05 15:46:40.949104 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:46:40.949087 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff\": container with ID starting with efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff not found: ID does not exist" containerID="efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff" Jun 05 15:46:40.949184 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.949114 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff"} err="failed to get container status \"efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff\": rpc error: code = NotFound desc = could not find container \"efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff\": container with ID starting with efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff not found: ID does not exist" Jun 05 15:46:40.949184 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.949150 2566 scope.go:117] "RemoveContainer" containerID="191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5" Jun 05 15:46:40.949365 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:46:40.949350 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5\": container with ID starting with 191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5 not found: ID does not exist" containerID="191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5" Jun 05 15:46:40.949406 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.949369 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5"} err="failed to get container status \"191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5\": rpc error: code = NotFound desc = could not find container \"191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5\": container with ID starting with 191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5 not found: ID does not exist" Jun 05 15:46:40.949406 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.949382 2566 scope.go:117] "RemoveContainer" containerID="2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883" Jun 05 15:46:40.949600 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:46:40.949584 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883\": container with ID starting with 2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883 not found: ID does not exist" containerID="2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883" Jun 05 15:46:40.949642 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.949604 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883"} err="failed to get container status \"2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883\": rpc error: code = NotFound desc = could not find container \"2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883\": container with ID starting with 2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883 not found: ID does not exist" Jun 05 15:46:40.949642 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.949619 2566 scope.go:117] "RemoveContainer" containerID="18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296" Jun 05 15:46:40.949854 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:46:40.949840 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296\": container with ID starting with 18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296 not found: ID does not exist" containerID="18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296" Jun 05 15:46:40.949891 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.949856 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296"} err="failed to get container status \"18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296\": rpc error: code = NotFound desc = could not find container \"18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296\": container with ID starting with 18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296 not found: ID does not exist" Jun 05 15:46:40.949891 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.949867 2566 scope.go:117] "RemoveContainer" containerID="93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94" Jun 05 15:46:40.950031 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:46:40.950014 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94\": container with ID starting with 93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94 not found: ID does not exist" containerID="93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94" Jun 05 15:46:40.950101 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.950034 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94"} err="failed to get container status \"93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94\": rpc error: code = NotFound desc = could not find container \"93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94\": container with ID starting with 93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94 not found: ID does not exist" Jun 05 15:46:40.950101 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.950044 2566 scope.go:117] "RemoveContainer" containerID="4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a" Jun 05 15:46:40.950259 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:46:40.950245 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a\": container with ID starting with 4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a not found: ID does not exist" containerID="4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a" Jun 05 15:46:40.950301 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.950262 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a"} err="failed to get container status \"4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a\": rpc error: code = NotFound desc = could not find container \"4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a\": container with ID starting with 4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a not found: ID does not exist" Jun 05 15:46:40.950301 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.950272 2566 scope.go:117] "RemoveContainer" containerID="05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6" Jun 05 15:46:40.950463 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:46:40.950450 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6\": container with ID starting with 05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6 not found: ID does not exist" containerID="05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6" Jun 05 15:46:40.950500 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.950467 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6"} err="failed to get container status \"05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6\": rpc error: code = NotFound desc = could not find container \"05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6\": container with ID starting with 05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6 not found: ID does not exist" Jun 05 15:46:40.950500 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.950479 2566 scope.go:117] "RemoveContainer" containerID="efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff" Jun 05 15:46:40.950665 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.950640 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff"} err="failed to get container status \"efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff\": rpc error: code = NotFound desc = could not find container \"efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff\": container with ID starting with efa0b326f88d680a2583908983c3ac78808d3e1bc3a9898e92ec876bacc7f0ff not found: ID does not exist" Jun 05 15:46:40.950710 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.950665 2566 scope.go:117] "RemoveContainer" containerID="191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5" Jun 05 15:46:40.950836 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.950822 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5"} err="failed to get container status \"191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5\": rpc error: code = NotFound desc = could not find container \"191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5\": container with ID starting with 191995d6ca0e9f8885d0785406b8083116dd8794549014b8681ab1b05bc74fe5 not found: ID does not exist" Jun 05 15:46:40.950876 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.950836 2566 scope.go:117] "RemoveContainer" containerID="2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883" Jun 05 15:46:40.951022 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.950994 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883"} err="failed to get container status \"2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883\": rpc error: code = NotFound desc = could not find container \"2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883\": container with ID starting with 2cab583984e5749a5cf34b5376a657b848f3a1b5deae6be58461b5efe728c883 not found: ID does not exist" Jun 05 15:46:40.951069 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.951022 2566 scope.go:117] "RemoveContainer" containerID="18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296" Jun 05 15:46:40.951218 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.951201 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296"} err="failed to get container status \"18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296\": rpc error: code = NotFound desc = could not find container \"18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296\": container with ID starting with 18e71b908202f3ff2d6f7106c8e003aceeeb8929c5910e5e2ac37618064ab296 not found: ID does not exist" Jun 05 15:46:40.951269 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.951217 2566 scope.go:117] "RemoveContainer" containerID="93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94" Jun 05 15:46:40.951431 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.951413 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94"} err="failed to get container status \"93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94\": rpc error: code = NotFound desc = could not find container \"93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94\": container with ID starting with 93f7b9a39babe0c9874372542b4a60edd00e9703f3baa4c0e2226231e939ad94 not found: ID does not exist" Jun 05 15:46:40.951431 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.951431 2566 scope.go:117] "RemoveContainer" containerID="4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a" Jun 05 15:46:40.951632 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.951612 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a"} err="failed to get container status \"4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a\": rpc error: code = NotFound desc = could not find container \"4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a\": container with ID starting with 4b04e8052aeb0f4097b5e051a2582fb9ae8908498aecfa9652360ff83e28079a not found: ID does not exist" Jun 05 15:46:40.951672 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.951633 2566 scope.go:117] "RemoveContainer" containerID="05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6" Jun 05 15:46:40.951845 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.951829 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6"} err="failed to get container status \"05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6\": rpc error: code = NotFound desc = could not find container \"05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6\": container with ID starting with 05b79f8d59e5baad2ba13b4d77424823d8cf2cdbb07616de8851bb172a8d64c6 not found: ID does not exist" Jun 05 15:46:40.966659 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.966595 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 15:46:40.966744 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.966727 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:40.968942 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.968921 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 15:46:40.969081 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.969064 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 15:46:40.969372 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.969354 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 15:46:40.969372 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.969367 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 15:46:40.969507 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.969370 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 15:46:40.969507 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.969467 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 15:46:40.969620 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.969559 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 15:46:40.969620 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.969573 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c6m7v\"" Jun 05 15:46:40.969620 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.969596 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 15:46:40.975413 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:40.975391 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 15:46:41.049659 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.049638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e8a5aac-686a-48f3-8bd7-7d26df960a70-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.049779 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.049665 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.049779 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.049682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.049779 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.049698 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e8a5aac-686a-48f3-8bd7-7d26df960a70-config-out\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.049779 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.049714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.049779 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.049759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e8a5aac-686a-48f3-8bd7-7d26df960a70-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.050008 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.049841 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e8a5aac-686a-48f3-8bd7-7d26df960a70-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.050008 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.049872 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh929\" (UniqueName: \"kubernetes.io/projected/7e8a5aac-686a-48f3-8bd7-7d26df960a70-kube-api-access-kh929\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.050008 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.049898 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.050008 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.049926 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.050008 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.049985 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8a5aac-686a-48f3-8bd7-7d26df960a70-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.050250 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.050026 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-web-config\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.050250 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.050054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.150593 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.150570 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e8a5aac-686a-48f3-8bd7-7d26df960a70-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.150912 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.150597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh929\" (UniqueName: \"kubernetes.io/projected/7e8a5aac-686a-48f3-8bd7-7d26df960a70-kube-api-access-kh929\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.150912 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.150613 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.150912 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.150633 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.150912 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.150739 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8a5aac-686a-48f3-8bd7-7d26df960a70-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.150912 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.150799 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-web-config\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.150912 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.150832 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.150912 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.150878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e8a5aac-686a-48f3-8bd7-7d26df960a70-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.150912 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.150901 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.151318 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.150924 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.151318 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.150949 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e8a5aac-686a-48f3-8bd7-7d26df960a70-config-out\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.151318 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.150974 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.151318 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.150997 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e8a5aac-686a-48f3-8bd7-7d26df960a70-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.151506 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.151397 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e8a5aac-686a-48f3-8bd7-7d26df960a70-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.151506 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.151399 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e8a5aac-686a-48f3-8bd7-7d26df960a70-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.151954 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.151930 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e8a5aac-686a-48f3-8bd7-7d26df960a70-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.153765 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.153722 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.153959 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.153923 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e8a5aac-686a-48f3-8bd7-7d26df960a70-config-out\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.154406 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.154238 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.154406 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.154240 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.154406 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.154396 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.154555 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.154405 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.154555 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.154451 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.154637 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.154622 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e8a5aac-686a-48f3-8bd7-7d26df960a70-web-config\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.155381 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.155363 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e8a5aac-686a-48f3-8bd7-7d26df960a70-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.158917 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.158901 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh929\" (UniqueName: \"kubernetes.io/projected/7e8a5aac-686a-48f3-8bd7-7d26df960a70-kube-api-access-kh929\") pod \"alertmanager-main-0\" (UID: \"7e8a5aac-686a-48f3-8bd7-7d26df960a70\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.281346 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.281327 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 15:46:41.435848 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.435823 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 15:46:41.438339 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:46:41.438314 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8a5aac_686a_48f3_8bd7_7d26df960a70.slice/crio-87efe4fec31594b5e4b535379f9d382ce7da562c4d1bb44dd9149e1ed4557129 WatchSource:0}: Error finding container 87efe4fec31594b5e4b535379f9d382ce7da562c4d1bb44dd9149e1ed4557129: Status 404 returned error can't find the container with id 87efe4fec31594b5e4b535379f9d382ce7da562c4d1bb44dd9149e1ed4557129 Jun 05 15:46:41.899972 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.899911 2566 generic.go:356] "Generic (PLEG): container finished" podID="7e8a5aac-686a-48f3-8bd7-7d26df960a70" containerID="e50ae33197baaceff4fb53e1e7b5ee0901aa87ceb2aaf303470b528ad6f077cf" exitCode=0 Jun 05 15:46:41.899972 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.899955 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e8a5aac-686a-48f3-8bd7-7d26df960a70","Type":"ContainerDied","Data":"e50ae33197baaceff4fb53e1e7b5ee0901aa87ceb2aaf303470b528ad6f077cf"} Jun 05 15:46:41.900104 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:41.900001 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e8a5aac-686a-48f3-8bd7-7d26df960a70","Type":"ContainerStarted","Data":"87efe4fec31594b5e4b535379f9d382ce7da562c4d1bb44dd9149e1ed4557129"} Jun 05 15:46:42.598299 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:42.598266 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:42.698607 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:42.698537 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:42.699087 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:42.699067 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ff4c62d-5b32-4670-85f0-730145193db6" path="/var/lib/kubelet/pods/5ff4c62d-5b32-4670-85f0-730145193db6/volumes" Jun 05 15:46:42.909341 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:42.909312 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e8a5aac-686a-48f3-8bd7-7d26df960a70","Type":"ContainerStarted","Data":"e56b1f9b664bbde75d5a85f0840f2269ea6de99acc30dcfb07941a57cf7a271b"} Jun 05 15:46:42.909455 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:42.909379 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e8a5aac-686a-48f3-8bd7-7d26df960a70","Type":"ContainerStarted","Data":"e418b89f87c7614260e611f12f1b8985fdc6a5aecc7fabbc5e9871ee23ea2295"} Jun 05 15:46:42.909455 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:42.909405 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e8a5aac-686a-48f3-8bd7-7d26df960a70","Type":"ContainerStarted","Data":"9922679fb4048f267f822f1e79fa9a9bddff0bccf1bc7e29812c15df16156a86"} Jun 05 15:46:42.909455 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:42.909428 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e8a5aac-686a-48f3-8bd7-7d26df960a70","Type":"ContainerStarted","Data":"56a9476e34c55ea2ea04951911e7decd68ad86e5f745a3adb529e618281a8de2"} Jun 05 15:46:42.909455 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:42.909455 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e8a5aac-686a-48f3-8bd7-7d26df960a70","Type":"ContainerStarted","Data":"c4a995540448fd053972d0d559251980b908c7676d33fdccbcb9bf43ab54888d"} Jun 05 15:46:42.909590 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:42.909479 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e8a5aac-686a-48f3-8bd7-7d26df960a70","Type":"ContainerStarted","Data":"1fae31367df22520f09b92f81f9c6e9c690ec2142cbe62bc1a603b46f8375847"} Jun 05 15:46:42.947185 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:42.947121 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.930864685 podStartE2EDuration="2.947106472s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.241787ms" isStatefulPod=false podCreationTimestamp="2026-06-05 15:46:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:46:42.945995709 +0000 UTC m=+344.667569317" watchObservedRunningTime="2026-06-05 15:46:42.947106472 +0000 UTC m=+344.668680077" Jun 05 15:46:45.608282 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:45.608254 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:45.608693 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:45.608300 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:45.612679 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:45.612658 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:45.928297 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:45.928225 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:46:45.970694 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:45.970663 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d8479b76-7sv5r"] Jun 05 15:46:46.072304 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:46.072262 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:46.121465 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:46.121420 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:46.176018 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:46.175995 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:57.608460 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:57.608424 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:46:57.707528 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:46:57.707489 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:47:10.990039 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:10.989969 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64d8479b76-7sv5r" podUID="e51c5747-e061-40e1-8ea1-49852986e36b" containerName="console" containerID="cri-o://46292310b5c4f89ae3a3b8e19ca063679565648611603180f4795132cf12f98a" gracePeriod=15 Jun 05 15:47:11.229772 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.229753 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:47:11.276167 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.276094 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-service-ca\") pod \"e51c5747-e061-40e1-8ea1-49852986e36b\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " Jun 05 15:47:11.276167 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.276153 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-trusted-ca-bundle\") pod \"e51c5747-e061-40e1-8ea1-49852986e36b\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " Jun 05 15:47:11.276549 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.276196 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e51c5747-e061-40e1-8ea1-49852986e36b-console-serving-cert\") pod \"e51c5747-e061-40e1-8ea1-49852986e36b\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " Jun 05 15:47:11.276549 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.276227 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzn4x\" (UniqueName: \"kubernetes.io/projected/e51c5747-e061-40e1-8ea1-49852986e36b-kube-api-access-pzn4x\") pod \"e51c5747-e061-40e1-8ea1-49852986e36b\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " Jun 05 15:47:11.276549 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.276269 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e51c5747-e061-40e1-8ea1-49852986e36b-console-oauth-config\") pod \"e51c5747-e061-40e1-8ea1-49852986e36b\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " Jun 05 15:47:11.276549 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.276341 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-oauth-serving-cert\") pod \"e51c5747-e061-40e1-8ea1-49852986e36b\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " Jun 05 15:47:11.276549 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.276368 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-console-config\") pod \"e51c5747-e061-40e1-8ea1-49852986e36b\" (UID: \"e51c5747-e061-40e1-8ea1-49852986e36b\") " Jun 05 15:47:11.276549 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.276529 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-service-ca" (OuterVolumeSpecName: "service-ca") pod "e51c5747-e061-40e1-8ea1-49852986e36b" (UID: "e51c5747-e061-40e1-8ea1-49852986e36b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:47:11.276840 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.276601 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-service-ca\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:47:11.276840 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.276686 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e51c5747-e061-40e1-8ea1-49852986e36b" (UID: "e51c5747-e061-40e1-8ea1-49852986e36b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:47:11.276840 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.276779 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e51c5747-e061-40e1-8ea1-49852986e36b" (UID: "e51c5747-e061-40e1-8ea1-49852986e36b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:47:11.276840 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.276837 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-console-config" (OuterVolumeSpecName: "console-config") pod "e51c5747-e061-40e1-8ea1-49852986e36b" (UID: "e51c5747-e061-40e1-8ea1-49852986e36b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:47:11.278226 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.278206 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e51c5747-e061-40e1-8ea1-49852986e36b-kube-api-access-pzn4x" (OuterVolumeSpecName: "kube-api-access-pzn4x") pod "e51c5747-e061-40e1-8ea1-49852986e36b" (UID: "e51c5747-e061-40e1-8ea1-49852986e36b"). InnerVolumeSpecName "kube-api-access-pzn4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:47:11.278658 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.278634 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e51c5747-e061-40e1-8ea1-49852986e36b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e51c5747-e061-40e1-8ea1-49852986e36b" (UID: "e51c5747-e061-40e1-8ea1-49852986e36b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:47:11.278658 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.278646 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e51c5747-e061-40e1-8ea1-49852986e36b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e51c5747-e061-40e1-8ea1-49852986e36b" (UID: "e51c5747-e061-40e1-8ea1-49852986e36b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:47:11.377606 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.377584 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-oauth-serving-cert\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:47:11.377606 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.377605 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-console-config\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:47:11.377730 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.377613 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e51c5747-e061-40e1-8ea1-49852986e36b-trusted-ca-bundle\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:47:11.377730 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.377621 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e51c5747-e061-40e1-8ea1-49852986e36b-console-serving-cert\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:47:11.377730 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.377630 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzn4x\" (UniqueName: \"kubernetes.io/projected/e51c5747-e061-40e1-8ea1-49852986e36b-kube-api-access-pzn4x\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:47:11.377730 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:11.377638 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e51c5747-e061-40e1-8ea1-49852986e36b-console-oauth-config\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:47:12.028581 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:12.028545 2566 generic.go:356] "Generic (PLEG): container finished" podID="e51c5747-e061-40e1-8ea1-49852986e36b" containerID="46292310b5c4f89ae3a3b8e19ca063679565648611603180f4795132cf12f98a" exitCode=0 Jun 05 15:47:12.028940 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:12.028590 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d8479b76-7sv5r" Jun 05 15:47:12.028940 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:12.028581 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d8479b76-7sv5r" event={"ID":"e51c5747-e061-40e1-8ea1-49852986e36b","Type":"ContainerDied","Data":"46292310b5c4f89ae3a3b8e19ca063679565648611603180f4795132cf12f98a"} Jun 05 15:47:12.028940 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:12.028701 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d8479b76-7sv5r" event={"ID":"e51c5747-e061-40e1-8ea1-49852986e36b","Type":"ContainerDied","Data":"859de77568a23e8932f7aae0fa9d451738cb9a73d98c68e2a071bd24e72212d4"} Jun 05 15:47:12.028940 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:12.028722 2566 scope.go:117] "RemoveContainer" containerID="46292310b5c4f89ae3a3b8e19ca063679565648611603180f4795132cf12f98a" Jun 05 15:47:12.037001 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:12.036986 2566 scope.go:117] "RemoveContainer" containerID="46292310b5c4f89ae3a3b8e19ca063679565648611603180f4795132cf12f98a" Jun 05 15:47:12.037278 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:47:12.037256 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46292310b5c4f89ae3a3b8e19ca063679565648611603180f4795132cf12f98a\": container with ID starting with 46292310b5c4f89ae3a3b8e19ca063679565648611603180f4795132cf12f98a not found: ID does not exist" containerID="46292310b5c4f89ae3a3b8e19ca063679565648611603180f4795132cf12f98a" Jun 05 15:47:12.037369 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:12.037283 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46292310b5c4f89ae3a3b8e19ca063679565648611603180f4795132cf12f98a"} err="failed to get container status \"46292310b5c4f89ae3a3b8e19ca063679565648611603180f4795132cf12f98a\": rpc error: code = NotFound desc = could not find container \"46292310b5c4f89ae3a3b8e19ca063679565648611603180f4795132cf12f98a\": container with ID starting with 46292310b5c4f89ae3a3b8e19ca063679565648611603180f4795132cf12f98a not found: ID does not exist" Jun 05 15:47:12.049531 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:12.049508 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d8479b76-7sv5r"] Jun 05 15:47:12.052905 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:12.052886 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64d8479b76-7sv5r"] Jun 05 15:47:12.698423 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:12.698388 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e51c5747-e061-40e1-8ea1-49852986e36b" path="/var/lib/kubelet/pods/e51c5747-e061-40e1-8ea1-49852986e36b/volumes" Jun 05 15:47:31.737074 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:31.737040 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:47:31.790827 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:47:31.790777 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:48:36.581718 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:48:36.581640 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:49:19.355624 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:49:19.355587 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:49:19.403245 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:49:19.403210 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:49:34.688164 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:49:34.688111 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:49:47.610384 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:49:47.610337 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:50:51.538462 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:51.538426 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:50:52.625502 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:52.625473 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:50:53.687243 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:53.687206 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:50:53.738773 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:53.738739 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:50:54.407182 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.407160 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-585d47dbbc-fzp8d"] Jun 05 15:50:54.407491 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.407480 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e51c5747-e061-40e1-8ea1-49852986e36b" containerName="console" Jun 05 15:50:54.407543 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.407493 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e51c5747-e061-40e1-8ea1-49852986e36b" containerName="console" Jun 05 15:50:54.407579 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.407559 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e51c5747-e061-40e1-8ea1-49852986e36b" containerName="console" Jun 05 15:50:54.409263 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.409249 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.425114 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.425093 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585d47dbbc-fzp8d"] Jun 05 15:50:54.442252 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.442229 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/918c1993-b9fa-419a-a361-ae3feaf5788d-trusted-ca-bundle\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.442346 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.442263 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/918c1993-b9fa-419a-a361-ae3feaf5788d-oauth-serving-cert\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.442346 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.442287 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/918c1993-b9fa-419a-a361-ae3feaf5788d-console-serving-cert\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.442428 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.442386 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/918c1993-b9fa-419a-a361-ae3feaf5788d-console-config\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.442428 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.442421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2jt2\" (UniqueName: \"kubernetes.io/projected/918c1993-b9fa-419a-a361-ae3feaf5788d-kube-api-access-t2jt2\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.442498 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.442441 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/918c1993-b9fa-419a-a361-ae3feaf5788d-console-oauth-config\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.442498 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.442460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/918c1993-b9fa-419a-a361-ae3feaf5788d-service-ca\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.458008 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.457982 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:50:54.516622 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.516595 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:50:54.543668 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.543646 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/918c1993-b9fa-419a-a361-ae3feaf5788d-trusted-ca-bundle\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.543747 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.543679 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/918c1993-b9fa-419a-a361-ae3feaf5788d-oauth-serving-cert\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.543747 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.543708 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/918c1993-b9fa-419a-a361-ae3feaf5788d-console-serving-cert\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.543840 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.543754 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/918c1993-b9fa-419a-a361-ae3feaf5788d-console-config\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.543840 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.543787 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2jt2\" (UniqueName: \"kubernetes.io/projected/918c1993-b9fa-419a-a361-ae3feaf5788d-kube-api-access-t2jt2\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.543840 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.543815 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/918c1993-b9fa-419a-a361-ae3feaf5788d-console-oauth-config\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.543978 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.543940 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/918c1993-b9fa-419a-a361-ae3feaf5788d-service-ca\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.544413 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.544393 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/918c1993-b9fa-419a-a361-ae3feaf5788d-oauth-serving-cert\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.544569 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.544548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/918c1993-b9fa-419a-a361-ae3feaf5788d-console-config\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.544569 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.544559 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/918c1993-b9fa-419a-a361-ae3feaf5788d-service-ca\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.544689 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.544576 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/918c1993-b9fa-419a-a361-ae3feaf5788d-trusted-ca-bundle\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.546116 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.546094 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/918c1993-b9fa-419a-a361-ae3feaf5788d-console-oauth-config\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.546202 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.546144 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/918c1993-b9fa-419a-a361-ae3feaf5788d-console-serving-cert\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.551643 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.551626 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2jt2\" (UniqueName: \"kubernetes.io/projected/918c1993-b9fa-419a-a361-ae3feaf5788d-kube-api-access-t2jt2\") pod \"console-585d47dbbc-fzp8d\" (UID: \"918c1993-b9fa-419a-a361-ae3feaf5788d\") " pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.718089 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.718042 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:50:54.841423 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.841401 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585d47dbbc-fzp8d"] Jun 05 15:50:54.843502 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:50:54.843480 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918c1993_b9fa_419a_a361_ae3feaf5788d.slice/crio-5a6bef65f2c1a2ee8c51ba55df795478b366a881e41c6231aca8f1499b734939 WatchSource:0}: Error finding container 5a6bef65f2c1a2ee8c51ba55df795478b366a881e41c6231aca8f1499b734939: Status 404 returned error can't find the container with id 5a6bef65f2c1a2ee8c51ba55df795478b366a881e41c6231aca8f1499b734939 Jun 05 15:50:54.919732 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.919701 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585d47dbbc-fzp8d" event={"ID":"918c1993-b9fa-419a-a361-ae3feaf5788d","Type":"ContainerStarted","Data":"bc4892269bd82153464fdd0dd5484269694ee57bf93dfd835c8f61e06f7eaa6c"} Jun 05 15:50:54.919844 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.919744 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585d47dbbc-fzp8d" event={"ID":"918c1993-b9fa-419a-a361-ae3feaf5788d","Type":"ContainerStarted","Data":"5a6bef65f2c1a2ee8c51ba55df795478b366a881e41c6231aca8f1499b734939"} Jun 05 15:50:54.937285 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:54.937242 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-585d47dbbc-fzp8d" podStartSLOduration=0.937226977 podStartE2EDuration="937.226977ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:50:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:50:54.935373225 +0000 UTC m=+596.656946863" watchObservedRunningTime="2026-06-05 15:50:54.937226977 +0000 UTC m=+596.658800586" Jun 05 15:50:59.961392 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:59.961281 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 15:50:59.967032 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:50:59.962094 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 15:51:04.718453 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:04.718376 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:51:04.718453 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:04.718443 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:51:04.722782 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:04.722758 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:51:04.963494 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:04.963465 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-585d47dbbc-fzp8d" Jun 05 15:51:05.009537 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:05.009506 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7b75fc54-tqgbt"] Jun 05 15:51:05.113012 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:05.112989 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:51:05.214172 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:05.214122 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:51:05.269179 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:05.269096 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:51:30.029595 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.029482 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f7b75fc54-tqgbt" podUID="46aec6c9-ea66-4328-a5dd-30d35add21c8" containerName="console" containerID="cri-o://2ec1a67976742e4f3a41456b3e5f7f5752b341d8902c2be4980496b474913af3" gracePeriod=15 Jun 05 15:51:30.272612 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.272592 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:51:30.408859 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.408808 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-oauth-config\") pod \"46aec6c9-ea66-4328-a5dd-30d35add21c8\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " Jun 05 15:51:30.408859 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.408839 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-trusted-ca-bundle\") pod \"46aec6c9-ea66-4328-a5dd-30d35add21c8\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " Jun 05 15:51:30.408859 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.408853 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-serving-cert\") pod \"46aec6c9-ea66-4328-a5dd-30d35add21c8\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " Jun 05 15:51:30.409075 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.408886 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-oauth-serving-cert\") pod \"46aec6c9-ea66-4328-a5dd-30d35add21c8\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " Jun 05 15:51:30.409075 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.408911 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-service-ca\") pod \"46aec6c9-ea66-4328-a5dd-30d35add21c8\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " Jun 05 15:51:30.409075 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.408977 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kczgv\" (UniqueName: \"kubernetes.io/projected/46aec6c9-ea66-4328-a5dd-30d35add21c8-kube-api-access-kczgv\") pod \"46aec6c9-ea66-4328-a5dd-30d35add21c8\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " Jun 05 15:51:30.409075 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.409005 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-config\") pod \"46aec6c9-ea66-4328-a5dd-30d35add21c8\" (UID: \"46aec6c9-ea66-4328-a5dd-30d35add21c8\") " Jun 05 15:51:30.409305 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.409274 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "46aec6c9-ea66-4328-a5dd-30d35add21c8" (UID: "46aec6c9-ea66-4328-a5dd-30d35add21c8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:51:30.409305 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.409281 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "46aec6c9-ea66-4328-a5dd-30d35add21c8" (UID: "46aec6c9-ea66-4328-a5dd-30d35add21c8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:51:30.409400 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.409334 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-service-ca" (OuterVolumeSpecName: "service-ca") pod "46aec6c9-ea66-4328-a5dd-30d35add21c8" (UID: "46aec6c9-ea66-4328-a5dd-30d35add21c8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:51:30.409507 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.409490 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-config" (OuterVolumeSpecName: "console-config") pod "46aec6c9-ea66-4328-a5dd-30d35add21c8" (UID: "46aec6c9-ea66-4328-a5dd-30d35add21c8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:51:30.410895 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.410860 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "46aec6c9-ea66-4328-a5dd-30d35add21c8" (UID: "46aec6c9-ea66-4328-a5dd-30d35add21c8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:51:30.410895 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.410881 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46aec6c9-ea66-4328-a5dd-30d35add21c8-kube-api-access-kczgv" (OuterVolumeSpecName: "kube-api-access-kczgv") pod "46aec6c9-ea66-4328-a5dd-30d35add21c8" (UID: "46aec6c9-ea66-4328-a5dd-30d35add21c8"). InnerVolumeSpecName "kube-api-access-kczgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:51:30.411033 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.410885 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "46aec6c9-ea66-4328-a5dd-30d35add21c8" (UID: "46aec6c9-ea66-4328-a5dd-30d35add21c8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:51:30.510396 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.510374 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-service-ca\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:51:30.510396 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.510395 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kczgv\" (UniqueName: \"kubernetes.io/projected/46aec6c9-ea66-4328-a5dd-30d35add21c8-kube-api-access-kczgv\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:51:30.510520 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.510406 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-config\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:51:30.510520 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.510415 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-oauth-config\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:51:30.510520 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.510422 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-trusted-ca-bundle\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:51:30.510520 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.510430 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46aec6c9-ea66-4328-a5dd-30d35add21c8-console-serving-cert\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:51:30.510520 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:30.510437 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46aec6c9-ea66-4328-a5dd-30d35add21c8-oauth-serving-cert\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:51:31.067147 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:31.067096 2566 generic.go:356] "Generic (PLEG): container finished" podID="46aec6c9-ea66-4328-a5dd-30d35add21c8" containerID="2ec1a67976742e4f3a41456b3e5f7f5752b341d8902c2be4980496b474913af3" exitCode=0 Jun 05 15:51:31.067535 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:31.067168 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7b75fc54-tqgbt" Jun 05 15:51:31.067535 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:31.067188 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7b75fc54-tqgbt" event={"ID":"46aec6c9-ea66-4328-a5dd-30d35add21c8","Type":"ContainerDied","Data":"2ec1a67976742e4f3a41456b3e5f7f5752b341d8902c2be4980496b474913af3"} Jun 05 15:51:31.067535 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:31.067248 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7b75fc54-tqgbt" event={"ID":"46aec6c9-ea66-4328-a5dd-30d35add21c8","Type":"ContainerDied","Data":"a328868b0050c5bf2b34677932e0861e1eeb9bf792f2d5ad11ccc6bb3d251d6f"} Jun 05 15:51:31.067535 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:31.067273 2566 scope.go:117] "RemoveContainer" containerID="2ec1a67976742e4f3a41456b3e5f7f5752b341d8902c2be4980496b474913af3" Jun 05 15:51:31.076519 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:31.076502 2566 scope.go:117] "RemoveContainer" containerID="2ec1a67976742e4f3a41456b3e5f7f5752b341d8902c2be4980496b474913af3" Jun 05 15:51:31.076783 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:51:31.076764 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ec1a67976742e4f3a41456b3e5f7f5752b341d8902c2be4980496b474913af3\": container with ID starting with 2ec1a67976742e4f3a41456b3e5f7f5752b341d8902c2be4980496b474913af3 not found: ID does not exist" containerID="2ec1a67976742e4f3a41456b3e5f7f5752b341d8902c2be4980496b474913af3" Jun 05 15:51:31.076821 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:31.076791 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ec1a67976742e4f3a41456b3e5f7f5752b341d8902c2be4980496b474913af3"} err="failed to get container status \"2ec1a67976742e4f3a41456b3e5f7f5752b341d8902c2be4980496b474913af3\": rpc error: code = NotFound desc = could not find container \"2ec1a67976742e4f3a41456b3e5f7f5752b341d8902c2be4980496b474913af3\": container with ID starting with 2ec1a67976742e4f3a41456b3e5f7f5752b341d8902c2be4980496b474913af3 not found: ID does not exist" Jun 05 15:51:31.083090 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:31.083061 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7b75fc54-tqgbt"] Jun 05 15:51:31.085847 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:31.085824 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f7b75fc54-tqgbt"] Jun 05 15:51:32.699246 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:51:32.699214 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46aec6c9-ea66-4328-a5dd-30d35add21c8" path="/var/lib/kubelet/pods/46aec6c9-ea66-4328-a5dd-30d35add21c8/volumes" Jun 05 15:54:17.594333 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:17.594291 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:54:17.678877 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:17.678840 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:54:18.106379 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.106348 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8"] Jun 05 15:54:18.106734 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.106719 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aec6c9-ea66-4328-a5dd-30d35add21c8" containerName="console" Jun 05 15:54:18.106781 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.106749 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aec6c9-ea66-4328-a5dd-30d35add21c8" containerName="console" Jun 05 15:54:18.106820 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.106814 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="46aec6c9-ea66-4328-a5dd-30d35add21c8" containerName="console" Jun 05 15:54:18.109983 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.109966 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" Jun 05 15:54:18.112322 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.112301 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mf7mb\"" Jun 05 15:54:18.112425 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.112305 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:54:18.113037 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.113020 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:54:18.122618 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.122592 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8"] Jun 05 15:54:18.172971 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.172945 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4b4218-7193-4846-bab9-33ad6dbed901-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8\" (UID: \"6a4b4218-7193-4846-bab9-33ad6dbed901\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" Jun 05 15:54:18.173070 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.172989 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfj7d\" (UniqueName: \"kubernetes.io/projected/6a4b4218-7193-4846-bab9-33ad6dbed901-kube-api-access-rfj7d\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8\" (UID: \"6a4b4218-7193-4846-bab9-33ad6dbed901\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" Jun 05 15:54:18.173070 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.173030 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4b4218-7193-4846-bab9-33ad6dbed901-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8\" (UID: \"6a4b4218-7193-4846-bab9-33ad6dbed901\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" Jun 05 15:54:18.274055 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.274032 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4b4218-7193-4846-bab9-33ad6dbed901-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8\" (UID: \"6a4b4218-7193-4846-bab9-33ad6dbed901\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" Jun 05 15:54:18.274196 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.274067 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfj7d\" (UniqueName: \"kubernetes.io/projected/6a4b4218-7193-4846-bab9-33ad6dbed901-kube-api-access-rfj7d\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8\" (UID: \"6a4b4218-7193-4846-bab9-33ad6dbed901\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" Jun 05 15:54:18.274196 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.274111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4b4218-7193-4846-bab9-33ad6dbed901-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8\" (UID: \"6a4b4218-7193-4846-bab9-33ad6dbed901\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" Jun 05 15:54:18.274500 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.274480 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4b4218-7193-4846-bab9-33ad6dbed901-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8\" (UID: \"6a4b4218-7193-4846-bab9-33ad6dbed901\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" Jun 05 15:54:18.274536 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.274496 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4b4218-7193-4846-bab9-33ad6dbed901-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8\" (UID: \"6a4b4218-7193-4846-bab9-33ad6dbed901\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" Jun 05 15:54:18.281895 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.281870 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfj7d\" (UniqueName: \"kubernetes.io/projected/6a4b4218-7193-4846-bab9-33ad6dbed901-kube-api-access-rfj7d\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8\" (UID: \"6a4b4218-7193-4846-bab9-33ad6dbed901\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" Jun 05 15:54:18.420612 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.420522 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" Jun 05 15:54:18.550744 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.550720 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8"] Jun 05 15:54:18.553269 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:54:18.553243 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4b4218_7193_4846_bab9_33ad6dbed901.slice/crio-c9e8e05f1a4473045d503d6b6dc3a667e1e1ce23dd6858977596e7e04ba0b31f WatchSource:0}: Error finding container c9e8e05f1a4473045d503d6b6dc3a667e1e1ce23dd6858977596e7e04ba0b31f: Status 404 returned error can't find the container with id c9e8e05f1a4473045d503d6b6dc3a667e1e1ce23dd6858977596e7e04ba0b31f Jun 05 15:54:18.557105 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.557080 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 15:54:18.737179 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:18.737151 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" event={"ID":"6a4b4218-7193-4846-bab9-33ad6dbed901","Type":"ContainerStarted","Data":"c9e8e05f1a4473045d503d6b6dc3a667e1e1ce23dd6858977596e7e04ba0b31f"} Jun 05 15:54:26.772816 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:26.772753 2566 generic.go:356] "Generic (PLEG): container finished" podID="6a4b4218-7193-4846-bab9-33ad6dbed901" containerID="7115a997d50121e4b30ce0c3bca30f6662573512a67d343774d41b41872d46fc" exitCode=0 Jun 05 15:54:26.773157 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:26.772840 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" event={"ID":"6a4b4218-7193-4846-bab9-33ad6dbed901","Type":"ContainerDied","Data":"7115a997d50121e4b30ce0c3bca30f6662573512a67d343774d41b41872d46fc"} Jun 05 15:54:29.789144 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:29.789092 2566 generic.go:356] "Generic (PLEG): container finished" podID="6a4b4218-7193-4846-bab9-33ad6dbed901" containerID="5708544d51be22f8fb12db56979244df774872fa665d156fd9955d96a43e6689" exitCode=0 Jun 05 15:54:29.789548 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:29.789178 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" event={"ID":"6a4b4218-7193-4846-bab9-33ad6dbed901","Type":"ContainerDied","Data":"5708544d51be22f8fb12db56979244df774872fa665d156fd9955d96a43e6689"} Jun 05 15:54:38.838060 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:38.838029 2566 generic.go:356] "Generic (PLEG): container finished" podID="6a4b4218-7193-4846-bab9-33ad6dbed901" containerID="57a8f4e7ba5b08663b2d8518774543f03df97017894f80fd960ef42c2436971f" exitCode=0 Jun 05 15:54:38.838411 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:38.838073 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" event={"ID":"6a4b4218-7193-4846-bab9-33ad6dbed901","Type":"ContainerDied","Data":"57a8f4e7ba5b08663b2d8518774543f03df97017894f80fd960ef42c2436971f"} Jun 05 15:54:40.013582 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:40.013555 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" Jun 05 15:54:40.142172 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:40.142103 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfj7d\" (UniqueName: \"kubernetes.io/projected/6a4b4218-7193-4846-bab9-33ad6dbed901-kube-api-access-rfj7d\") pod \"6a4b4218-7193-4846-bab9-33ad6dbed901\" (UID: \"6a4b4218-7193-4846-bab9-33ad6dbed901\") " Jun 05 15:54:40.142283 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:40.142178 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4b4218-7193-4846-bab9-33ad6dbed901-bundle\") pod \"6a4b4218-7193-4846-bab9-33ad6dbed901\" (UID: \"6a4b4218-7193-4846-bab9-33ad6dbed901\") " Jun 05 15:54:40.142283 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:40.142213 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4b4218-7193-4846-bab9-33ad6dbed901-util\") pod \"6a4b4218-7193-4846-bab9-33ad6dbed901\" (UID: \"6a4b4218-7193-4846-bab9-33ad6dbed901\") " Jun 05 15:54:40.142965 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:40.142941 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4b4218-7193-4846-bab9-33ad6dbed901-bundle" (OuterVolumeSpecName: "bundle") pod "6a4b4218-7193-4846-bab9-33ad6dbed901" (UID: "6a4b4218-7193-4846-bab9-33ad6dbed901"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:54:40.144151 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:40.144110 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a4b4218-7193-4846-bab9-33ad6dbed901-kube-api-access-rfj7d" (OuterVolumeSpecName: "kube-api-access-rfj7d") pod "6a4b4218-7193-4846-bab9-33ad6dbed901" (UID: "6a4b4218-7193-4846-bab9-33ad6dbed901"). InnerVolumeSpecName "kube-api-access-rfj7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:54:40.146826 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:40.146806 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4b4218-7193-4846-bab9-33ad6dbed901-util" (OuterVolumeSpecName: "util") pod "6a4b4218-7193-4846-bab9-33ad6dbed901" (UID: "6a4b4218-7193-4846-bab9-33ad6dbed901"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:54:40.243211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:40.243189 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4b4218-7193-4846-bab9-33ad6dbed901-bundle\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:54:40.243211 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:40.243208 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4b4218-7193-4846-bab9-33ad6dbed901-util\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:54:40.243325 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:40.243216 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfj7d\" (UniqueName: \"kubernetes.io/projected/6a4b4218-7193-4846-bab9-33ad6dbed901-kube-api-access-rfj7d\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:54:40.848572 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:40.848546 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" event={"ID":"6a4b4218-7193-4846-bab9-33ad6dbed901","Type":"ContainerDied","Data":"c9e8e05f1a4473045d503d6b6dc3a667e1e1ce23dd6858977596e7e04ba0b31f"} Jun 05 15:54:40.848670 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:40.848586 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9e8e05f1a4473045d503d6b6dc3a667e1e1ce23dd6858977596e7e04ba0b31f" Jun 05 15:54:40.848670 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:40.848589 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drqgz8" Jun 05 15:54:43.878727 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:43.878665 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:54:45.239235 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.239199 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:54:45.819521 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.819484 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7"] Jun 05 15:54:45.819830 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.819814 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4b4218-7193-4846-bab9-33ad6dbed901" containerName="util" Jun 05 15:54:45.819879 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.819870 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4b4218-7193-4846-bab9-33ad6dbed901" containerName="util" Jun 05 15:54:45.819911 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.819884 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4b4218-7193-4846-bab9-33ad6dbed901" containerName="extract" Jun 05 15:54:45.819911 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.819900 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4b4218-7193-4846-bab9-33ad6dbed901" containerName="extract" Jun 05 15:54:45.819963 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.819952 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4b4218-7193-4846-bab9-33ad6dbed901" containerName="pull" Jun 05 15:54:45.819994 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.819962 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4b4218-7193-4846-bab9-33ad6dbed901" containerName="pull" Jun 05 15:54:45.820104 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.820089 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a4b4218-7193-4846-bab9-33ad6dbed901" containerName="extract" Jun 05 15:54:45.822196 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.822179 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7" Jun 05 15:54:45.824414 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.824392 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 05 15:54:45.824545 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.824461 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tg5qm\"" Jun 05 15:54:45.824545 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.824491 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:54:45.834272 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.834249 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7"] Jun 05 15:54:45.890906 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.890883 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1500a755-4080-4418-a782-da3e6d4ed1b5-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-g5kc7\" (UID: \"1500a755-4080-4418-a782-da3e6d4ed1b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7" Jun 05 15:54:45.891013 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.890942 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g56z\" (UniqueName: \"kubernetes.io/projected/1500a755-4080-4418-a782-da3e6d4ed1b5-kube-api-access-9g56z\") pod \"cert-manager-operator-controller-manager-57757f7cfc-g5kc7\" (UID: \"1500a755-4080-4418-a782-da3e6d4ed1b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7" Jun 05 15:54:45.991527 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.991500 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g56z\" (UniqueName: \"kubernetes.io/projected/1500a755-4080-4418-a782-da3e6d4ed1b5-kube-api-access-9g56z\") pod \"cert-manager-operator-controller-manager-57757f7cfc-g5kc7\" (UID: \"1500a755-4080-4418-a782-da3e6d4ed1b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7" Jun 05 15:54:45.991645 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.991544 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1500a755-4080-4418-a782-da3e6d4ed1b5-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-g5kc7\" (UID: \"1500a755-4080-4418-a782-da3e6d4ed1b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7" Jun 05 15:54:45.991945 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.991926 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1500a755-4080-4418-a782-da3e6d4ed1b5-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-g5kc7\" (UID: \"1500a755-4080-4418-a782-da3e6d4ed1b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7" Jun 05 15:54:45.999854 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:45.999826 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g56z\" (UniqueName: \"kubernetes.io/projected/1500a755-4080-4418-a782-da3e6d4ed1b5-kube-api-access-9g56z\") pod \"cert-manager-operator-controller-manager-57757f7cfc-g5kc7\" (UID: \"1500a755-4080-4418-a782-da3e6d4ed1b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7" Jun 05 15:54:46.132944 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:46.132892 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7" Jun 05 15:54:46.262424 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:46.262399 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7"] Jun 05 15:54:46.265781 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:54:46.265759 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1500a755_4080_4418_a782_da3e6d4ed1b5.slice/crio-9dcf004df69e12c6450a67b8872bbebd60ed90583f6e9a919df6b813089ae271 WatchSource:0}: Error finding container 9dcf004df69e12c6450a67b8872bbebd60ed90583f6e9a919df6b813089ae271: Status 404 returned error can't find the container with id 9dcf004df69e12c6450a67b8872bbebd60ed90583f6e9a919df6b813089ae271 Jun 05 15:54:46.876004 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:46.875976 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7" event={"ID":"1500a755-4080-4418-a782-da3e6d4ed1b5","Type":"ContainerStarted","Data":"9dcf004df69e12c6450a67b8872bbebd60ed90583f6e9a919df6b813089ae271"} Jun 05 15:54:47.488075 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:47.488050 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:54:47.588492 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:47.588466 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:54:48.887491 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:48.887463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7" event={"ID":"1500a755-4080-4418-a782-da3e6d4ed1b5","Type":"ContainerStarted","Data":"368dcb7a509bcfff29ad39783653d9477746aa3e28b82133a33dd3a88b18e03d"} Jun 05 15:54:48.908029 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:48.907987 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-g5kc7" podStartSLOduration=1.788245849 podStartE2EDuration="3.9079724s" totalImagesPullingTime="2.119726551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:54:48.906531259 +0000 UTC m=+830.628104887" watchObservedRunningTime="2026-06-05 15:54:48.9079724 +0000 UTC m=+830.629546005" Jun 05 15:54:49.237344 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:49.237313 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:54:49.338473 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:49.338448 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:54:49.436604 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:49.436581 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:54:50.312688 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.312660 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc"] Jun 05 15:54:50.315192 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.315171 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" Jun 05 15:54:50.317462 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.317442 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:54:50.317572 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.317538 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:54:50.317657 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.317635 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mf7mb\"" Jun 05 15:54:50.323161 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.323111 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc"] Jun 05 15:54:50.424678 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.424651 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82ad1f17-4851-4ffc-895c-cf5b0dceac07-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc\" (UID: \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" Jun 05 15:54:50.424811 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.424700 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82ad1f17-4851-4ffc-895c-cf5b0dceac07-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc\" (UID: \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" Jun 05 15:54:50.424811 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.424750 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xh2t\" (UniqueName: \"kubernetes.io/projected/82ad1f17-4851-4ffc-895c-cf5b0dceac07-kube-api-access-4xh2t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc\" (UID: \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" Jun 05 15:54:50.525948 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.525920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82ad1f17-4851-4ffc-895c-cf5b0dceac07-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc\" (UID: \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" Jun 05 15:54:50.526058 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.525980 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82ad1f17-4851-4ffc-895c-cf5b0dceac07-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc\" (UID: \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" Jun 05 15:54:50.526058 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.526008 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xh2t\" (UniqueName: \"kubernetes.io/projected/82ad1f17-4851-4ffc-895c-cf5b0dceac07-kube-api-access-4xh2t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc\" (UID: \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" Jun 05 15:54:50.526327 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.526307 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82ad1f17-4851-4ffc-895c-cf5b0dceac07-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc\" (UID: \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" Jun 05 15:54:50.526422 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.526404 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82ad1f17-4851-4ffc-895c-cf5b0dceac07-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc\" (UID: \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" Jun 05 15:54:50.533724 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.533692 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xh2t\" (UniqueName: \"kubernetes.io/projected/82ad1f17-4851-4ffc-895c-cf5b0dceac07-kube-api-access-4xh2t\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc\" (UID: \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" Jun 05 15:54:50.625327 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.625267 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" Jun 05 15:54:50.749700 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.749645 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc"] Jun 05 15:54:50.751838 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:54:50.751809 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ad1f17_4851_4ffc_895c_cf5b0dceac07.slice/crio-4944003993fc54b0a09d34c51c1863fda51d280dabdce8f9a319cdce3c2997df WatchSource:0}: Error finding container 4944003993fc54b0a09d34c51c1863fda51d280dabdce8f9a319cdce3c2997df: Status 404 returned error can't find the container with id 4944003993fc54b0a09d34c51c1863fda51d280dabdce8f9a319cdce3c2997df Jun 05 15:54:50.897395 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.897350 2566 generic.go:356] "Generic (PLEG): container finished" podID="82ad1f17-4851-4ffc-895c-cf5b0dceac07" containerID="3f0ebf19f4ddcddfa7acb343f6b490826f517c26274a5bd29eb7af315745c932" exitCode=0 Jun 05 15:54:50.897493 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.897399 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" event={"ID":"82ad1f17-4851-4ffc-895c-cf5b0dceac07","Type":"ContainerDied","Data":"3f0ebf19f4ddcddfa7acb343f6b490826f517c26274a5bd29eb7af315745c932"} Jun 05 15:54:50.897493 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:50.897432 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" event={"ID":"82ad1f17-4851-4ffc-895c-cf5b0dceac07","Type":"ContainerStarted","Data":"4944003993fc54b0a09d34c51c1863fda51d280dabdce8f9a319cdce3c2997df"} Jun 05 15:54:51.844233 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:51.844157 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc"] Jun 05 15:54:51.847412 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:51.847393 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc" Jun 05 15:54:51.849447 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:51.849427 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 15:54:51.850304 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:51.850282 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 15:54:51.850437 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:51.850333 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-b54hn\"" Jun 05 15:54:51.856230 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:51.856203 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc"] Jun 05 15:54:51.938786 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:51.938759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e92efbee-f1fa-4735-9323-dd22e7996905-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-pj9zc\" (UID: \"e92efbee-f1fa-4735-9323-dd22e7996905\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc" Jun 05 15:54:51.938923 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:51.938806 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz99s\" (UniqueName: \"kubernetes.io/projected/e92efbee-f1fa-4735-9323-dd22e7996905-kube-api-access-zz99s\") pod \"cert-manager-webhook-7dc76cbb94-pj9zc\" (UID: \"e92efbee-f1fa-4735-9323-dd22e7996905\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc" Jun 05 15:54:52.040242 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:52.040216 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e92efbee-f1fa-4735-9323-dd22e7996905-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-pj9zc\" (UID: \"e92efbee-f1fa-4735-9323-dd22e7996905\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc" Jun 05 15:54:52.040399 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:52.040259 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz99s\" (UniqueName: \"kubernetes.io/projected/e92efbee-f1fa-4735-9323-dd22e7996905-kube-api-access-zz99s\") pod \"cert-manager-webhook-7dc76cbb94-pj9zc\" (UID: \"e92efbee-f1fa-4735-9323-dd22e7996905\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc" Jun 05 15:54:52.048329 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:52.048305 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e92efbee-f1fa-4735-9323-dd22e7996905-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-pj9zc\" (UID: \"e92efbee-f1fa-4735-9323-dd22e7996905\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc" Jun 05 15:54:52.048458 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:52.048329 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz99s\" (UniqueName: \"kubernetes.io/projected/e92efbee-f1fa-4735-9323-dd22e7996905-kube-api-access-zz99s\") pod \"cert-manager-webhook-7dc76cbb94-pj9zc\" (UID: \"e92efbee-f1fa-4735-9323-dd22e7996905\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc" Jun 05 15:54:52.164790 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:52.164726 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc" Jun 05 15:54:52.526681 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:52.526622 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:54:52.745983 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:52.745961 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc"] Jun 05 15:54:52.747931 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:54:52.747904 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode92efbee_f1fa_4735_9323_dd22e7996905.slice/crio-371c4f49630038b5a42ff99e31566fe76e459dbc98934392e43a30e15ce99391 WatchSource:0}: Error finding container 371c4f49630038b5a42ff99e31566fe76e459dbc98934392e43a30e15ce99391: Status 404 returned error can't find the container with id 371c4f49630038b5a42ff99e31566fe76e459dbc98934392e43a30e15ce99391 Jun 05 15:54:52.909277 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:52.909248 2566 generic.go:356] "Generic (PLEG): container finished" podID="82ad1f17-4851-4ffc-895c-cf5b0dceac07" containerID="feefde2b51947f672131cbe10197de8d006d78165b9b235deae09e69c39c7d0d" exitCode=0 Jun 05 15:54:52.909604 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:52.909325 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" event={"ID":"82ad1f17-4851-4ffc-895c-cf5b0dceac07","Type":"ContainerDied","Data":"feefde2b51947f672131cbe10197de8d006d78165b9b235deae09e69c39c7d0d"} Jun 05 15:54:52.910582 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:52.910558 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc" event={"ID":"e92efbee-f1fa-4735-9323-dd22e7996905","Type":"ContainerStarted","Data":"371c4f49630038b5a42ff99e31566fe76e459dbc98934392e43a30e15ce99391"} Jun 05 15:54:53.117349 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:53.117296 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:54:53.918480 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:53.918454 2566 generic.go:356] "Generic (PLEG): container finished" podID="82ad1f17-4851-4ffc-895c-cf5b0dceac07" containerID="daa9d3779f059baeec7fb8af3f7d637b71e2da0fe7eddeb2aff6f726d80aa32d" exitCode=0 Jun 05 15:54:53.918884 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:53.918547 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" event={"ID":"82ad1f17-4851-4ffc-895c-cf5b0dceac07","Type":"ContainerDied","Data":"daa9d3779f059baeec7fb8af3f7d637b71e2da0fe7eddeb2aff6f726d80aa32d"} Jun 05 15:54:54.483798 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:54.483765 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:54:54.534467 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:54.534437 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:54:54.713395 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:54.713368 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dq9th"] Jun 05 15:54:54.716800 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:54.716781 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dq9th" Jun 05 15:54:54.718975 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:54.718955 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-98vkx\"" Jun 05 15:54:54.726492 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:54.726470 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dq9th"] Jun 05 15:54:54.866076 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:54.866007 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2237ec2b-e329-4328-a784-bec5b089a3d8-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dq9th\" (UID: \"2237ec2b-e329-4328-a784-bec5b089a3d8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dq9th" Jun 05 15:54:54.866076 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:54.866044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldvkf\" (UniqueName: \"kubernetes.io/projected/2237ec2b-e329-4328-a784-bec5b089a3d8-kube-api-access-ldvkf\") pod \"cert-manager-cainjector-5d99449ffd-dq9th\" (UID: \"2237ec2b-e329-4328-a784-bec5b089a3d8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dq9th" Jun 05 15:54:54.967244 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:54.967207 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2237ec2b-e329-4328-a784-bec5b089a3d8-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dq9th\" (UID: \"2237ec2b-e329-4328-a784-bec5b089a3d8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dq9th" Jun 05 15:54:54.967678 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:54.967264 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldvkf\" (UniqueName: \"kubernetes.io/projected/2237ec2b-e329-4328-a784-bec5b089a3d8-kube-api-access-ldvkf\") pod \"cert-manager-cainjector-5d99449ffd-dq9th\" (UID: \"2237ec2b-e329-4328-a784-bec5b089a3d8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dq9th" Jun 05 15:54:54.975166 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:54.975116 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2237ec2b-e329-4328-a784-bec5b089a3d8-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dq9th\" (UID: \"2237ec2b-e329-4328-a784-bec5b089a3d8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dq9th" Jun 05 15:54:54.975308 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:54.975245 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldvkf\" (UniqueName: \"kubernetes.io/projected/2237ec2b-e329-4328-a784-bec5b089a3d8-kube-api-access-ldvkf\") pod \"cert-manager-cainjector-5d99449ffd-dq9th\" (UID: \"2237ec2b-e329-4328-a784-bec5b089a3d8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dq9th" Jun 05 15:54:55.028539 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.028509 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dq9th" Jun 05 15:54:55.528926 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.528904 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" Jun 05 15:54:55.635537 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.635517 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dq9th"] Jun 05 15:54:55.636994 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:54:55.636969 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2237ec2b_e329_4328_a784_bec5b089a3d8.slice/crio-8f556d8d07a5c0c3b5ce98ca53250dc7bbe9a884fa5c9e10647a9937fd6bafb1 WatchSource:0}: Error finding container 8f556d8d07a5c0c3b5ce98ca53250dc7bbe9a884fa5c9e10647a9937fd6bafb1: Status 404 returned error can't find the container with id 8f556d8d07a5c0c3b5ce98ca53250dc7bbe9a884fa5c9e10647a9937fd6bafb1 Jun 05 15:54:55.672991 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.672966 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82ad1f17-4851-4ffc-895c-cf5b0dceac07-util\") pod \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\" (UID: \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\") " Jun 05 15:54:55.673111 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.673094 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82ad1f17-4851-4ffc-895c-cf5b0dceac07-bundle\") pod \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\" (UID: \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\") " Jun 05 15:54:55.673193 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.673181 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xh2t\" (UniqueName: \"kubernetes.io/projected/82ad1f17-4851-4ffc-895c-cf5b0dceac07-kube-api-access-4xh2t\") pod \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\" (UID: \"82ad1f17-4851-4ffc-895c-cf5b0dceac07\") " Jun 05 15:54:55.673647 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.673498 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ad1f17-4851-4ffc-895c-cf5b0dceac07-bundle" (OuterVolumeSpecName: "bundle") pod "82ad1f17-4851-4ffc-895c-cf5b0dceac07" (UID: "82ad1f17-4851-4ffc-895c-cf5b0dceac07"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:54:55.675618 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.675596 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ad1f17-4851-4ffc-895c-cf5b0dceac07-kube-api-access-4xh2t" (OuterVolumeSpecName: "kube-api-access-4xh2t") pod "82ad1f17-4851-4ffc-895c-cf5b0dceac07" (UID: "82ad1f17-4851-4ffc-895c-cf5b0dceac07"). InnerVolumeSpecName "kube-api-access-4xh2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:54:55.678027 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.678008 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ad1f17-4851-4ffc-895c-cf5b0dceac07-util" (OuterVolumeSpecName: "util") pod "82ad1f17-4851-4ffc-895c-cf5b0dceac07" (UID: "82ad1f17-4851-4ffc-895c-cf5b0dceac07"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:54:55.774198 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.774149 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xh2t\" (UniqueName: \"kubernetes.io/projected/82ad1f17-4851-4ffc-895c-cf5b0dceac07-kube-api-access-4xh2t\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:54:55.774198 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.774171 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82ad1f17-4851-4ffc-895c-cf5b0dceac07-util\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:54:55.774198 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.774180 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82ad1f17-4851-4ffc-895c-cf5b0dceac07-bundle\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:54:55.928785 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.928754 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dq9th" event={"ID":"2237ec2b-e329-4328-a784-bec5b089a3d8","Type":"ContainerStarted","Data":"78474e8b1c21470c543c47a7d1cbb1025413716ace0436d268d293769a2867e9"} Jun 05 15:54:55.928938 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.928792 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dq9th" event={"ID":"2237ec2b-e329-4328-a784-bec5b089a3d8","Type":"ContainerStarted","Data":"8f556d8d07a5c0c3b5ce98ca53250dc7bbe9a884fa5c9e10647a9937fd6bafb1"} Jun 05 15:54:55.930531 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.930508 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" event={"ID":"82ad1f17-4851-4ffc-895c-cf5b0dceac07","Type":"ContainerDied","Data":"4944003993fc54b0a09d34c51c1863fda51d280dabdce8f9a319cdce3c2997df"} Jun 05 15:54:55.930629 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.930551 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4944003993fc54b0a09d34c51c1863fda51d280dabdce8f9a319cdce3c2997df" Jun 05 15:54:55.930629 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.930513 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nwqc" Jun 05 15:54:55.932172 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.932149 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc" event={"ID":"e92efbee-f1fa-4735-9323-dd22e7996905","Type":"ContainerStarted","Data":"d7f8112baea7e6074915475b29aaffefcfe95353b6472292d5cea85e3056df1b"} Jun 05 15:54:55.932275 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.932225 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc" Jun 05 15:54:55.943349 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.943309 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dq9th" podStartSLOduration=1.943293683 podStartE2EDuration="1.943293683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:54:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:54:55.942982652 +0000 UTC m=+837.664556260" watchObservedRunningTime="2026-06-05 15:54:55.943293683 +0000 UTC m=+837.664867290" Jun 05 15:54:55.965736 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:54:55.965689 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc" podStartSLOduration=2.139826963 podStartE2EDuration="4.965670977s" totalImagesPullingTime="2.825844014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:54:55.964369917 +0000 UTC m=+837.685943522" watchObservedRunningTime="2026-06-05 15:54:55.965670977 +0000 UTC m=+837.687244583" Jun 05 15:55:00.888641 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:00.888606 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:00.989024 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:00.988993 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:01.127830 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:01.127802 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:01.939511 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:01.939485 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pj9zc" Jun 05 15:55:07.292699 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:07.292665 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:07.343703 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:07.343676 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:09.294845 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:09.294811 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:10.745247 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.745212 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67"] Jun 05 15:55:10.745704 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.745681 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ad1f17-4851-4ffc-895c-cf5b0dceac07" containerName="util" Jun 05 15:55:10.745780 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.745708 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ad1f17-4851-4ffc-895c-cf5b0dceac07" containerName="util" Jun 05 15:55:10.745780 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.745737 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ad1f17-4851-4ffc-895c-cf5b0dceac07" containerName="pull" Jun 05 15:55:10.745780 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.745745 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ad1f17-4851-4ffc-895c-cf5b0dceac07" containerName="pull" Jun 05 15:55:10.745780 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.745777 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ad1f17-4851-4ffc-895c-cf5b0dceac07" containerName="extract" Jun 05 15:55:10.745969 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.745785 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ad1f17-4851-4ffc-895c-cf5b0dceac07" containerName="extract" Jun 05 15:55:10.745969 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.745870 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ad1f17-4851-4ffc-895c-cf5b0dceac07" containerName="extract" Jun 05 15:55:10.772561 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.772537 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67"] Jun 05 15:55:10.772706 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.772641 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" Jun 05 15:55:10.775302 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.775278 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mf7mb\"" Jun 05 15:55:10.775427 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.775327 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:55:10.775427 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.775342 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:55:10.882346 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.882325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a9ad4a3-1546-4ded-a728-38ff14d08a71-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67\" (UID: \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" Jun 05 15:55:10.882436 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.882376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxq94\" (UniqueName: \"kubernetes.io/projected/4a9ad4a3-1546-4ded-a728-38ff14d08a71-kube-api-access-jxq94\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67\" (UID: \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" Jun 05 15:55:10.882436 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.882409 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a9ad4a3-1546-4ded-a728-38ff14d08a71-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67\" (UID: \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" Jun 05 15:55:10.983291 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.983255 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxq94\" (UniqueName: \"kubernetes.io/projected/4a9ad4a3-1546-4ded-a728-38ff14d08a71-kube-api-access-jxq94\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67\" (UID: \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" Jun 05 15:55:10.983385 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.983304 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a9ad4a3-1546-4ded-a728-38ff14d08a71-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67\" (UID: \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" Jun 05 15:55:10.983385 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.983335 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a9ad4a3-1546-4ded-a728-38ff14d08a71-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67\" (UID: \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" Jun 05 15:55:10.983667 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.983652 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a9ad4a3-1546-4ded-a728-38ff14d08a71-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67\" (UID: \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" Jun 05 15:55:10.983708 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.983683 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a9ad4a3-1546-4ded-a728-38ff14d08a71-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67\" (UID: \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" Jun 05 15:55:10.990904 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:10.990884 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxq94\" (UniqueName: \"kubernetes.io/projected/4a9ad4a3-1546-4ded-a728-38ff14d08a71-kube-api-access-jxq94\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67\" (UID: \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" Jun 05 15:55:11.082412 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:11.082365 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" Jun 05 15:55:11.215907 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:11.215751 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67"] Jun 05 15:55:11.218510 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:55:11.218487 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a9ad4a3_1546_4ded_a728_38ff14d08a71.slice/crio-698520016d033c042d05363da52f700ae8e894e33e437213d15d1dcb536c2e59 WatchSource:0}: Error finding container 698520016d033c042d05363da52f700ae8e894e33e437213d15d1dcb536c2e59: Status 404 returned error can't find the container with id 698520016d033c042d05363da52f700ae8e894e33e437213d15d1dcb536c2e59 Jun 05 15:55:12.025257 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:12.025225 2566 generic.go:356] "Generic (PLEG): container finished" podID="4a9ad4a3-1546-4ded-a728-38ff14d08a71" containerID="6067fbb4cb34bb5ae9c9c0c0da8e3d9314ca86dd2953907c4f939cbb707e5f8e" exitCode=0 Jun 05 15:55:12.025602 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:12.025308 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" event={"ID":"4a9ad4a3-1546-4ded-a728-38ff14d08a71","Type":"ContainerDied","Data":"6067fbb4cb34bb5ae9c9c0c0da8e3d9314ca86dd2953907c4f939cbb707e5f8e"} Jun 05 15:55:12.025602 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:12.025355 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" event={"ID":"4a9ad4a3-1546-4ded-a728-38ff14d08a71","Type":"ContainerStarted","Data":"698520016d033c042d05363da52f700ae8e894e33e437213d15d1dcb536c2e59"} Jun 05 15:55:13.032296 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:13.032257 2566 generic.go:356] "Generic (PLEG): container finished" podID="4a9ad4a3-1546-4ded-a728-38ff14d08a71" containerID="c11198e218f1a255f96a4f9e5e50f49217f2333f941d63968abc1616215944a7" exitCode=0 Jun 05 15:55:13.032594 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:13.032331 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" event={"ID":"4a9ad4a3-1546-4ded-a728-38ff14d08a71","Type":"ContainerDied","Data":"c11198e218f1a255f96a4f9e5e50f49217f2333f941d63968abc1616215944a7"} Jun 05 15:55:14.041005 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:14.040967 2566 generic.go:356] "Generic (PLEG): container finished" podID="4a9ad4a3-1546-4ded-a728-38ff14d08a71" containerID="33b236c9c0b53c9a848140527d7cec2f87dc24e3d424d3c634a2084e4c9af7a7" exitCode=0 Jun 05 15:55:14.041414 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:14.041060 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" event={"ID":"4a9ad4a3-1546-4ded-a728-38ff14d08a71","Type":"ContainerDied","Data":"33b236c9c0b53c9a848140527d7cec2f87dc24e3d424d3c634a2084e4c9af7a7"} Jun 05 15:55:15.183387 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:15.183368 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" Jun 05 15:55:15.314348 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:15.314292 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxq94\" (UniqueName: \"kubernetes.io/projected/4a9ad4a3-1546-4ded-a728-38ff14d08a71-kube-api-access-jxq94\") pod \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\" (UID: \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\") " Jun 05 15:55:15.314348 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:15.314334 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a9ad4a3-1546-4ded-a728-38ff14d08a71-util\") pod \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\" (UID: \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\") " Jun 05 15:55:15.314348 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:15.314349 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a9ad4a3-1546-4ded-a728-38ff14d08a71-bundle\") pod \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\" (UID: \"4a9ad4a3-1546-4ded-a728-38ff14d08a71\") " Jun 05 15:55:15.315028 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:15.314998 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a9ad4a3-1546-4ded-a728-38ff14d08a71-bundle" (OuterVolumeSpecName: "bundle") pod "4a9ad4a3-1546-4ded-a728-38ff14d08a71" (UID: "4a9ad4a3-1546-4ded-a728-38ff14d08a71"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:55:15.316293 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:15.316269 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a9ad4a3-1546-4ded-a728-38ff14d08a71-kube-api-access-jxq94" (OuterVolumeSpecName: "kube-api-access-jxq94") pod "4a9ad4a3-1546-4ded-a728-38ff14d08a71" (UID: "4a9ad4a3-1546-4ded-a728-38ff14d08a71"). InnerVolumeSpecName "kube-api-access-jxq94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:55:15.319387 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:15.319356 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a9ad4a3-1546-4ded-a728-38ff14d08a71-util" (OuterVolumeSpecName: "util") pod "4a9ad4a3-1546-4ded-a728-38ff14d08a71" (UID: "4a9ad4a3-1546-4ded-a728-38ff14d08a71"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:55:15.415091 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:15.415069 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a9ad4a3-1546-4ded-a728-38ff14d08a71-util\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:55:15.415091 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:15.415088 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a9ad4a3-1546-4ded-a728-38ff14d08a71-bundle\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:55:15.415226 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:15.415097 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxq94\" (UniqueName: \"kubernetes.io/projected/4a9ad4a3-1546-4ded-a728-38ff14d08a71-kube-api-access-jxq94\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:55:16.054388 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:16.054366 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" Jun 05 15:55:16.054518 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:16.054385 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdg7g67" event={"ID":"4a9ad4a3-1546-4ded-a728-38ff14d08a71","Type":"ContainerDied","Data":"698520016d033c042d05363da52f700ae8e894e33e437213d15d1dcb536c2e59"} Jun 05 15:55:16.054518 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:16.054450 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="698520016d033c042d05363da52f700ae8e894e33e437213d15d1dcb536c2e59" Jun 05 15:55:21.893911 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:21.893879 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:22.003027 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.002994 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:22.508110 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.508070 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:22.726479 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.726432 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:22.803014 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.802916 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:22.804473 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.804454 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg"] Jun 05 15:55:22.804807 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.804791 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a9ad4a3-1546-4ded-a728-38ff14d08a71" containerName="util" Jun 05 15:55:22.804848 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.804810 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a9ad4a3-1546-4ded-a728-38ff14d08a71" containerName="util" Jun 05 15:55:22.804848 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.804825 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a9ad4a3-1546-4ded-a728-38ff14d08a71" containerName="pull" Jun 05 15:55:22.804848 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.804830 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a9ad4a3-1546-4ded-a728-38ff14d08a71" containerName="pull" Jun 05 15:55:22.804848 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.804844 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a9ad4a3-1546-4ded-a728-38ff14d08a71" containerName="extract" Jun 05 15:55:22.804964 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.804851 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a9ad4a3-1546-4ded-a728-38ff14d08a71" containerName="extract" Jun 05 15:55:22.804964 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.804910 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a9ad4a3-1546-4ded-a728-38ff14d08a71" containerName="extract" Jun 05 15:55:22.811108 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.811090 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.813598 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.813570 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 15:55:22.813687 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.813636 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 15:55:22.813805 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.813791 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 15:55:22.813871 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.813826 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gwrl7\"" Jun 05 15:55:22.813939 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.813872 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 15:55:22.822624 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.822605 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg"] Jun 05 15:55:22.866506 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.866486 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/58828fa7-2b54-4aa7-89e6-3ce073d7338c-manifests\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.866616 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.866523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58828fa7-2b54-4aa7-89e6-3ce073d7338c-tmp\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.866616 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.866556 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/58828fa7-2b54-4aa7-89e6-3ce073d7338c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.866616 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.866582 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqmjn\" (UniqueName: \"kubernetes.io/projected/58828fa7-2b54-4aa7-89e6-3ce073d7338c-kube-api-access-lqmjn\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.866756 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.866619 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58828fa7-2b54-4aa7-89e6-3ce073d7338c-webhook-cert\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.941114 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.941090 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:22.967194 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.967174 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/58828fa7-2b54-4aa7-89e6-3ce073d7338c-manifests\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.967272 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.967207 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58828fa7-2b54-4aa7-89e6-3ce073d7338c-tmp\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.967272 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.967230 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/58828fa7-2b54-4aa7-89e6-3ce073d7338c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.967272 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.967256 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqmjn\" (UniqueName: \"kubernetes.io/projected/58828fa7-2b54-4aa7-89e6-3ce073d7338c-kube-api-access-lqmjn\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.967416 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.967298 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58828fa7-2b54-4aa7-89e6-3ce073d7338c-webhook-cert\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.967590 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.967563 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/58828fa7-2b54-4aa7-89e6-3ce073d7338c-manifests\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.969358 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.969336 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58828fa7-2b54-4aa7-89e6-3ce073d7338c-tmp\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.969545 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.969531 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58828fa7-2b54-4aa7-89e6-3ce073d7338c-webhook-cert\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.969605 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.969553 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/58828fa7-2b54-4aa7-89e6-3ce073d7338c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:22.974746 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:22.974724 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqmjn\" (UniqueName: \"kubernetes.io/projected/58828fa7-2b54-4aa7-89e6-3ce073d7338c-kube-api-access-lqmjn\") pod \"opendatahub-operator-controller-manager-854c86f8ff-7nmmg\" (UID: \"58828fa7-2b54-4aa7-89e6-3ce073d7338c\") " pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:23.037305 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:23.037283 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:23.122314 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:23.122264 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:23.134291 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:23.134270 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:23.239868 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:23.239841 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:23.257725 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:23.257694 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg"] Jun 05 15:55:23.259727 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:55:23.259704 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58828fa7_2b54_4aa7_89e6_3ce073d7338c.slice/crio-cdba3bd7ec5222cf76de79587c00bb4ec92f36596ed50266ccca0437a228958b WatchSource:0}: Error finding container cdba3bd7ec5222cf76de79587c00bb4ec92f36596ed50266ccca0437a228958b: Status 404 returned error can't find the container with id cdba3bd7ec5222cf76de79587c00bb4ec92f36596ed50266ccca0437a228958b Jun 05 15:55:23.354001 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:23.353979 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:24.095014 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:24.094949 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" event={"ID":"58828fa7-2b54-4aa7-89e6-3ce073d7338c","Type":"ContainerStarted","Data":"cdba3bd7ec5222cf76de79587c00bb4ec92f36596ed50266ccca0437a228958b"} Jun 05 15:55:26.105436 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:26.105407 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" event={"ID":"58828fa7-2b54-4aa7-89e6-3ce073d7338c","Type":"ContainerStarted","Data":"daa4be22a0fe8c1e1d4751bbece0475b5052d3c1a5f5fe1124631a6b21e04daf"} Jun 05 15:55:27.112096 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:27.112073 2566 generic.go:356] "Generic (PLEG): container finished" podID="58828fa7-2b54-4aa7-89e6-3ce073d7338c" containerID="daa4be22a0fe8c1e1d4751bbece0475b5052d3c1a5f5fe1124631a6b21e04daf" exitCode=0 Jun 05 15:55:27.112376 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:27.112165 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" event={"ID":"58828fa7-2b54-4aa7-89e6-3ce073d7338c","Type":"ContainerDied","Data":"daa4be22a0fe8c1e1d4751bbece0475b5052d3c1a5f5fe1124631a6b21e04daf"} Jun 05 15:55:27.573931 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:27.573902 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:27.674498 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:27.674422 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:28.118933 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:28.118905 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" event={"ID":"58828fa7-2b54-4aa7-89e6-3ce073d7338c","Type":"ContainerStarted","Data":"d67304be7da03e834e1705379cb94ae256b8e087d9baa016f8732e1b0677ee70"} Jun 05 15:55:28.119283 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:28.118996 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:28.145215 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:28.145165 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" podStartSLOduration=2.120778747 podStartE2EDuration="6.145150367s" totalImagesPullingTime="3.052993672s" totalInitContainerRuntime="971.377948ms" isStatefulPod=false podCreationTimestamp="2026-06-05 15:55:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:55:28.143988757 +0000 UTC m=+869.865562384" watchObservedRunningTime="2026-06-05 15:55:28.145150367 +0000 UTC m=+869.866723972" Jun 05 15:55:33.504333 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:33.504279 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:33.629498 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:33.629441 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:33.716550 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:33.716514 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:39.017220 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:39.017168 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:39.117484 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:39.117425 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:39.125760 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:39.125737 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-854c86f8ff-7nmmg" Jun 05 15:55:39.218999 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:39.218977 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:41.485573 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:41.485547 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:41.616380 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:41.616347 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:41.861052 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:41.860975 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:41.957985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:41.957952 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:42.023493 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.023464 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt"] Jun 05 15:55:42.032100 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.032078 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" Jun 05 15:55:42.034534 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.034507 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 05 15:55:42.034911 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.034516 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 05 15:55:42.034911 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.034600 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 15:55:42.034911 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.034802 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rwgdl\"" Jun 05 15:55:42.034911 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.034813 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 15:55:42.046477 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.046437 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt"] Jun 05 15:55:42.083987 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.083961 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:42.117190 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.117115 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfzn8\" (UniqueName: \"kubernetes.io/projected/4175f1a6-85ca-4f14-af73-293a0546edab-kube-api-access-wfzn8\") pod \"kube-auth-proxy-7fbd886dcc-kz4pt\" (UID: \"4175f1a6-85ca-4f14-af73-293a0546edab\") " pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" Jun 05 15:55:42.117271 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.117194 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4175f1a6-85ca-4f14-af73-293a0546edab-tls-certs\") pod \"kube-auth-proxy-7fbd886dcc-kz4pt\" (UID: \"4175f1a6-85ca-4f14-af73-293a0546edab\") " pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" Jun 05 15:55:42.117271 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.117264 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4175f1a6-85ca-4f14-af73-293a0546edab-tmp\") pod \"kube-auth-proxy-7fbd886dcc-kz4pt\" (UID: \"4175f1a6-85ca-4f14-af73-293a0546edab\") " pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" Jun 05 15:55:42.171215 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.171192 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9gwrf"] Jun 05 15:55:42.174869 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.174853 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" Jun 05 15:55:42.177245 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.177227 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lzsvp\"" Jun 05 15:55:42.177357 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.177227 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 05 15:55:42.185570 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.185546 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9gwrf"] Jun 05 15:55:42.203901 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.203860 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:42.217864 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.217840 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e19bbb67-a64e-4832-9431-8def97668866-cert\") pod \"odh-model-controller-6dc94f689f-9gwrf\" (UID: \"e19bbb67-a64e-4832-9431-8def97668866\") " pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" Jun 05 15:55:42.217959 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.217885 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfzn8\" (UniqueName: \"kubernetes.io/projected/4175f1a6-85ca-4f14-af73-293a0546edab-kube-api-access-wfzn8\") pod \"kube-auth-proxy-7fbd886dcc-kz4pt\" (UID: \"4175f1a6-85ca-4f14-af73-293a0546edab\") " pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" Jun 05 15:55:42.217959 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.217924 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4175f1a6-85ca-4f14-af73-293a0546edab-tls-certs\") pod \"kube-auth-proxy-7fbd886dcc-kz4pt\" (UID: \"4175f1a6-85ca-4f14-af73-293a0546edab\") " pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" Jun 05 15:55:42.218081 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.217982 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4175f1a6-85ca-4f14-af73-293a0546edab-tmp\") pod \"kube-auth-proxy-7fbd886dcc-kz4pt\" (UID: \"4175f1a6-85ca-4f14-af73-293a0546edab\") " pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" Jun 05 15:55:42.218081 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.218024 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkp8n\" (UniqueName: \"kubernetes.io/projected/e19bbb67-a64e-4832-9431-8def97668866-kube-api-access-dkp8n\") pod \"odh-model-controller-6dc94f689f-9gwrf\" (UID: \"e19bbb67-a64e-4832-9431-8def97668866\") " pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" Jun 05 15:55:42.220103 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.220084 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4175f1a6-85ca-4f14-af73-293a0546edab-tmp\") pod \"kube-auth-proxy-7fbd886dcc-kz4pt\" (UID: \"4175f1a6-85ca-4f14-af73-293a0546edab\") " pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" Jun 05 15:55:42.220403 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.220386 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4175f1a6-85ca-4f14-af73-293a0546edab-tls-certs\") pod \"kube-auth-proxy-7fbd886dcc-kz4pt\" (UID: \"4175f1a6-85ca-4f14-af73-293a0546edab\") " pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" Jun 05 15:55:42.225896 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.225875 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfzn8\" (UniqueName: \"kubernetes.io/projected/4175f1a6-85ca-4f14-af73-293a0546edab-kube-api-access-wfzn8\") pod \"kube-auth-proxy-7fbd886dcc-kz4pt\" (UID: \"4175f1a6-85ca-4f14-af73-293a0546edab\") " pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" Jun 05 15:55:42.282436 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.282403 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:42.319490 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.319462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkp8n\" (UniqueName: \"kubernetes.io/projected/e19bbb67-a64e-4832-9431-8def97668866-kube-api-access-dkp8n\") pod \"odh-model-controller-6dc94f689f-9gwrf\" (UID: \"e19bbb67-a64e-4832-9431-8def97668866\") " pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" Jun 05 15:55:42.319608 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.319520 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e19bbb67-a64e-4832-9431-8def97668866-cert\") pod \"odh-model-controller-6dc94f689f-9gwrf\" (UID: \"e19bbb67-a64e-4832-9431-8def97668866\") " pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" Jun 05 15:55:42.319654 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:55:42.319604 2566 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 05 15:55:42.319694 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:55:42.319678 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19bbb67-a64e-4832-9431-8def97668866-cert podName:e19bbb67-a64e-4832-9431-8def97668866 nodeName:}" failed. No retries permitted until 2026-06-05 15:55:42.819664243 +0000 UTC m=+884.541237828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e19bbb67-a64e-4832-9431-8def97668866-cert") pod "odh-model-controller-6dc94f689f-9gwrf" (UID: "e19bbb67-a64e-4832-9431-8def97668866") : secret "odh-model-controller-webhook-cert" not found Jun 05 15:55:42.327566 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.327548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkp8n\" (UniqueName: \"kubernetes.io/projected/e19bbb67-a64e-4832-9431-8def97668866-kube-api-access-dkp8n\") pod \"odh-model-controller-6dc94f689f-9gwrf\" (UID: \"e19bbb67-a64e-4832-9431-8def97668866\") " pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" Jun 05 15:55:42.366959 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.366935 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" Jun 05 15:55:42.396098 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.396073 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:42.531822 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.531801 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt"] Jun 05 15:55:42.533364 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:55:42.533335 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4175f1a6_85ca_4f14_af73_293a0546edab.slice/crio-05efe6cf9f8e3e2bb7e713b37510d4b58146cd62f8637586abf3fd623909845b WatchSource:0}: Error finding container 05efe6cf9f8e3e2bb7e713b37510d4b58146cd62f8637586abf3fd623909845b: Status 404 returned error can't find the container with id 05efe6cf9f8e3e2bb7e713b37510d4b58146cd62f8637586abf3fd623909845b Jun 05 15:55:42.740059 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.740036 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:42.803684 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.803653 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-5d59g"] Jun 05 15:55:42.808383 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.808362 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-5d59g" Jun 05 15:55:42.810887 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.810867 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 05 15:55:42.810985 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.810904 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-rz25c\"" Jun 05 15:55:42.816347 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.816325 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-5d59g"] Jun 05 15:55:42.824399 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.824380 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e19bbb67-a64e-4832-9431-8def97668866-cert\") pod \"odh-model-controller-6dc94f689f-9gwrf\" (UID: \"e19bbb67-a64e-4832-9431-8def97668866\") " pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" Jun 05 15:55:42.826506 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.826484 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e19bbb67-a64e-4832-9431-8def97668866-cert\") pod \"odh-model-controller-6dc94f689f-9gwrf\" (UID: \"e19bbb67-a64e-4832-9431-8def97668866\") " pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" Jun 05 15:55:42.925827 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.925800 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mxts\" (UniqueName: \"kubernetes.io/projected/b094d0ac-c28f-4cc7-8f03-468f9c4656a8-kube-api-access-7mxts\") pod \"model-serving-api-5dd488fc48-5d59g\" (UID: \"b094d0ac-c28f-4cc7-8f03-468f9c4656a8\") " pod="opendatahub/model-serving-api-5dd488fc48-5d59g" Jun 05 15:55:42.925930 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.925853 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b094d0ac-c28f-4cc7-8f03-468f9c4656a8-tls-certs\") pod \"model-serving-api-5dd488fc48-5d59g\" (UID: \"b094d0ac-c28f-4cc7-8f03-468f9c4656a8\") " pod="opendatahub/model-serving-api-5dd488fc48-5d59g" Jun 05 15:55:42.960697 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:42.960658 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:43.027052 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.026988 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b094d0ac-c28f-4cc7-8f03-468f9c4656a8-tls-certs\") pod \"model-serving-api-5dd488fc48-5d59g\" (UID: \"b094d0ac-c28f-4cc7-8f03-468f9c4656a8\") " pod="opendatahub/model-serving-api-5dd488fc48-5d59g" Jun 05 15:55:43.027052 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.027041 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mxts\" (UniqueName: \"kubernetes.io/projected/b094d0ac-c28f-4cc7-8f03-468f9c4656a8-kube-api-access-7mxts\") pod \"model-serving-api-5dd488fc48-5d59g\" (UID: \"b094d0ac-c28f-4cc7-8f03-468f9c4656a8\") " pod="opendatahub/model-serving-api-5dd488fc48-5d59g" Jun 05 15:55:43.029345 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.029324 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b094d0ac-c28f-4cc7-8f03-468f9c4656a8-tls-certs\") pod \"model-serving-api-5dd488fc48-5d59g\" (UID: \"b094d0ac-c28f-4cc7-8f03-468f9c4656a8\") " pod="opendatahub/model-serving-api-5dd488fc48-5d59g" Jun 05 15:55:43.034736 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.034717 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mxts\" (UniqueName: \"kubernetes.io/projected/b094d0ac-c28f-4cc7-8f03-468f9c4656a8-kube-api-access-7mxts\") pod \"model-serving-api-5dd488fc48-5d59g\" (UID: \"b094d0ac-c28f-4cc7-8f03-468f9c4656a8\") " pod="opendatahub/model-serving-api-5dd488fc48-5d59g" Jun 05 15:55:43.086614 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.086590 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" Jun 05 15:55:43.120575 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.120526 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-5d59g" Jun 05 15:55:43.202295 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.201978 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" event={"ID":"4175f1a6-85ca-4f14-af73-293a0546edab","Type":"ContainerStarted","Data":"05efe6cf9f8e3e2bb7e713b37510d4b58146cd62f8637586abf3fd623909845b"} Jun 05 15:55:43.268841 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.268055 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9gwrf"] Jun 05 15:55:43.271072 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:55:43.271026 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode19bbb67_a64e_4832_9431_8def97668866.slice/crio-cc5008dbf7fa2e5f6e94c302ea8fed8712ca993727fe804c809a8450d011f279 WatchSource:0}: Error finding container cc5008dbf7fa2e5f6e94c302ea8fed8712ca993727fe804c809a8450d011f279: Status 404 returned error can't find the container with id cc5008dbf7fa2e5f6e94c302ea8fed8712ca993727fe804c809a8450d011f279 Jun 05 15:55:43.311090 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.311068 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-5d59g"] Jun 05 15:55:43.314488 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:55:43.314459 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb094d0ac_c28f_4cc7_8f03_468f9c4656a8.slice/crio-1e3098530074bf6b3079e0ab7194ca46d931d518dfd3f0619ef968f03c16ebea WatchSource:0}: Error finding container 1e3098530074bf6b3079e0ab7194ca46d931d518dfd3f0619ef968f03c16ebea: Status 404 returned error can't find the container with id 1e3098530074bf6b3079e0ab7194ca46d931d518dfd3f0619ef968f03c16ebea Jun 05 15:55:43.942142 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.940094 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h"] Jun 05 15:55:43.947068 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.947043 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" Jun 05 15:55:43.949777 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.949347 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h"] Jun 05 15:55:43.951334 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.950562 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mf7mb\"" Jun 05 15:55:43.951334 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.950889 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:55:43.951844 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:43.951821 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:55:44.038536 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:44.038502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7xqd\" (UniqueName: \"kubernetes.io/projected/6bda7a96-3c9f-4564-9b89-d0094b11e949-kube-api-access-w7xqd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h\" (UID: \"6bda7a96-3c9f-4564-9b89-d0094b11e949\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" Jun 05 15:55:44.038724 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:44.038552 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bda7a96-3c9f-4564-9b89-d0094b11e949-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h\" (UID: \"6bda7a96-3c9f-4564-9b89-d0094b11e949\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" Jun 05 15:55:44.038724 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:44.038649 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bda7a96-3c9f-4564-9b89-d0094b11e949-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h\" (UID: \"6bda7a96-3c9f-4564-9b89-d0094b11e949\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" Jun 05 15:55:44.139393 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:44.139354 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bda7a96-3c9f-4564-9b89-d0094b11e949-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h\" (UID: \"6bda7a96-3c9f-4564-9b89-d0094b11e949\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" Jun 05 15:55:44.139564 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:44.139506 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7xqd\" (UniqueName: \"kubernetes.io/projected/6bda7a96-3c9f-4564-9b89-d0094b11e949-kube-api-access-w7xqd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h\" (UID: \"6bda7a96-3c9f-4564-9b89-d0094b11e949\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" Jun 05 15:55:44.139564 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:44.139543 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bda7a96-3c9f-4564-9b89-d0094b11e949-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h\" (UID: \"6bda7a96-3c9f-4564-9b89-d0094b11e949\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" Jun 05 15:55:44.140048 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:44.140022 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bda7a96-3c9f-4564-9b89-d0094b11e949-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h\" (UID: \"6bda7a96-3c9f-4564-9b89-d0094b11e949\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" Jun 05 15:55:44.140299 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:44.140280 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bda7a96-3c9f-4564-9b89-d0094b11e949-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h\" (UID: \"6bda7a96-3c9f-4564-9b89-d0094b11e949\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" Jun 05 15:55:44.149777 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:44.149751 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7xqd\" (UniqueName: \"kubernetes.io/projected/6bda7a96-3c9f-4564-9b89-d0094b11e949-kube-api-access-w7xqd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h\" (UID: \"6bda7a96-3c9f-4564-9b89-d0094b11e949\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" Jun 05 15:55:44.211145 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:44.211051 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" event={"ID":"e19bbb67-a64e-4832-9431-8def97668866","Type":"ContainerStarted","Data":"cc5008dbf7fa2e5f6e94c302ea8fed8712ca993727fe804c809a8450d011f279"} Jun 05 15:55:44.212756 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:44.212721 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-5d59g" event={"ID":"b094d0ac-c28f-4cc7-8f03-468f9c4656a8","Type":"ContainerStarted","Data":"1e3098530074bf6b3079e0ab7194ca46d931d518dfd3f0619ef968f03c16ebea"} Jun 05 15:55:44.263759 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:44.263725 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" Jun 05 15:55:46.089698 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:46.088666 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h"] Jun 05 15:55:46.090750 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:55:46.090720 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bda7a96_3c9f_4564_9b89_d0094b11e949.slice/crio-4e4138031f16690aa9d0d7b96daa285f8d0f90d1c43e9fb28deddcce533b0ad6 WatchSource:0}: Error finding container 4e4138031f16690aa9d0d7b96daa285f8d0f90d1c43e9fb28deddcce533b0ad6: Status 404 returned error can't find the container with id 4e4138031f16690aa9d0d7b96daa285f8d0f90d1c43e9fb28deddcce533b0ad6 Jun 05 15:55:46.226453 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:46.226384 2566 generic.go:356] "Generic (PLEG): container finished" podID="6bda7a96-3c9f-4564-9b89-d0094b11e949" containerID="ea78f735cc9e09a2365989953f70c274f2b04e1cda4e3db30726e26a714ee1fb" exitCode=0 Jun 05 15:55:46.226583 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:46.226457 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" event={"ID":"6bda7a96-3c9f-4564-9b89-d0094b11e949","Type":"ContainerDied","Data":"ea78f735cc9e09a2365989953f70c274f2b04e1cda4e3db30726e26a714ee1fb"} Jun 05 15:55:46.226583 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:46.226522 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" event={"ID":"6bda7a96-3c9f-4564-9b89-d0094b11e949","Type":"ContainerStarted","Data":"4e4138031f16690aa9d0d7b96daa285f8d0f90d1c43e9fb28deddcce533b0ad6"} Jun 05 15:55:46.228475 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:46.228454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" event={"ID":"4175f1a6-85ca-4f14-af73-293a0546edab","Type":"ContainerStarted","Data":"f0d9fec059c74504e77e450174927cd505b471964bef7a8e892599e9d1582ce8"} Jun 05 15:55:46.230040 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:46.230015 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-5d59g" event={"ID":"b094d0ac-c28f-4cc7-8f03-468f9c4656a8","Type":"ContainerStarted","Data":"2f72df3dee67a6b1d10d2bae9e3214e1f1ae8ccfebf583dd28a8f70532fef1b0"} Jun 05 15:55:46.230195 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:46.230173 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-5d59g" Jun 05 15:55:46.286852 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:46.286804 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7fbd886dcc-kz4pt" podStartSLOduration=1.86907874 podStartE2EDuration="5.286786247s" totalImagesPullingTime="3.417707507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:55:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:55:46.286344023 +0000 UTC m=+888.007917667" watchObservedRunningTime="2026-06-05 15:55:46.286786247 +0000 UTC m=+888.008359857" Jun 05 15:55:46.306013 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:46.305973 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-5d59g" podStartSLOduration=1.6684164209999999 podStartE2EDuration="4.305959295s" totalImagesPullingTime="2.637542874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:55:46.304643339 +0000 UTC m=+888.026216965" watchObservedRunningTime="2026-06-05 15:55:46.305959295 +0000 UTC m=+888.027532904" Jun 05 15:55:48.245549 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:48.245510 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" event={"ID":"6bda7a96-3c9f-4564-9b89-d0094b11e949","Type":"ContainerStarted","Data":"d0c731e9bdb9123b020b76cfc444aa0ec13249cc4d2a7ae72d65da7939bcd4cc"} Jun 05 15:55:49.254711 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:49.254661 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" event={"ID":"e19bbb67-a64e-4832-9431-8def97668866","Type":"ContainerStarted","Data":"f89d9691a3fdaec63951cf7f33204ec8363758efd0c2f5b706d71c526d1b3ea0"} Jun 05 15:55:49.255191 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:49.254809 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" Jun 05 15:55:49.256355 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:49.256331 2566 generic.go:356] "Generic (PLEG): container finished" podID="6bda7a96-3c9f-4564-9b89-d0094b11e949" containerID="d0c731e9bdb9123b020b76cfc444aa0ec13249cc4d2a7ae72d65da7939bcd4cc" exitCode=0 Jun 05 15:55:49.256493 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:49.256411 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" event={"ID":"6bda7a96-3c9f-4564-9b89-d0094b11e949","Type":"ContainerDied","Data":"d0c731e9bdb9123b020b76cfc444aa0ec13249cc4d2a7ae72d65da7939bcd4cc"} Jun 05 15:55:49.292930 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:49.292869 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" podStartSLOduration=2.035594197 podStartE2EDuration="7.292851079s" totalImagesPullingTime="5.257256882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:55:49.290613674 +0000 UTC m=+891.012187283" watchObservedRunningTime="2026-06-05 15:55:49.292851079 +0000 UTC m=+891.014424686" Jun 05 15:55:50.263557 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:50.263524 2566 generic.go:356] "Generic (PLEG): container finished" podID="6bda7a96-3c9f-4564-9b89-d0094b11e949" containerID="839340a24e88b340f5237093f6c57873cc32ce22e8a4ed07d2be591142608ee2" exitCode=0 Jun 05 15:55:50.263913 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:50.263613 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" event={"ID":"6bda7a96-3c9f-4564-9b89-d0094b11e949","Type":"ContainerDied","Data":"839340a24e88b340f5237093f6c57873cc32ce22e8a4ed07d2be591142608ee2"} Jun 05 15:55:51.402240 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:51.402216 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" Jun 05 15:55:51.510825 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:51.510791 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7xqd\" (UniqueName: \"kubernetes.io/projected/6bda7a96-3c9f-4564-9b89-d0094b11e949-kube-api-access-w7xqd\") pod \"6bda7a96-3c9f-4564-9b89-d0094b11e949\" (UID: \"6bda7a96-3c9f-4564-9b89-d0094b11e949\") " Jun 05 15:55:51.510995 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:51.510852 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bda7a96-3c9f-4564-9b89-d0094b11e949-bundle\") pod \"6bda7a96-3c9f-4564-9b89-d0094b11e949\" (UID: \"6bda7a96-3c9f-4564-9b89-d0094b11e949\") " Jun 05 15:55:51.510995 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:51.510940 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bda7a96-3c9f-4564-9b89-d0094b11e949-util\") pod \"6bda7a96-3c9f-4564-9b89-d0094b11e949\" (UID: \"6bda7a96-3c9f-4564-9b89-d0094b11e949\") " Jun 05 15:55:51.511883 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:51.511843 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bda7a96-3c9f-4564-9b89-d0094b11e949-bundle" (OuterVolumeSpecName: "bundle") pod "6bda7a96-3c9f-4564-9b89-d0094b11e949" (UID: "6bda7a96-3c9f-4564-9b89-d0094b11e949"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:55:51.514612 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:51.514584 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bda7a96-3c9f-4564-9b89-d0094b11e949-kube-api-access-w7xqd" (OuterVolumeSpecName: "kube-api-access-w7xqd") pod "6bda7a96-3c9f-4564-9b89-d0094b11e949" (UID: "6bda7a96-3c9f-4564-9b89-d0094b11e949"). InnerVolumeSpecName "kube-api-access-w7xqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:55:51.515959 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:51.515933 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bda7a96-3c9f-4564-9b89-d0094b11e949-util" (OuterVolumeSpecName: "util") pod "6bda7a96-3c9f-4564-9b89-d0094b11e949" (UID: "6bda7a96-3c9f-4564-9b89-d0094b11e949"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:55:51.611779 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:51.611712 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7xqd\" (UniqueName: \"kubernetes.io/projected/6bda7a96-3c9f-4564-9b89-d0094b11e949-kube-api-access-w7xqd\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:55:51.611779 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:51.611740 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bda7a96-3c9f-4564-9b89-d0094b11e949-bundle\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:55:51.611779 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:51.611750 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bda7a96-3c9f-4564-9b89-d0094b11e949-util\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:55:52.277324 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.277297 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" Jun 05 15:55:52.277493 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.277323 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06ww25h" event={"ID":"6bda7a96-3c9f-4564-9b89-d0094b11e949","Type":"ContainerDied","Data":"4e4138031f16690aa9d0d7b96daa285f8d0f90d1c43e9fb28deddcce533b0ad6"} Jun 05 15:55:52.277493 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.277366 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e4138031f16690aa9d0d7b96daa285f8d0f90d1c43e9fb28deddcce533b0ad6" Jun 05 15:55:52.616690 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.616616 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:52.665548 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.665523 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-r5lk5"] Jun 05 15:55:52.665882 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.665869 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bda7a96-3c9f-4564-9b89-d0094b11e949" containerName="extract" Jun 05 15:55:52.665927 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.665884 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bda7a96-3c9f-4564-9b89-d0094b11e949" containerName="extract" Jun 05 15:55:52.665927 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.665909 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bda7a96-3c9f-4564-9b89-d0094b11e949" containerName="util" Jun 05 15:55:52.665927 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.665914 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bda7a96-3c9f-4564-9b89-d0094b11e949" containerName="util" Jun 05 15:55:52.665927 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.665919 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bda7a96-3c9f-4564-9b89-d0094b11e949" containerName="pull" Jun 05 15:55:52.665927 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.665924 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bda7a96-3c9f-4564-9b89-d0094b11e949" containerName="pull" Jun 05 15:55:52.666069 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.665978 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bda7a96-3c9f-4564-9b89-d0094b11e949" containerName="extract" Jun 05 15:55:52.668873 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.668858 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" Jun 05 15:55:52.671391 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.671367 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bqz9f\"" Jun 05 15:55:52.671592 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.671576 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 05 15:55:52.676522 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.676503 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g"] Jun 05 15:55:52.680005 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.679988 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-r5lk5"] Jun 05 15:55:52.680095 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.680068 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g" Jun 05 15:55:52.682469 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.682423 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 05 15:55:52.683018 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.682951 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-psgz2\"" Jun 05 15:55:52.692569 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.692551 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g"] Jun 05 15:55:52.720789 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.720758 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9kcx\" (UniqueName: \"kubernetes.io/projected/5cfd2162-77e4-4a59-b36e-f524ccc3f297-kube-api-access-d9kcx\") pod \"kserve-controller-manager-69fc866d76-r5lk5\" (UID: \"5cfd2162-77e4-4a59-b36e-f524ccc3f297\") " pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" Jun 05 15:55:52.721064 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.721021 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cfd2162-77e4-4a59-b36e-f524ccc3f297-cert\") pod \"kserve-controller-manager-69fc866d76-r5lk5\" (UID: \"5cfd2162-77e4-4a59-b36e-f524ccc3f297\") " pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" Jun 05 15:55:52.821555 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.821529 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c69f8f-2047-4ad9-9e9e-70340cf03d3a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-t6d5g\" (UID: \"f3c69f8f-2047-4ad9-9e9e-70340cf03d3a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g" Jun 05 15:55:52.821727 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.821565 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t55wr\" (UniqueName: \"kubernetes.io/projected/f3c69f8f-2047-4ad9-9e9e-70340cf03d3a-kube-api-access-t55wr\") pod \"llmisvc-controller-manager-864bfd7bc9-t6d5g\" (UID: \"f3c69f8f-2047-4ad9-9e9e-70340cf03d3a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g" Jun 05 15:55:52.821727 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.821659 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kcx\" (UniqueName: \"kubernetes.io/projected/5cfd2162-77e4-4a59-b36e-f524ccc3f297-kube-api-access-d9kcx\") pod \"kserve-controller-manager-69fc866d76-r5lk5\" (UID: \"5cfd2162-77e4-4a59-b36e-f524ccc3f297\") " pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" Jun 05 15:55:52.821727 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.821710 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cfd2162-77e4-4a59-b36e-f524ccc3f297-cert\") pod \"kserve-controller-manager-69fc866d76-r5lk5\" (UID: \"5cfd2162-77e4-4a59-b36e-f524ccc3f297\") " pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" Jun 05 15:55:52.821898 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:55:52.821846 2566 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 05 15:55:52.821945 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:55:52.821912 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cfd2162-77e4-4a59-b36e-f524ccc3f297-cert podName:5cfd2162-77e4-4a59-b36e-f524ccc3f297 nodeName:}" failed. No retries permitted until 2026-06-05 15:55:53.321891175 +0000 UTC m=+895.043464759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5cfd2162-77e4-4a59-b36e-f524ccc3f297-cert") pod "kserve-controller-manager-69fc866d76-r5lk5" (UID: "5cfd2162-77e4-4a59-b36e-f524ccc3f297") : secret "kserve-webhook-server-cert" not found Jun 05 15:55:52.834290 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.834266 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9kcx\" (UniqueName: \"kubernetes.io/projected/5cfd2162-77e4-4a59-b36e-f524ccc3f297-kube-api-access-d9kcx\") pod \"kserve-controller-manager-69fc866d76-r5lk5\" (UID: \"5cfd2162-77e4-4a59-b36e-f524ccc3f297\") " pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" Jun 05 15:55:52.923165 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.923075 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c69f8f-2047-4ad9-9e9e-70340cf03d3a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-t6d5g\" (UID: \"f3c69f8f-2047-4ad9-9e9e-70340cf03d3a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g" Jun 05 15:55:52.923165 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.923115 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t55wr\" (UniqueName: \"kubernetes.io/projected/f3c69f8f-2047-4ad9-9e9e-70340cf03d3a-kube-api-access-t55wr\") pod \"llmisvc-controller-manager-864bfd7bc9-t6d5g\" (UID: \"f3c69f8f-2047-4ad9-9e9e-70340cf03d3a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g" Jun 05 15:55:52.925241 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.925222 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c69f8f-2047-4ad9-9e9e-70340cf03d3a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-t6d5g\" (UID: \"f3c69f8f-2047-4ad9-9e9e-70340cf03d3a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g" Jun 05 15:55:52.943928 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.943905 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t55wr\" (UniqueName: \"kubernetes.io/projected/f3c69f8f-2047-4ad9-9e9e-70340cf03d3a-kube-api-access-t55wr\") pod \"llmisvc-controller-manager-864bfd7bc9-t6d5g\" (UID: \"f3c69f8f-2047-4ad9-9e9e-70340cf03d3a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g" Jun 05 15:55:52.989941 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:52.989921 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g" Jun 05 15:55:53.111815 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:53.111790 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g"] Jun 05 15:55:53.113636 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:55:53.113611 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf3c69f8f_2047_4ad9_9e9e_70340cf03d3a.slice/crio-9b2c53b92d4c7aaf49a2bcec5ab461417f771fb190dd403aaa2d3543664cda00 WatchSource:0}: Error finding container 9b2c53b92d4c7aaf49a2bcec5ab461417f771fb190dd403aaa2d3543664cda00: Status 404 returned error can't find the container with id 9b2c53b92d4c7aaf49a2bcec5ab461417f771fb190dd403aaa2d3543664cda00 Jun 05 15:55:53.283744 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:53.283715 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g" event={"ID":"f3c69f8f-2047-4ad9-9e9e-70340cf03d3a","Type":"ContainerStarted","Data":"9b2c53b92d4c7aaf49a2bcec5ab461417f771fb190dd403aaa2d3543664cda00"} Jun 05 15:55:53.325989 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:53.325958 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cfd2162-77e4-4a59-b36e-f524ccc3f297-cert\") pod \"kserve-controller-manager-69fc866d76-r5lk5\" (UID: \"5cfd2162-77e4-4a59-b36e-f524ccc3f297\") " pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" Jun 05 15:55:53.328161 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:53.328145 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cfd2162-77e4-4a59-b36e-f524ccc3f297-cert\") pod \"kserve-controller-manager-69fc866d76-r5lk5\" (UID: \"5cfd2162-77e4-4a59-b36e-f524ccc3f297\") " pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" Jun 05 15:55:53.580157 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:53.580071 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" Jun 05 15:55:53.591431 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:53.591403 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:53.705659 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:53.705638 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-r5lk5"] Jun 05 15:55:53.707030 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:55:53.707006 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfd2162_77e4_4a59_b36e_f524ccc3f297.slice/crio-09f9010fcd15dd75d0f0da7779be7c5720eb257dbeef99326eb8231c8d0a8ea7 WatchSource:0}: Error finding container 09f9010fcd15dd75d0f0da7779be7c5720eb257dbeef99326eb8231c8d0a8ea7: Status 404 returned error can't find the container with id 09f9010fcd15dd75d0f0da7779be7c5720eb257dbeef99326eb8231c8d0a8ea7 Jun 05 15:55:53.891722 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:53.891641 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:53.985342 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:53.985308 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:54.080458 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:54.080427 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:55:54.292341 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:54.292306 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" event={"ID":"5cfd2162-77e4-4a59-b36e-f524ccc3f297","Type":"ContainerStarted","Data":"09f9010fcd15dd75d0f0da7779be7c5720eb257dbeef99326eb8231c8d0a8ea7"} Jun 05 15:55:57.241462 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:57.241436 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-5d59g" Jun 05 15:55:57.309122 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:57.309093 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g" event={"ID":"f3c69f8f-2047-4ad9-9e9e-70340cf03d3a","Type":"ContainerStarted","Data":"e3a80286df11c99822c3efcb2e0b9765de23c7b7fc2c2273df796acb45bce7c3"} Jun 05 15:55:57.309290 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:57.309274 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g" Jun 05 15:55:57.310752 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:57.310729 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" event={"ID":"5cfd2162-77e4-4a59-b36e-f524ccc3f297","Type":"ContainerStarted","Data":"6c568bf883cb7254667429ee2298585afedc89b79165672f351914cd6205cdce"} Jun 05 15:55:57.310848 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:57.310780 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" Jun 05 15:55:57.327351 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:57.327276 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g" podStartSLOduration=1.364405621 podStartE2EDuration="5.327264386s" totalImagesPullingTime="3.962858765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:55:57.325039024 +0000 UTC m=+899.046612634" watchObservedRunningTime="2026-06-05 15:55:57.327264386 +0000 UTC m=+899.048837992" Jun 05 15:55:57.341047 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:55:57.340994 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" podStartSLOduration=1.9688715669999999 podStartE2EDuration="5.34098123s" totalImagesPullingTime="3.372109663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:55:57.339047516 +0000 UTC m=+899.060621149" watchObservedRunningTime="2026-06-05 15:55:57.34098123 +0000 UTC m=+899.062554840" Jun 05 15:56:00.004333 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:00.004308 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 15:56:00.049396 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:00.005590 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 15:56:00.266601 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:00.266534 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-9gwrf" Jun 05 15:56:02.163488 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:02.163459 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:02.265784 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:02.265755 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:03.318278 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.318250 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:03.417149 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.417096 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:03.632186 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.632098 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc"] Jun 05 15:56:03.685145 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.685096 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc"] Jun 05 15:56:03.685281 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.685212 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" Jun 05 15:56:03.703304 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.703283 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:56:03.704138 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.704099 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mf7mb\"" Jun 05 15:56:03.704138 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.704112 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:56:03.812670 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.812645 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fb4ce98-f177-4825-b2f2-46654c90f42c-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc\" (UID: \"0fb4ce98-f177-4825-b2f2-46654c90f42c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" Jun 05 15:56:03.812828 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.812749 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfzlb\" (UniqueName: \"kubernetes.io/projected/0fb4ce98-f177-4825-b2f2-46654c90f42c-kube-api-access-hfzlb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc\" (UID: \"0fb4ce98-f177-4825-b2f2-46654c90f42c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" Jun 05 15:56:03.812828 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.812788 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fb4ce98-f177-4825-b2f2-46654c90f42c-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc\" (UID: \"0fb4ce98-f177-4825-b2f2-46654c90f42c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" Jun 05 15:56:03.914196 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.914105 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fb4ce98-f177-4825-b2f2-46654c90f42c-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc\" (UID: \"0fb4ce98-f177-4825-b2f2-46654c90f42c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" Jun 05 15:56:03.914196 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.914184 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfzlb\" (UniqueName: \"kubernetes.io/projected/0fb4ce98-f177-4825-b2f2-46654c90f42c-kube-api-access-hfzlb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc\" (UID: \"0fb4ce98-f177-4825-b2f2-46654c90f42c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" Jun 05 15:56:03.914391 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.914206 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fb4ce98-f177-4825-b2f2-46654c90f42c-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc\" (UID: \"0fb4ce98-f177-4825-b2f2-46654c90f42c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" Jun 05 15:56:03.914457 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.914440 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fb4ce98-f177-4825-b2f2-46654c90f42c-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc\" (UID: \"0fb4ce98-f177-4825-b2f2-46654c90f42c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" Jun 05 15:56:03.914504 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.914470 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fb4ce98-f177-4825-b2f2-46654c90f42c-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc\" (UID: \"0fb4ce98-f177-4825-b2f2-46654c90f42c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" Jun 05 15:56:03.933300 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.933269 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfzlb\" (UniqueName: \"kubernetes.io/projected/0fb4ce98-f177-4825-b2f2-46654c90f42c-kube-api-access-hfzlb\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc\" (UID: \"0fb4ce98-f177-4825-b2f2-46654c90f42c\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" Jun 05 15:56:03.994146 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:03.994105 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" Jun 05 15:56:04.093568 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:04.093508 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:04.169625 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:04.167934 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc"] Jun 05 15:56:04.239385 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:04.239362 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:04.352744 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:04.352714 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" event={"ID":"0fb4ce98-f177-4825-b2f2-46654c90f42c","Type":"ContainerStarted","Data":"be764fc71c401d651e09736197681026c920313fc2e5eddf455621df29e79728"} Jun 05 15:56:04.353168 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:04.352766 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" event={"ID":"0fb4ce98-f177-4825-b2f2-46654c90f42c","Type":"ContainerStarted","Data":"64d9c3d32532f38970ba80412c71e11443fb9e3cd47960b15158dbd722dab61f"} Jun 05 15:56:04.693409 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:04.693349 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:04.783810 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:04.783781 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:04.910394 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:04.910368 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:05.039681 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.039644 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-mqw82"] Jun 05 15:56:05.042102 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.042082 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mqw82" Jun 05 15:56:05.045137 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.045106 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 05 15:56:05.045248 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.045173 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-4g9f8\"" Jun 05 15:56:05.045321 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.045307 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 05 15:56:05.058233 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.058213 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-mqw82"] Jun 05 15:56:05.126367 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.126340 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/375514fb-d4e0-4815-9ad4-8223911fb48f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-mqw82\" (UID: \"375514fb-d4e0-4815-9ad4-8223911fb48f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mqw82" Jun 05 15:56:05.126503 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.126482 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f48ql\" (UniqueName: \"kubernetes.io/projected/375514fb-d4e0-4815-9ad4-8223911fb48f-kube-api-access-f48ql\") pod \"servicemesh-operator3-57f65f65fb-mqw82\" (UID: \"375514fb-d4e0-4815-9ad4-8223911fb48f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mqw82" Jun 05 15:56:05.226918 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.226891 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f48ql\" (UniqueName: \"kubernetes.io/projected/375514fb-d4e0-4815-9ad4-8223911fb48f-kube-api-access-f48ql\") pod \"servicemesh-operator3-57f65f65fb-mqw82\" (UID: \"375514fb-d4e0-4815-9ad4-8223911fb48f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mqw82" Jun 05 15:56:05.227030 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.226937 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/375514fb-d4e0-4815-9ad4-8223911fb48f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-mqw82\" (UID: \"375514fb-d4e0-4815-9ad4-8223911fb48f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mqw82" Jun 05 15:56:05.229313 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.229296 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/375514fb-d4e0-4815-9ad4-8223911fb48f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-mqw82\" (UID: \"375514fb-d4e0-4815-9ad4-8223911fb48f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mqw82" Jun 05 15:56:05.235304 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.235283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f48ql\" (UniqueName: \"kubernetes.io/projected/375514fb-d4e0-4815-9ad4-8223911fb48f-kube-api-access-f48ql\") pod \"servicemesh-operator3-57f65f65fb-mqw82\" (UID: \"375514fb-d4e0-4815-9ad4-8223911fb48f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-mqw82" Jun 05 15:56:05.352001 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.351939 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mqw82" Jun 05 15:56:05.358950 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.358926 2566 generic.go:356] "Generic (PLEG): container finished" podID="0fb4ce98-f177-4825-b2f2-46654c90f42c" containerID="be764fc71c401d651e09736197681026c920313fc2e5eddf455621df29e79728" exitCode=0 Jun 05 15:56:05.359312 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.358969 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" event={"ID":"0fb4ce98-f177-4825-b2f2-46654c90f42c","Type":"ContainerDied","Data":"be764fc71c401d651e09736197681026c920313fc2e5eddf455621df29e79728"} Jun 05 15:56:05.482503 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:05.482481 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-mqw82"] Jun 05 15:56:05.483763 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:56:05.483743 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375514fb_d4e0_4815_9ad4_8223911fb48f.slice/crio-76f5f3a6246934994b8a41bd47d3ad02ce709b99e614ed7a2daeca8929ceba14 WatchSource:0}: Error finding container 76f5f3a6246934994b8a41bd47d3ad02ce709b99e614ed7a2daeca8929ceba14: Status 404 returned error can't find the container with id 76f5f3a6246934994b8a41bd47d3ad02ce709b99e614ed7a2daeca8929ceba14 Jun 05 15:56:06.366624 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:06.366589 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mqw82" event={"ID":"375514fb-d4e0-4815-9ad4-8223911fb48f","Type":"ContainerStarted","Data":"76f5f3a6246934994b8a41bd47d3ad02ce709b99e614ed7a2daeca8929ceba14"} Jun 05 15:56:07.374054 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:07.374021 2566 generic.go:356] "Generic (PLEG): container finished" podID="0fb4ce98-f177-4825-b2f2-46654c90f42c" containerID="2b8543459fd81c86d0fa2335b8e2387482b5fdcb566e0a97287a257a722b181d" exitCode=0 Jun 05 15:56:07.374439 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:07.374096 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" event={"ID":"0fb4ce98-f177-4825-b2f2-46654c90f42c","Type":"ContainerDied","Data":"2b8543459fd81c86d0fa2335b8e2387482b5fdcb566e0a97287a257a722b181d"} Jun 05 15:56:08.383329 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:08.383292 2566 generic.go:356] "Generic (PLEG): container finished" podID="0fb4ce98-f177-4825-b2f2-46654c90f42c" containerID="6f00ba3b178943a2986f930e55116494ada4de3bc7f58c84103ac58f0122f25d" exitCode=0 Jun 05 15:56:08.383789 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:08.383364 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" event={"ID":"0fb4ce98-f177-4825-b2f2-46654c90f42c","Type":"ContainerDied","Data":"6f00ba3b178943a2986f930e55116494ada4de3bc7f58c84103ac58f0122f25d"} Jun 05 15:56:09.391918 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:09.391782 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mqw82" event={"ID":"375514fb-d4e0-4815-9ad4-8223911fb48f","Type":"ContainerStarted","Data":"98313f72fc363cb995a408c0f9ae9d4dcab3917eae9aec68312d275a9eabe638"} Jun 05 15:56:09.414792 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:09.414704 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mqw82" podStartSLOduration=0.805112866 podStartE2EDuration="4.414686299s" totalImagesPullingTime="3.609573433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:56:09.412548332 +0000 UTC m=+911.134121968" watchObservedRunningTime="2026-06-05 15:56:09.414686299 +0000 UTC m=+911.136259904" Jun 05 15:56:09.546374 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:09.546349 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" Jun 05 15:56:09.673407 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:09.673325 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fb4ce98-f177-4825-b2f2-46654c90f42c-bundle\") pod \"0fb4ce98-f177-4825-b2f2-46654c90f42c\" (UID: \"0fb4ce98-f177-4825-b2f2-46654c90f42c\") " Jun 05 15:56:09.673407 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:09.673382 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fb4ce98-f177-4825-b2f2-46654c90f42c-util\") pod \"0fb4ce98-f177-4825-b2f2-46654c90f42c\" (UID: \"0fb4ce98-f177-4825-b2f2-46654c90f42c\") " Jun 05 15:56:09.673624 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:09.673442 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfzlb\" (UniqueName: \"kubernetes.io/projected/0fb4ce98-f177-4825-b2f2-46654c90f42c-kube-api-access-hfzlb\") pod \"0fb4ce98-f177-4825-b2f2-46654c90f42c\" (UID: \"0fb4ce98-f177-4825-b2f2-46654c90f42c\") " Jun 05 15:56:09.674275 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:09.674246 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fb4ce98-f177-4825-b2f2-46654c90f42c-bundle" (OuterVolumeSpecName: "bundle") pod "0fb4ce98-f177-4825-b2f2-46654c90f42c" (UID: "0fb4ce98-f177-4825-b2f2-46654c90f42c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:56:09.675495 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:09.675466 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fb4ce98-f177-4825-b2f2-46654c90f42c-kube-api-access-hfzlb" (OuterVolumeSpecName: "kube-api-access-hfzlb") pod "0fb4ce98-f177-4825-b2f2-46654c90f42c" (UID: "0fb4ce98-f177-4825-b2f2-46654c90f42c"). InnerVolumeSpecName "kube-api-access-hfzlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:56:09.678969 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:09.678944 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fb4ce98-f177-4825-b2f2-46654c90f42c-util" (OuterVolumeSpecName: "util") pod "0fb4ce98-f177-4825-b2f2-46654c90f42c" (UID: "0fb4ce98-f177-4825-b2f2-46654c90f42c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:56:09.774446 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:09.774410 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fb4ce98-f177-4825-b2f2-46654c90f42c-bundle\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:56:09.774446 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:09.774442 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fb4ce98-f177-4825-b2f2-46654c90f42c-util\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:56:09.774624 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:09.774455 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfzlb\" (UniqueName: \"kubernetes.io/projected/0fb4ce98-f177-4825-b2f2-46654c90f42c-kube-api-access-hfzlb\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:56:10.398728 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:10.398695 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" Jun 05 15:56:10.398728 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:10.398702 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apvlqc" event={"ID":"0fb4ce98-f177-4825-b2f2-46654c90f42c","Type":"ContainerDied","Data":"64d9c3d32532f38970ba80412c71e11443fb9e3cd47960b15158dbd722dab61f"} Jun 05 15:56:10.399187 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:10.398747 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64d9c3d32532f38970ba80412c71e11443fb9e3cd47960b15158dbd722dab61f" Jun 05 15:56:10.399187 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:10.398789 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mqw82" Jun 05 15:56:12.395303 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.395266 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt"] Jun 05 15:56:12.395710 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.395629 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fb4ce98-f177-4825-b2f2-46654c90f42c" containerName="extract" Jun 05 15:56:12.395710 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.395639 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fb4ce98-f177-4825-b2f2-46654c90f42c" containerName="extract" Jun 05 15:56:12.395710 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.395656 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fb4ce98-f177-4825-b2f2-46654c90f42c" containerName="util" Jun 05 15:56:12.395710 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.395661 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fb4ce98-f177-4825-b2f2-46654c90f42c" containerName="util" Jun 05 15:56:12.395710 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.395672 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fb4ce98-f177-4825-b2f2-46654c90f42c" containerName="pull" Jun 05 15:56:12.395710 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.395677 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fb4ce98-f177-4825-b2f2-46654c90f42c" containerName="pull" Jun 05 15:56:12.395982 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.395742 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fb4ce98-f177-4825-b2f2-46654c90f42c" containerName="extract" Jun 05 15:56:12.397927 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.397905 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt" Jun 05 15:56:12.400761 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.400742 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gjsmv\"" Jun 05 15:56:12.401639 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.401621 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 15:56:12.417868 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.417845 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt"] Jun 05 15:56:12.455379 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.455352 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:12.504608 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.504580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qstrn\" (UniqueName: \"kubernetes.io/projected/18ab1298-460f-4147-bb86-6777429951b0-kube-api-access-qstrn\") pod \"dashboard-redirect-6df7b7bc6d-rdgtt\" (UID: \"18ab1298-460f-4147-bb86-6777429951b0\") " pod="opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt" Jun 05 15:56:12.504710 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.504613 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/18ab1298-460f-4147-bb86-6777429951b0-redirect-config\") pod \"dashboard-redirect-6df7b7bc6d-rdgtt\" (UID: \"18ab1298-460f-4147-bb86-6777429951b0\") " pod="opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt" Jun 05 15:56:12.605806 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.605782 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qstrn\" (UniqueName: \"kubernetes.io/projected/18ab1298-460f-4147-bb86-6777429951b0-kube-api-access-qstrn\") pod \"dashboard-redirect-6df7b7bc6d-rdgtt\" (UID: \"18ab1298-460f-4147-bb86-6777429951b0\") " pod="opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt" Jun 05 15:56:12.605906 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.605815 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/18ab1298-460f-4147-bb86-6777429951b0-redirect-config\") pod \"dashboard-redirect-6df7b7bc6d-rdgtt\" (UID: \"18ab1298-460f-4147-bb86-6777429951b0\") " pod="opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt" Jun 05 15:56:12.606540 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.606522 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/18ab1298-460f-4147-bb86-6777429951b0-redirect-config\") pod \"dashboard-redirect-6df7b7bc6d-rdgtt\" (UID: \"18ab1298-460f-4147-bb86-6777429951b0\") " pod="opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt" Jun 05 15:56:12.613663 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.613645 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qstrn\" (UniqueName: \"kubernetes.io/projected/18ab1298-460f-4147-bb86-6777429951b0-kube-api-access-qstrn\") pod \"dashboard-redirect-6df7b7bc6d-rdgtt\" (UID: \"18ab1298-460f-4147-bb86-6777429951b0\") " pod="opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt" Jun 05 15:56:12.708957 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.708905 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt" Jun 05 15:56:12.837918 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:12.837894 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt"] Jun 05 15:56:12.839504 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:56:12.839479 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ab1298_460f_4147_bb86_6777429951b0.slice/crio-81c48b713536548395e194845fa73f50b817e485408efb9057c447f6363cb94b WatchSource:0}: Error finding container 81c48b713536548395e194845fa73f50b817e485408efb9057c447f6363cb94b: Status 404 returned error can't find the container with id 81c48b713536548395e194845fa73f50b817e485408efb9057c447f6363cb94b Jun 05 15:56:13.415947 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:13.415912 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt" event={"ID":"18ab1298-460f-4147-bb86-6777429951b0","Type":"ContainerStarted","Data":"81c48b713536548395e194845fa73f50b817e485408efb9057c447f6363cb94b"} Jun 05 15:56:14.691770 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.691735 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4"] Jun 05 15:56:14.695280 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.695245 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:14.698090 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.698067 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.702964 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.701745 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 05 15:56:14.702964 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.701762 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5jbh6\"" Jun 05 15:56:14.702964 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.701998 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 05 15:56:14.706595 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.703007 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 15:56:14.706595 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.704155 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 05 15:56:14.711203 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.711147 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4"] Jun 05 15:56:14.723101 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.723078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f609daa5-3def-465b-a651-c877c8f39ee8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.723312 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.723293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f609daa5-3def-465b-a651-c877c8f39ee8-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.723470 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.723450 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f609daa5-3def-465b-a651-c877c8f39ee8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.723653 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.723637 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f609daa5-3def-465b-a651-c877c8f39ee8-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.723855 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.723839 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xznq\" (UniqueName: \"kubernetes.io/projected/f609daa5-3def-465b-a651-c877c8f39ee8-kube-api-access-9xznq\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.724092 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.724075 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f609daa5-3def-465b-a651-c877c8f39ee8-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.724484 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.724462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f609daa5-3def-465b-a651-c877c8f39ee8-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.754818 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.754755 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:14.825959 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.825917 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f609daa5-3def-465b-a651-c877c8f39ee8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.826158 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.825987 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f609daa5-3def-465b-a651-c877c8f39ee8-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.826158 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.826049 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xznq\" (UniqueName: \"kubernetes.io/projected/f609daa5-3def-465b-a651-c877c8f39ee8-kube-api-access-9xznq\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.826158 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.826078 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f609daa5-3def-465b-a651-c877c8f39ee8-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.826158 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.826121 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f609daa5-3def-465b-a651-c877c8f39ee8-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.826382 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.826227 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f609daa5-3def-465b-a651-c877c8f39ee8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.826382 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.826260 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f609daa5-3def-465b-a651-c877c8f39ee8-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.826617 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.826588 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f609daa5-3def-465b-a651-c877c8f39ee8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.828792 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.828747 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f609daa5-3def-465b-a651-c877c8f39ee8-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.828908 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.828889 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f609daa5-3def-465b-a651-c877c8f39ee8-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.828968 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.828947 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f609daa5-3def-465b-a651-c877c8f39ee8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.829014 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.828951 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f609daa5-3def-465b-a651-c877c8f39ee8-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.834302 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.834278 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f609daa5-3def-465b-a651-c877c8f39ee8-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:14.834423 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:14.834340 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xznq\" (UniqueName: \"kubernetes.io/projected/f609daa5-3def-465b-a651-c877c8f39ee8-kube-api-access-9xznq\") pod \"istiod-openshift-gateway-75c67f8887-9qzg4\" (UID: \"f609daa5-3def-465b-a651-c877c8f39ee8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:15.014320 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:15.014284 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:15.044881 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:15.044846 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:15.146468 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:15.146412 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:15.152922 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:15.152899 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4"] Jun 05 15:56:15.155492 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:56:15.155462 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf609daa5_3def_465b_a651_c877c8f39ee8.slice/crio-9210c015c9fc47c75be94bc2c68fc12568e2a020cb00e3f024a598c10a355d2e WatchSource:0}: Error finding container 9210c015c9fc47c75be94bc2c68fc12568e2a020cb00e3f024a598c10a355d2e: Status 404 returned error can't find the container with id 9210c015c9fc47c75be94bc2c68fc12568e2a020cb00e3f024a598c10a355d2e Jun 05 15:56:15.342076 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:15.342043 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:15.430896 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:15.430863 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" event={"ID":"f609daa5-3def-465b-a651-c877c8f39ee8","Type":"ContainerStarted","Data":"9210c015c9fc47c75be94bc2c68fc12568e2a020cb00e3f024a598c10a355d2e"} Jun 05 15:56:15.432569 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:15.432543 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt" event={"ID":"18ab1298-460f-4147-bb86-6777429951b0","Type":"ContainerStarted","Data":"1ba94336f71010cefb989bd76c561a322820a6bb8ee7b3611bfe62b964fb1f8d"} Jun 05 15:56:15.447858 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:15.447802 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6df7b7bc6d-rdgtt" podStartSLOduration=1.335573559 podStartE2EDuration="3.447783269s" totalImagesPullingTime="2.11220971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:56:15.446734467 +0000 UTC m=+917.168308096" watchObservedRunningTime="2026-06-05 15:56:15.447783269 +0000 UTC m=+917.169356876" Jun 05 15:56:17.825550 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:17.825514 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 15:56:17.825807 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:17.825583 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 15:56:18.452543 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:18.452510 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" event={"ID":"f609daa5-3def-465b-a651-c877c8f39ee8","Type":"ContainerStarted","Data":"d728258726ccea66147e876c57df0d98dc2d02a776065dfebb5850d63a6c5e2a"} Jun 05 15:56:18.452707 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:18.452658 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:18.454464 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:18.454437 2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-9qzg4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 05 15:56:18.454622 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:18.454485 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" podUID="f609daa5-3def-465b-a651-c877c8f39ee8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:56:18.474141 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:18.474094 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" podStartSLOduration=1.806227144 podStartE2EDuration="4.474080037s" totalImagesPullingTime="2.667852893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:56:18.470939953 +0000 UTC m=+920.192513560" watchObservedRunningTime="2026-06-05 15:56:18.474080037 +0000 UTC m=+920.195653643" Jun 05 15:56:18.560259 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:18.560217 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:18.660744 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:18.660711 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:18.856673 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:18.856639 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:19.008478 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:19.008446 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:19.112282 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:19.112196 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:19.459768 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:19.459695 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-9qzg4" Jun 05 15:56:19.782243 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:19.782214 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:21.406215 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:21.406188 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-mqw82" Jun 05 15:56:28.318365 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:28.318336 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-t6d5g" Jun 05 15:56:28.321332 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:28.321310 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-r5lk5" Jun 05 15:56:43.043567 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:43.043509 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:43.138501 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:43.138468 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:43.202476 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:43.202443 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:56:58.262961 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.262926 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh"] Jun 05 15:56:58.266035 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.266019 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" Jun 05 15:56:58.268315 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.268293 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 15:56:58.269061 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.269046 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 15:56:58.269115 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.269049 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qtcgr\"" Jun 05 15:56:58.273178 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.273155 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh"] Jun 05 15:56:58.400806 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.400776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402836ce-bbd6-4f44-b67a-243561e58fe2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh\" (UID: \"402836ce-bbd6-4f44-b67a-243561e58fe2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" Jun 05 15:56:58.400977 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.400831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p9dn\" (UniqueName: \"kubernetes.io/projected/402836ce-bbd6-4f44-b67a-243561e58fe2-kube-api-access-6p9dn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh\" (UID: \"402836ce-bbd6-4f44-b67a-243561e58fe2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" Jun 05 15:56:58.400977 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.400880 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402836ce-bbd6-4f44-b67a-243561e58fe2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh\" (UID: \"402836ce-bbd6-4f44-b67a-243561e58fe2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" Jun 05 15:56:58.501429 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.501401 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402836ce-bbd6-4f44-b67a-243561e58fe2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh\" (UID: \"402836ce-bbd6-4f44-b67a-243561e58fe2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" Jun 05 15:56:58.501555 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.501450 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402836ce-bbd6-4f44-b67a-243561e58fe2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh\" (UID: \"402836ce-bbd6-4f44-b67a-243561e58fe2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" Jun 05 15:56:58.501555 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.501496 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p9dn\" (UniqueName: \"kubernetes.io/projected/402836ce-bbd6-4f44-b67a-243561e58fe2-kube-api-access-6p9dn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh\" (UID: \"402836ce-bbd6-4f44-b67a-243561e58fe2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" Jun 05 15:56:58.501753 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.501736 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402836ce-bbd6-4f44-b67a-243561e58fe2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh\" (UID: \"402836ce-bbd6-4f44-b67a-243561e58fe2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" Jun 05 15:56:58.501886 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.501870 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402836ce-bbd6-4f44-b67a-243561e58fe2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh\" (UID: \"402836ce-bbd6-4f44-b67a-243561e58fe2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" Jun 05 15:56:58.509790 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.509759 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p9dn\" (UniqueName: \"kubernetes.io/projected/402836ce-bbd6-4f44-b67a-243561e58fe2-kube-api-access-6p9dn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh\" (UID: \"402836ce-bbd6-4f44-b67a-243561e58fe2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" Jun 05 15:56:58.575691 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.575636 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" Jun 05 15:56:58.664257 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.664232 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7"] Jun 05 15:56:58.667072 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.667054 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" Jun 05 15:56:58.678534 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.678503 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7"] Jun 05 15:56:58.716420 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.716396 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh"] Jun 05 15:56:58.717723 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:56:58.717696 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402836ce_bbd6_4f44_b67a_243561e58fe2.slice/crio-94ee923c6f460a01e7e2679321106e6b18de862684c95bf58e3695dcb92fe3f9 WatchSource:0}: Error finding container 94ee923c6f460a01e7e2679321106e6b18de862684c95bf58e3695dcb92fe3f9: Status 404 returned error can't find the container with id 94ee923c6f460a01e7e2679321106e6b18de862684c95bf58e3695dcb92fe3f9 Jun 05 15:56:58.803564 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.803530 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgclz\" (UniqueName: \"kubernetes.io/projected/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-kube-api-access-jgclz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7\" (UID: \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" Jun 05 15:56:58.803564 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.803577 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7\" (UID: \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" Jun 05 15:56:58.803810 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.803634 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7\" (UID: \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" Jun 05 15:56:58.904930 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.904871 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgclz\" (UniqueName: \"kubernetes.io/projected/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-kube-api-access-jgclz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7\" (UID: \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" Jun 05 15:56:58.904930 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.904909 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7\" (UID: \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" Jun 05 15:56:58.905075 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.905030 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7\" (UID: \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" Jun 05 15:56:58.905238 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.905223 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7\" (UID: \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" Jun 05 15:56:58.905347 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.905329 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7\" (UID: \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" Jun 05 15:56:58.912566 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.912548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgclz\" (UniqueName: \"kubernetes.io/projected/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-kube-api-access-jgclz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7\" (UID: \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" Jun 05 15:56:58.981060 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:58.981039 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" Jun 05 15:56:59.061492 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.061465 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt"] Jun 05 15:56:59.064679 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.064658 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" Jun 05 15:56:59.073167 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.073142 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt"] Jun 05 15:56:59.113557 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.113534 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7"] Jun 05 15:56:59.114736 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:56:59.114716 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e2a3f3_dff5_4697_b5a2_d5dcb10c87d9.slice/crio-1b753cd7750db7931552c06c85dedbe51864042b4084bee703fc639c895dac95 WatchSource:0}: Error finding container 1b753cd7750db7931552c06c85dedbe51864042b4084bee703fc639c895dac95: Status 404 returned error can't find the container with id 1b753cd7750db7931552c06c85dedbe51864042b4084bee703fc639c895dac95 Jun 05 15:56:59.207452 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.207423 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69c96410-5950-4b0c-ad35-23251de58880-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt\" (UID: \"69c96410-5950-4b0c-ad35-23251de58880\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" Jun 05 15:56:59.207588 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.207462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z59xr\" (UniqueName: \"kubernetes.io/projected/69c96410-5950-4b0c-ad35-23251de58880-kube-api-access-z59xr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt\" (UID: \"69c96410-5950-4b0c-ad35-23251de58880\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" Jun 05 15:56:59.207588 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.207488 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69c96410-5950-4b0c-ad35-23251de58880-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt\" (UID: \"69c96410-5950-4b0c-ad35-23251de58880\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" Jun 05 15:56:59.308971 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.308940 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69c96410-5950-4b0c-ad35-23251de58880-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt\" (UID: \"69c96410-5950-4b0c-ad35-23251de58880\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" Jun 05 15:56:59.309384 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.308985 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z59xr\" (UniqueName: \"kubernetes.io/projected/69c96410-5950-4b0c-ad35-23251de58880-kube-api-access-z59xr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt\" (UID: \"69c96410-5950-4b0c-ad35-23251de58880\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" Jun 05 15:56:59.309384 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.309023 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69c96410-5950-4b0c-ad35-23251de58880-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt\" (UID: \"69c96410-5950-4b0c-ad35-23251de58880\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" Jun 05 15:56:59.309384 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.309283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69c96410-5950-4b0c-ad35-23251de58880-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt\" (UID: \"69c96410-5950-4b0c-ad35-23251de58880\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" Jun 05 15:56:59.309509 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.309390 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69c96410-5950-4b0c-ad35-23251de58880-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt\" (UID: \"69c96410-5950-4b0c-ad35-23251de58880\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" Jun 05 15:56:59.316989 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.316968 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z59xr\" (UniqueName: \"kubernetes.io/projected/69c96410-5950-4b0c-ad35-23251de58880-kube-api-access-z59xr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt\" (UID: \"69c96410-5950-4b0c-ad35-23251de58880\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" Jun 05 15:56:59.376987 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.376963 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" Jun 05 15:56:59.502560 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.502537 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt"] Jun 05 15:56:59.504118 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:56:59.504091 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c96410_5950_4b0c_ad35_23251de58880.slice/crio-cd092a200e9e27ddb9dd285ea05f5b53331e7f71401d75612c782b9664ea4af4 WatchSource:0}: Error finding container cd092a200e9e27ddb9dd285ea05f5b53331e7f71401d75612c782b9664ea4af4: Status 404 returned error can't find the container with id cd092a200e9e27ddb9dd285ea05f5b53331e7f71401d75612c782b9664ea4af4 Jun 05 15:56:59.657344 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.657311 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk"] Jun 05 15:56:59.659788 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.659770 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" Jun 05 15:56:59.667902 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.667872 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk"] Jun 05 15:56:59.689561 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.689502 2566 generic.go:356] "Generic (PLEG): container finished" podID="69c96410-5950-4b0c-ad35-23251de58880" containerID="3d0f7ac459ec8861e1dccb9e6494bea76a9aad315062e9ab16b2cc615b1adb52" exitCode=0 Jun 05 15:56:59.689667 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.689579 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" event={"ID":"69c96410-5950-4b0c-ad35-23251de58880","Type":"ContainerDied","Data":"3d0f7ac459ec8861e1dccb9e6494bea76a9aad315062e9ab16b2cc615b1adb52"} Jun 05 15:56:59.689667 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.689622 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" event={"ID":"69c96410-5950-4b0c-ad35-23251de58880","Type":"ContainerStarted","Data":"cd092a200e9e27ddb9dd285ea05f5b53331e7f71401d75612c782b9664ea4af4"} Jun 05 15:56:59.691149 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.691113 2566 generic.go:356] "Generic (PLEG): container finished" podID="402836ce-bbd6-4f44-b67a-243561e58fe2" containerID="ff08f505908336bc0893734158cfeec9a4179b2ecf3f7f73fe9ada66a4d1056e" exitCode=0 Jun 05 15:56:59.691237 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.691164 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" event={"ID":"402836ce-bbd6-4f44-b67a-243561e58fe2","Type":"ContainerDied","Data":"ff08f505908336bc0893734158cfeec9a4179b2ecf3f7f73fe9ada66a4d1056e"} Jun 05 15:56:59.691237 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.691201 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" event={"ID":"402836ce-bbd6-4f44-b67a-243561e58fe2","Type":"ContainerStarted","Data":"94ee923c6f460a01e7e2679321106e6b18de862684c95bf58e3695dcb92fe3f9"} Jun 05 15:56:59.692970 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.692953 2566 generic.go:356] "Generic (PLEG): container finished" podID="31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9" containerID="3dc37117782f48e20d4eb0198c9bce6c19ccfacce9021b2e6e5c10bf1485c6a0" exitCode=0 Jun 05 15:56:59.693048 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.693020 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" event={"ID":"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9","Type":"ContainerDied","Data":"3dc37117782f48e20d4eb0198c9bce6c19ccfacce9021b2e6e5c10bf1485c6a0"} Jun 05 15:56:59.693100 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.693055 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" event={"ID":"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9","Type":"ContainerStarted","Data":"1b753cd7750db7931552c06c85dedbe51864042b4084bee703fc639c895dac95"} Jun 05 15:56:59.815713 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.815685 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bc631e1-1e46-450c-b16a-b79d30a9d512-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk\" (UID: \"5bc631e1-1e46-450c-b16a-b79d30a9d512\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" Jun 05 15:56:59.815836 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.815748 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bc631e1-1e46-450c-b16a-b79d30a9d512-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk\" (UID: \"5bc631e1-1e46-450c-b16a-b79d30a9d512\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" Jun 05 15:56:59.815836 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.815797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb86q\" (UniqueName: \"kubernetes.io/projected/5bc631e1-1e46-450c-b16a-b79d30a9d512-kube-api-access-nb86q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk\" (UID: \"5bc631e1-1e46-450c-b16a-b79d30a9d512\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" Jun 05 15:56:59.916970 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.916944 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bc631e1-1e46-450c-b16a-b79d30a9d512-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk\" (UID: \"5bc631e1-1e46-450c-b16a-b79d30a9d512\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" Jun 05 15:56:59.917070 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.916989 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb86q\" (UniqueName: \"kubernetes.io/projected/5bc631e1-1e46-450c-b16a-b79d30a9d512-kube-api-access-nb86q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk\" (UID: \"5bc631e1-1e46-450c-b16a-b79d30a9d512\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" Jun 05 15:56:59.917070 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.917040 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bc631e1-1e46-450c-b16a-b79d30a9d512-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk\" (UID: \"5bc631e1-1e46-450c-b16a-b79d30a9d512\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" Jun 05 15:56:59.917312 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.917296 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bc631e1-1e46-450c-b16a-b79d30a9d512-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk\" (UID: \"5bc631e1-1e46-450c-b16a-b79d30a9d512\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" Jun 05 15:56:59.917367 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.917336 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bc631e1-1e46-450c-b16a-b79d30a9d512-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk\" (UID: \"5bc631e1-1e46-450c-b16a-b79d30a9d512\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" Jun 05 15:56:59.925221 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.925200 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb86q\" (UniqueName: \"kubernetes.io/projected/5bc631e1-1e46-450c-b16a-b79d30a9d512-kube-api-access-nb86q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk\" (UID: \"5bc631e1-1e46-450c-b16a-b79d30a9d512\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" Jun 05 15:56:59.975685 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:56:59.975632 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" Jun 05 15:57:00.106921 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:00.106893 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk"] Jun 05 15:57:00.108137 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:57:00.108101 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc631e1_1e46_450c_b16a_b79d30a9d512.slice/crio-b4f4c56f2636c336d8903ff9b8d44de93e1bc2856b872a81e2a17c4410828c8e WatchSource:0}: Error finding container b4f4c56f2636c336d8903ff9b8d44de93e1bc2856b872a81e2a17c4410828c8e: Status 404 returned error can't find the container with id b4f4c56f2636c336d8903ff9b8d44de93e1bc2856b872a81e2a17c4410828c8e Jun 05 15:57:00.707011 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:00.706979 2566 generic.go:356] "Generic (PLEG): container finished" podID="31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9" containerID="7bb3ffba38d780e78e963a931cbd321ff5a01fb3b2ca9703a2ecb31e6cbdf996" exitCode=0 Jun 05 15:57:00.707480 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:00.707452 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" event={"ID":"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9","Type":"ContainerDied","Data":"7bb3ffba38d780e78e963a931cbd321ff5a01fb3b2ca9703a2ecb31e6cbdf996"} Jun 05 15:57:00.709007 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:00.708988 2566 generic.go:356] "Generic (PLEG): container finished" podID="402836ce-bbd6-4f44-b67a-243561e58fe2" containerID="8f3305281b6fb1344753455e9067f22fc771c6f31f908dbd74de00f910d2c139" exitCode=0 Jun 05 15:57:00.709085 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:00.709064 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" event={"ID":"402836ce-bbd6-4f44-b67a-243561e58fe2","Type":"ContainerDied","Data":"8f3305281b6fb1344753455e9067f22fc771c6f31f908dbd74de00f910d2c139"} Jun 05 15:57:00.710735 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:00.710711 2566 generic.go:356] "Generic (PLEG): container finished" podID="5bc631e1-1e46-450c-b16a-b79d30a9d512" containerID="3ab579a024ff5641b45f38988ec7b3e43c82d482c678325bd499538b65897996" exitCode=0 Jun 05 15:57:00.710828 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:00.710745 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" event={"ID":"5bc631e1-1e46-450c-b16a-b79d30a9d512","Type":"ContainerDied","Data":"3ab579a024ff5641b45f38988ec7b3e43c82d482c678325bd499538b65897996"} Jun 05 15:57:00.710828 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:00.710777 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" event={"ID":"5bc631e1-1e46-450c-b16a-b79d30a9d512","Type":"ContainerStarted","Data":"b4f4c56f2636c336d8903ff9b8d44de93e1bc2856b872a81e2a17c4410828c8e"} Jun 05 15:57:01.718298 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:01.718232 2566 generic.go:356] "Generic (PLEG): container finished" podID="69c96410-5950-4b0c-ad35-23251de58880" containerID="871ac66d40cc7f754113ed325539ecf6a6438aef5595e6cfa2d4cfb34d053f27" exitCode=0 Jun 05 15:57:01.718683 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:01.718313 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" event={"ID":"69c96410-5950-4b0c-ad35-23251de58880","Type":"ContainerDied","Data":"871ac66d40cc7f754113ed325539ecf6a6438aef5595e6cfa2d4cfb34d053f27"} Jun 05 15:57:01.720651 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:01.720628 2566 generic.go:356] "Generic (PLEG): container finished" podID="402836ce-bbd6-4f44-b67a-243561e58fe2" containerID="ed2084f78f5ce82d36dc774cfd91e6cd4622bfe3e185dfad961849b08fde8cb3" exitCode=0 Jun 05 15:57:01.720753 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:01.720712 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" event={"ID":"402836ce-bbd6-4f44-b67a-243561e58fe2","Type":"ContainerDied","Data":"ed2084f78f5ce82d36dc774cfd91e6cd4622bfe3e185dfad961849b08fde8cb3"} Jun 05 15:57:01.722607 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:01.722587 2566 generic.go:356] "Generic (PLEG): container finished" podID="5bc631e1-1e46-450c-b16a-b79d30a9d512" containerID="efb1218b2a3f0c02d67791b22578d410903e5ee1a4d072a805a11fe84e3fbf21" exitCode=0 Jun 05 15:57:01.722733 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:01.722712 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" event={"ID":"5bc631e1-1e46-450c-b16a-b79d30a9d512","Type":"ContainerDied","Data":"efb1218b2a3f0c02d67791b22578d410903e5ee1a4d072a805a11fe84e3fbf21"} Jun 05 15:57:01.725163 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:01.725142 2566 generic.go:356] "Generic (PLEG): container finished" podID="31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9" containerID="d9e0d2405a6a7ff90f660b952dbcf9690fd48a339e440780e653d40664f6e5c9" exitCode=0 Jun 05 15:57:01.725256 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:01.725196 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" event={"ID":"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9","Type":"ContainerDied","Data":"d9e0d2405a6a7ff90f660b952dbcf9690fd48a339e440780e653d40664f6e5c9"} Jun 05 15:57:02.731549 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:02.731518 2566 generic.go:356] "Generic (PLEG): container finished" podID="69c96410-5950-4b0c-ad35-23251de58880" containerID="ec61a4936b4a34a80bd5a8808ca3a2d44620f5c2c3a66a52c10db0d3f957e0c3" exitCode=0 Jun 05 15:57:02.731945 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:02.731605 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" event={"ID":"69c96410-5950-4b0c-ad35-23251de58880","Type":"ContainerDied","Data":"ec61a4936b4a34a80bd5a8808ca3a2d44620f5c2c3a66a52c10db0d3f957e0c3"} Jun 05 15:57:02.733505 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:02.733479 2566 generic.go:356] "Generic (PLEG): container finished" podID="5bc631e1-1e46-450c-b16a-b79d30a9d512" containerID="14d4657a93421525eda474c2554500abf062c6cc9c5d8d70feded7068d78add1" exitCode=0 Jun 05 15:57:02.733626 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:02.733569 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" event={"ID":"5bc631e1-1e46-450c-b16a-b79d30a9d512","Type":"ContainerDied","Data":"14d4657a93421525eda474c2554500abf062c6cc9c5d8d70feded7068d78add1"} Jun 05 15:57:02.874364 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:02.874340 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" Jun 05 15:57:02.897056 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:02.897032 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" Jun 05 15:57:03.045511 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.045482 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402836ce-bbd6-4f44-b67a-243561e58fe2-util\") pod \"402836ce-bbd6-4f44-b67a-243561e58fe2\" (UID: \"402836ce-bbd6-4f44-b67a-243561e58fe2\") " Jun 05 15:57:03.045696 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.045534 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p9dn\" (UniqueName: \"kubernetes.io/projected/402836ce-bbd6-4f44-b67a-243561e58fe2-kube-api-access-6p9dn\") pod \"402836ce-bbd6-4f44-b67a-243561e58fe2\" (UID: \"402836ce-bbd6-4f44-b67a-243561e58fe2\") " Jun 05 15:57:03.045696 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.045602 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgclz\" (UniqueName: \"kubernetes.io/projected/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-kube-api-access-jgclz\") pod \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\" (UID: \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\") " Jun 05 15:57:03.045696 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.045628 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402836ce-bbd6-4f44-b67a-243561e58fe2-bundle\") pod \"402836ce-bbd6-4f44-b67a-243561e58fe2\" (UID: \"402836ce-bbd6-4f44-b67a-243561e58fe2\") " Jun 05 15:57:03.045696 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.045650 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-util\") pod \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\" (UID: \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\") " Jun 05 15:57:03.045916 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.045718 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-bundle\") pod \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\" (UID: \"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9\") " Jun 05 15:57:03.046342 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.046315 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402836ce-bbd6-4f44-b67a-243561e58fe2-bundle" (OuterVolumeSpecName: "bundle") pod "402836ce-bbd6-4f44-b67a-243561e58fe2" (UID: "402836ce-bbd6-4f44-b67a-243561e58fe2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:57:03.046456 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.046437 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-bundle" (OuterVolumeSpecName: "bundle") pod "31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9" (UID: "31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:57:03.047729 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.047700 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-kube-api-access-jgclz" (OuterVolumeSpecName: "kube-api-access-jgclz") pod "31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9" (UID: "31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9"). InnerVolumeSpecName "kube-api-access-jgclz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:57:03.047920 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.047902 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/402836ce-bbd6-4f44-b67a-243561e58fe2-kube-api-access-6p9dn" (OuterVolumeSpecName: "kube-api-access-6p9dn") pod "402836ce-bbd6-4f44-b67a-243561e58fe2" (UID: "402836ce-bbd6-4f44-b67a-243561e58fe2"). InnerVolumeSpecName "kube-api-access-6p9dn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:57:03.051093 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.051061 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402836ce-bbd6-4f44-b67a-243561e58fe2-util" (OuterVolumeSpecName: "util") pod "402836ce-bbd6-4f44-b67a-243561e58fe2" (UID: "402836ce-bbd6-4f44-b67a-243561e58fe2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:57:03.053298 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.053273 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-util" (OuterVolumeSpecName: "util") pod "31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9" (UID: "31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:57:03.147219 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.147198 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-bundle\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:57:03.147219 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.147216 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/402836ce-bbd6-4f44-b67a-243561e58fe2-util\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:57:03.147347 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.147225 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p9dn\" (UniqueName: \"kubernetes.io/projected/402836ce-bbd6-4f44-b67a-243561e58fe2-kube-api-access-6p9dn\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:57:03.147347 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.147236 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgclz\" (UniqueName: \"kubernetes.io/projected/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-kube-api-access-jgclz\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:57:03.147347 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.147245 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/402836ce-bbd6-4f44-b67a-243561e58fe2-bundle\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:57:03.147347 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.147252 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9-util\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:57:03.744784 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.744760 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" Jun 05 15:57:03.745279 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.744797 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7" event={"ID":"31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9","Type":"ContainerDied","Data":"1b753cd7750db7931552c06c85dedbe51864042b4084bee703fc639c895dac95"} Jun 05 15:57:03.745279 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.744841 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b753cd7750db7931552c06c85dedbe51864042b4084bee703fc639c895dac95" Jun 05 15:57:03.746625 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.746606 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" Jun 05 15:57:03.746738 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.746641 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh" event={"ID":"402836ce-bbd6-4f44-b67a-243561e58fe2","Type":"ContainerDied","Data":"94ee923c6f460a01e7e2679321106e6b18de862684c95bf58e3695dcb92fe3f9"} Jun 05 15:57:03.746738 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.746683 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94ee923c6f460a01e7e2679321106e6b18de862684c95bf58e3695dcb92fe3f9" Jun 05 15:57:03.876605 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.876584 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" Jun 05 15:57:03.901927 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.901903 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" Jun 05 15:57:03.952354 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.952318 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bc631e1-1e46-450c-b16a-b79d30a9d512-bundle\") pod \"5bc631e1-1e46-450c-b16a-b79d30a9d512\" (UID: \"5bc631e1-1e46-450c-b16a-b79d30a9d512\") " Jun 05 15:57:03.952470 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.952379 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z59xr\" (UniqueName: \"kubernetes.io/projected/69c96410-5950-4b0c-ad35-23251de58880-kube-api-access-z59xr\") pod \"69c96410-5950-4b0c-ad35-23251de58880\" (UID: \"69c96410-5950-4b0c-ad35-23251de58880\") " Jun 05 15:57:03.952470 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.952438 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69c96410-5950-4b0c-ad35-23251de58880-util\") pod \"69c96410-5950-4b0c-ad35-23251de58880\" (UID: \"69c96410-5950-4b0c-ad35-23251de58880\") " Jun 05 15:57:03.952470 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.952464 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bc631e1-1e46-450c-b16a-b79d30a9d512-util\") pod \"5bc631e1-1e46-450c-b16a-b79d30a9d512\" (UID: \"5bc631e1-1e46-450c-b16a-b79d30a9d512\") " Jun 05 15:57:03.952641 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.952487 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb86q\" (UniqueName: \"kubernetes.io/projected/5bc631e1-1e46-450c-b16a-b79d30a9d512-kube-api-access-nb86q\") pod \"5bc631e1-1e46-450c-b16a-b79d30a9d512\" (UID: \"5bc631e1-1e46-450c-b16a-b79d30a9d512\") " Jun 05 15:57:03.952641 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.952541 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69c96410-5950-4b0c-ad35-23251de58880-bundle\") pod \"69c96410-5950-4b0c-ad35-23251de58880\" (UID: \"69c96410-5950-4b0c-ad35-23251de58880\") " Jun 05 15:57:03.952987 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.952961 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc631e1-1e46-450c-b16a-b79d30a9d512-bundle" (OuterVolumeSpecName: "bundle") pod "5bc631e1-1e46-450c-b16a-b79d30a9d512" (UID: "5bc631e1-1e46-450c-b16a-b79d30a9d512"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:57:03.953187 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.953062 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69c96410-5950-4b0c-ad35-23251de58880-bundle" (OuterVolumeSpecName: "bundle") pod "69c96410-5950-4b0c-ad35-23251de58880" (UID: "69c96410-5950-4b0c-ad35-23251de58880"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:57:03.954510 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.954489 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69c96410-5950-4b0c-ad35-23251de58880-kube-api-access-z59xr" (OuterVolumeSpecName: "kube-api-access-z59xr") pod "69c96410-5950-4b0c-ad35-23251de58880" (UID: "69c96410-5950-4b0c-ad35-23251de58880"). InnerVolumeSpecName "kube-api-access-z59xr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:57:03.954870 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.954849 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc631e1-1e46-450c-b16a-b79d30a9d512-kube-api-access-nb86q" (OuterVolumeSpecName: "kube-api-access-nb86q") pod "5bc631e1-1e46-450c-b16a-b79d30a9d512" (UID: "5bc631e1-1e46-450c-b16a-b79d30a9d512"). InnerVolumeSpecName "kube-api-access-nb86q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:57:03.958232 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.958213 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc631e1-1e46-450c-b16a-b79d30a9d512-util" (OuterVolumeSpecName: "util") pod "5bc631e1-1e46-450c-b16a-b79d30a9d512" (UID: "5bc631e1-1e46-450c-b16a-b79d30a9d512"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:57:03.958807 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:03.958787 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69c96410-5950-4b0c-ad35-23251de58880-util" (OuterVolumeSpecName: "util") pod "69c96410-5950-4b0c-ad35-23251de58880" (UID: "69c96410-5950-4b0c-ad35-23251de58880"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:57:04.053334 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:04.053279 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69c96410-5950-4b0c-ad35-23251de58880-bundle\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:57:04.053334 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:04.053299 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bc631e1-1e46-450c-b16a-b79d30a9d512-bundle\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:57:04.053334 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:04.053309 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z59xr\" (UniqueName: \"kubernetes.io/projected/69c96410-5950-4b0c-ad35-23251de58880-kube-api-access-z59xr\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:57:04.053334 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:04.053317 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69c96410-5950-4b0c-ad35-23251de58880-util\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:57:04.053334 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:04.053325 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bc631e1-1e46-450c-b16a-b79d30a9d512-util\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:57:04.053334 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:04.053332 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb86q\" (UniqueName: \"kubernetes.io/projected/5bc631e1-1e46-450c-b16a-b79d30a9d512-kube-api-access-nb86q\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:57:04.754859 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:04.754831 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" event={"ID":"69c96410-5950-4b0c-ad35-23251de58880","Type":"ContainerDied","Data":"cd092a200e9e27ddb9dd285ea05f5b53331e7f71401d75612c782b9664ea4af4"} Jun 05 15:57:04.755222 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:04.754876 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd092a200e9e27ddb9dd285ea05f5b53331e7f71401d75612c782b9664ea4af4" Jun 05 15:57:04.755222 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:04.754880 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt" Jun 05 15:57:04.756946 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:04.756921 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" event={"ID":"5bc631e1-1e46-450c-b16a-b79d30a9d512","Type":"ContainerDied","Data":"b4f4c56f2636c336d8903ff9b8d44de93e1bc2856b872a81e2a17c4410828c8e"} Jun 05 15:57:04.757063 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:04.756964 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4f4c56f2636c336d8903ff9b8d44de93e1bc2856b872a81e2a17c4410828c8e" Jun 05 15:57:04.757063 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:04.757034 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk" Jun 05 15:57:11.007717 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:11.007682 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:15.259522 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:15.259483 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:16.608643 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:16.608608 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:18.228412 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:18.228383 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:18.446474 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:18.446406 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:18.623250 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:18.623218 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:18.725870 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:18.725840 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:21.227799 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.227766 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vbcnm"] Jun 05 15:57:21.228206 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228189 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69c96410-5950-4b0c-ad35-23251de58880" containerName="extract" Jun 05 15:57:21.228260 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228208 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="69c96410-5950-4b0c-ad35-23251de58880" containerName="extract" Jun 05 15:57:21.228260 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228219 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9" containerName="extract" Jun 05 15:57:21.228260 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228224 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9" containerName="extract" Jun 05 15:57:21.228260 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228234 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9" containerName="util" Jun 05 15:57:21.228260 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228240 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9" containerName="util" Jun 05 15:57:21.228260 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228246 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc631e1-1e46-450c-b16a-b79d30a9d512" containerName="extract" Jun 05 15:57:21.228260 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228252 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc631e1-1e46-450c-b16a-b79d30a9d512" containerName="extract" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228263 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc631e1-1e46-450c-b16a-b79d30a9d512" containerName="util" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228268 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc631e1-1e46-450c-b16a-b79d30a9d512" containerName="util" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228275 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402836ce-bbd6-4f44-b67a-243561e58fe2" containerName="util" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228280 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="402836ce-bbd6-4f44-b67a-243561e58fe2" containerName="util" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228286 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402836ce-bbd6-4f44-b67a-243561e58fe2" containerName="extract" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228290 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="402836ce-bbd6-4f44-b67a-243561e58fe2" containerName="extract" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228300 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9" containerName="pull" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228304 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9" containerName="pull" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228313 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69c96410-5950-4b0c-ad35-23251de58880" containerName="util" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228318 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="69c96410-5950-4b0c-ad35-23251de58880" containerName="util" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228324 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69c96410-5950-4b0c-ad35-23251de58880" containerName="pull" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228328 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="69c96410-5950-4b0c-ad35-23251de58880" containerName="pull" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228339 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402836ce-bbd6-4f44-b67a-243561e58fe2" containerName="pull" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228343 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="402836ce-bbd6-4f44-b67a-243561e58fe2" containerName="pull" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228348 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc631e1-1e46-450c-b16a-b79d30a9d512" containerName="pull" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228352 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc631e1-1e46-450c-b16a-b79d30a9d512" containerName="pull" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228421 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9" containerName="extract" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228430 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="69c96410-5950-4b0c-ad35-23251de58880" containerName="extract" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228436 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="402836ce-bbd6-4f44-b67a-243561e58fe2" containerName="extract" Jun 05 15:57:21.228466 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.228441 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bc631e1-1e46-450c-b16a-b79d30a9d512" containerName="extract" Jun 05 15:57:21.231143 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.231110 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vbcnm" Jun 05 15:57:21.233416 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.233393 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zmvzq\"" Jun 05 15:57:21.233557 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.233423 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 15:57:21.234264 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.234246 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 15:57:21.241700 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.241675 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vbcnm"] Jun 05 15:57:21.289223 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.289202 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ss9l\" (UniqueName: \"kubernetes.io/projected/5d833ab3-784a-4111-a2bf-5a12517c2b8a-kube-api-access-7ss9l\") pod \"authorino-operator-75cc8d5cb7-vbcnm\" (UID: \"5d833ab3-784a-4111-a2bf-5a12517c2b8a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vbcnm" Jun 05 15:57:21.390138 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.390106 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ss9l\" (UniqueName: \"kubernetes.io/projected/5d833ab3-784a-4111-a2bf-5a12517c2b8a-kube-api-access-7ss9l\") pod \"authorino-operator-75cc8d5cb7-vbcnm\" (UID: \"5d833ab3-784a-4111-a2bf-5a12517c2b8a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vbcnm" Jun 05 15:57:21.399521 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.399496 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ss9l\" (UniqueName: \"kubernetes.io/projected/5d833ab3-784a-4111-a2bf-5a12517c2b8a-kube-api-access-7ss9l\") pod \"authorino-operator-75cc8d5cb7-vbcnm\" (UID: \"5d833ab3-784a-4111-a2bf-5a12517c2b8a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vbcnm" Jun 05 15:57:21.542215 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.542191 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vbcnm" Jun 05 15:57:21.679574 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.679547 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vbcnm"] Jun 05 15:57:21.681564 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:57:21.681537 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d833ab3_784a_4111_a2bf_5a12517c2b8a.slice/crio-6d14981113e8fdd386ea89b887b88b5ee1a71512da7ec4a3ab92ab56053df58c WatchSource:0}: Error finding container 6d14981113e8fdd386ea89b887b88b5ee1a71512da7ec4a3ab92ab56053df58c: Status 404 returned error can't find the container with id 6d14981113e8fdd386ea89b887b88b5ee1a71512da7ec4a3ab92ab56053df58c Jun 05 15:57:21.693114 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.693089 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:21.832504 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.832450 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:21.851467 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:21.851431 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vbcnm" event={"ID":"5d833ab3-784a-4111-a2bf-5a12517c2b8a","Type":"ContainerStarted","Data":"6d14981113e8fdd386ea89b887b88b5ee1a71512da7ec4a3ab92ab56053df58c"} Jun 05 15:57:24.469544 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:24.469490 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:24.552699 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:24.552669 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:24.874036 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:24.874005 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vbcnm" event={"ID":"5d833ab3-784a-4111-a2bf-5a12517c2b8a","Type":"ContainerStarted","Data":"6c004fa1d90fab4d0b34bc6e6a3ca431bddd17b6aa9802df06fb8a4504fdb28d"} Jun 05 15:57:24.874197 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:24.874062 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vbcnm" Jun 05 15:57:24.892711 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:24.892668 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vbcnm" podStartSLOduration=1.721156905 podStartE2EDuration="3.892652938s" totalImagesPullingTime="2.171496033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:57:24.889560235 +0000 UTC m=+986.611133842" watchObservedRunningTime="2026-06-05 15:57:24.892652938 +0000 UTC m=+986.614226544" Jun 05 15:57:26.216188 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:26.216152 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:26.316517 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:26.316486 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:33.829419 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:33.829383 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:33.929797 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:33.929760 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:35.882909 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:35.882883 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vbcnm" Jun 05 15:57:38.650880 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:38.650842 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:38.750932 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:38.750903 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:38.850817 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:38.850788 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:41.066787 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:41.066756 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:41.166770 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:41.166742 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:42.784445 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:42.784413 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:46.649381 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:46.649346 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:46.757838 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:46.757801 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:47.700137 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:47.700104 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:47.927320 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:47.927282 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr"] Jun 05 15:57:47.932034 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:47.932009 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" Jun 05 15:57:47.934563 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:47.934543 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zsxrb\"" Jun 05 15:57:47.943387 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:47.943361 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr"] Jun 05 15:57:48.036566 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:48.036538 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6552e640-6637-4f99-9873-6a8d78161c75-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q6xgr\" (UID: \"6552e640-6637-4f99-9873-6a8d78161c75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" Jun 05 15:57:48.036747 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:48.036666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tqc7\" (UniqueName: \"kubernetes.io/projected/6552e640-6637-4f99-9873-6a8d78161c75-kube-api-access-8tqc7\") pod \"kuadrant-operator-controller-manager-86878c769f-q6xgr\" (UID: \"6552e640-6637-4f99-9873-6a8d78161c75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" Jun 05 15:57:48.137906 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:48.137872 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tqc7\" (UniqueName: \"kubernetes.io/projected/6552e640-6637-4f99-9873-6a8d78161c75-kube-api-access-8tqc7\") pod \"kuadrant-operator-controller-manager-86878c769f-q6xgr\" (UID: \"6552e640-6637-4f99-9873-6a8d78161c75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" Jun 05 15:57:48.138082 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:48.137917 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6552e640-6637-4f99-9873-6a8d78161c75-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q6xgr\" (UID: \"6552e640-6637-4f99-9873-6a8d78161c75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" Jun 05 15:57:48.138324 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:48.138307 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6552e640-6637-4f99-9873-6a8d78161c75-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q6xgr\" (UID: \"6552e640-6637-4f99-9873-6a8d78161c75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" Jun 05 15:57:48.146350 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:48.146322 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tqc7\" (UniqueName: \"kubernetes.io/projected/6552e640-6637-4f99-9873-6a8d78161c75-kube-api-access-8tqc7\") pod \"kuadrant-operator-controller-manager-86878c769f-q6xgr\" (UID: \"6552e640-6637-4f99-9873-6a8d78161c75\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" Jun 05 15:57:48.243506 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:48.243479 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" Jun 05 15:57:48.403306 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:48.403276 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr"] Jun 05 15:57:48.404067 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:57:48.404042 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6552e640_6637_4f99_9873_6a8d78161c75.slice/crio-1bc5f701ddb67e8dc48f336a09b7ccba2842f8605bcf93ac0cc4d93f8ce503d8 WatchSource:0}: Error finding container 1bc5f701ddb67e8dc48f336a09b7ccba2842f8605bcf93ac0cc4d93f8ce503d8: Status 404 returned error can't find the container with id 1bc5f701ddb67e8dc48f336a09b7ccba2842f8605bcf93ac0cc4d93f8ce503d8 Jun 05 15:57:49.014122 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:49.014082 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" event={"ID":"6552e640-6637-4f99-9873-6a8d78161c75","Type":"ContainerStarted","Data":"1bc5f701ddb67e8dc48f336a09b7ccba2842f8605bcf93ac0cc4d93f8ce503d8"} Jun 05 15:57:53.041190 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:53.041159 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" event={"ID":"6552e640-6637-4f99-9873-6a8d78161c75","Type":"ContainerStarted","Data":"ed5db79b3681abe54ad31ed5b47f405d78f0247672f2645722038ded78537395"} Jun 05 15:57:53.041465 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:53.041242 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" Jun 05 15:57:53.060598 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:53.060556 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" podStartSLOduration=1.52004639 podStartE2EDuration="6.060542165s" totalImagesPullingTime="4.540495775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:57:53.057063661 +0000 UTC m=+1014.778637280" watchObservedRunningTime="2026-06-05 15:57:53.060542165 +0000 UTC m=+1014.782115770" Jun 05 15:57:53.503977 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:53.503945 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:53.610855 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:53.610824 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:58.305801 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:58.305769 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:57:58.405811 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:57:58.405778 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:00.756491 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:00.756458 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:00.855343 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:00.855312 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:03.950815 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:03.950784 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:04.050284 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:04.050258 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:04.053480 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:04.053460 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" Jun 05 15:58:06.512143 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:06.512105 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:06.569160 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:06.569112 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:08.141678 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:08.141652 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:14.313729 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:14.313697 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:14.413884 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:14.413854 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:14.935696 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:14.935667 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:15.036198 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:15.036175 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:18.720402 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:18.720374 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:18.819595 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:18.819571 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:21.164326 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:21.164292 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:21.211892 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:21.211868 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:22.106231 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:22.106202 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:23.676253 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:23.676223 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:23.782138 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:23.782093 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:23.882255 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:23.882226 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:24.549066 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:24.549038 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:24.649858 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:24.649829 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:39.879079 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:39.879044 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:47.093572 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:47.093542 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:47.146470 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:47.146434 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:49.768647 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:49.768563 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:49.866099 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:49.866065 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:49.998414 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:49.998385 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:58:50.796921 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.796886 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx"] Jun 05 15:58:50.799850 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.799831 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" Jun 05 15:58:50.802096 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.802073 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 15:58:50.802914 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.802898 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mf7mb\"" Jun 05 15:58:50.802981 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.802915 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 15:58:50.807807 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.807772 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx"] Jun 05 15:58:50.875811 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.875773 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a796bae4-57b0-437e-b9c5-762ad02b12cf-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx\" (UID: \"a796bae4-57b0-437e-b9c5-762ad02b12cf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" Jun 05 15:58:50.875987 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.875877 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9n9v\" (UniqueName: \"kubernetes.io/projected/a796bae4-57b0-437e-b9c5-762ad02b12cf-kube-api-access-b9n9v\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx\" (UID: \"a796bae4-57b0-437e-b9c5-762ad02b12cf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" Jun 05 15:58:50.875987 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.875921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a796bae4-57b0-437e-b9c5-762ad02b12cf-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx\" (UID: \"a796bae4-57b0-437e-b9c5-762ad02b12cf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" Jun 05 15:58:50.976831 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.976789 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a796bae4-57b0-437e-b9c5-762ad02b12cf-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx\" (UID: \"a796bae4-57b0-437e-b9c5-762ad02b12cf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" Jun 05 15:58:50.977004 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.976915 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9n9v\" (UniqueName: \"kubernetes.io/projected/a796bae4-57b0-437e-b9c5-762ad02b12cf-kube-api-access-b9n9v\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx\" (UID: \"a796bae4-57b0-437e-b9c5-762ad02b12cf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" Jun 05 15:58:50.977004 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.976949 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a796bae4-57b0-437e-b9c5-762ad02b12cf-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx\" (UID: \"a796bae4-57b0-437e-b9c5-762ad02b12cf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" Jun 05 15:58:50.977309 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.977288 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a796bae4-57b0-437e-b9c5-762ad02b12cf-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx\" (UID: \"a796bae4-57b0-437e-b9c5-762ad02b12cf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" Jun 05 15:58:50.977346 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.977288 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a796bae4-57b0-437e-b9c5-762ad02b12cf-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx\" (UID: \"a796bae4-57b0-437e-b9c5-762ad02b12cf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" Jun 05 15:58:50.984689 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:50.984666 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9n9v\" (UniqueName: \"kubernetes.io/projected/a796bae4-57b0-437e-b9c5-762ad02b12cf-kube-api-access-b9n9v\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx\" (UID: \"a796bae4-57b0-437e-b9c5-762ad02b12cf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" Jun 05 15:58:51.110862 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:51.110781 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" Jun 05 15:58:51.245169 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:51.245138 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx"] Jun 05 15:58:51.246036 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:58:51.246013 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda796bae4_57b0_437e_b9c5_762ad02b12cf.slice/crio-1dc0bc9a763c59c612ecb7e3a68ce2bcee1366d1f2c2103a5c9c1d1a2699301c WatchSource:0}: Error finding container 1dc0bc9a763c59c612ecb7e3a68ce2bcee1366d1f2c2103a5c9c1d1a2699301c: Status 404 returned error can't find the container with id 1dc0bc9a763c59c612ecb7e3a68ce2bcee1366d1f2c2103a5c9c1d1a2699301c Jun 05 15:58:51.388698 ip-10-0-135-97 kubenswrapper[2566]: E0605 15:58:51.388614 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda796bae4_57b0_437e_b9c5_762ad02b12cf.slice/crio-conmon-d45ab7cae18fe0418347c12f470b397b30d786df0931a2dbde61c1e62c433cf2.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda796bae4_57b0_437e_b9c5_762ad02b12cf.slice/crio-d45ab7cae18fe0418347c12f470b397b30d786df0931a2dbde61c1e62c433cf2.scope\": RecentStats: unable to find data in memory cache]" Jun 05 15:58:51.393607 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:51.393583 2566 generic.go:356] "Generic (PLEG): container finished" podID="a796bae4-57b0-437e-b9c5-762ad02b12cf" containerID="d45ab7cae18fe0418347c12f470b397b30d786df0931a2dbde61c1e62c433cf2" exitCode=0 Jun 05 15:58:51.393747 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:51.393647 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" event={"ID":"a796bae4-57b0-437e-b9c5-762ad02b12cf","Type":"ContainerDied","Data":"d45ab7cae18fe0418347c12f470b397b30d786df0931a2dbde61c1e62c433cf2"} Jun 05 15:58:51.393747 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:51.393680 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" event={"ID":"a796bae4-57b0-437e-b9c5-762ad02b12cf","Type":"ContainerStarted","Data":"1dc0bc9a763c59c612ecb7e3a68ce2bcee1366d1f2c2103a5c9c1d1a2699301c"} Jun 05 15:58:52.402013 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:52.401924 2566 generic.go:356] "Generic (PLEG): container finished" podID="a796bae4-57b0-437e-b9c5-762ad02b12cf" containerID="7b2a75bef1371b5e90ba12fdff5d25134a17db49ec4d997f0b2c4aba175b1711" exitCode=0 Jun 05 15:58:52.402013 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:52.401973 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" event={"ID":"a796bae4-57b0-437e-b9c5-762ad02b12cf","Type":"ContainerDied","Data":"7b2a75bef1371b5e90ba12fdff5d25134a17db49ec4d997f0b2c4aba175b1711"} Jun 05 15:58:53.410035 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:53.410006 2566 generic.go:356] "Generic (PLEG): container finished" podID="a796bae4-57b0-437e-b9c5-762ad02b12cf" containerID="4367efe3e8f590391ea62776d7e31c42ba4b139f47d423f248afe19c6b0101df" exitCode=0 Jun 05 15:58:53.410479 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:53.410086 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" event={"ID":"a796bae4-57b0-437e-b9c5-762ad02b12cf","Type":"ContainerDied","Data":"4367efe3e8f590391ea62776d7e31c42ba4b139f47d423f248afe19c6b0101df"} Jun 05 15:58:54.550708 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:54.550672 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" Jun 05 15:58:54.603060 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:54.603022 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9n9v\" (UniqueName: \"kubernetes.io/projected/a796bae4-57b0-437e-b9c5-762ad02b12cf-kube-api-access-b9n9v\") pod \"a796bae4-57b0-437e-b9c5-762ad02b12cf\" (UID: \"a796bae4-57b0-437e-b9c5-762ad02b12cf\") " Jun 05 15:58:54.603265 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:54.603074 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a796bae4-57b0-437e-b9c5-762ad02b12cf-bundle\") pod \"a796bae4-57b0-437e-b9c5-762ad02b12cf\" (UID: \"a796bae4-57b0-437e-b9c5-762ad02b12cf\") " Jun 05 15:58:54.603265 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:54.603097 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a796bae4-57b0-437e-b9c5-762ad02b12cf-util\") pod \"a796bae4-57b0-437e-b9c5-762ad02b12cf\" (UID: \"a796bae4-57b0-437e-b9c5-762ad02b12cf\") " Jun 05 15:58:54.603525 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:54.603498 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a796bae4-57b0-437e-b9c5-762ad02b12cf-bundle" (OuterVolumeSpecName: "bundle") pod "a796bae4-57b0-437e-b9c5-762ad02b12cf" (UID: "a796bae4-57b0-437e-b9c5-762ad02b12cf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:58:54.605101 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:54.605080 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a796bae4-57b0-437e-b9c5-762ad02b12cf-kube-api-access-b9n9v" (OuterVolumeSpecName: "kube-api-access-b9n9v") pod "a796bae4-57b0-437e-b9c5-762ad02b12cf" (UID: "a796bae4-57b0-437e-b9c5-762ad02b12cf"). InnerVolumeSpecName "kube-api-access-b9n9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:58:54.608443 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:54.608410 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a796bae4-57b0-437e-b9c5-762ad02b12cf-util" (OuterVolumeSpecName: "util") pod "a796bae4-57b0-437e-b9c5-762ad02b12cf" (UID: "a796bae4-57b0-437e-b9c5-762ad02b12cf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:58:54.704448 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:54.704360 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9n9v\" (UniqueName: \"kubernetes.io/projected/a796bae4-57b0-437e-b9c5-762ad02b12cf-kube-api-access-b9n9v\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:58:54.704448 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:54.704385 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a796bae4-57b0-437e-b9c5-762ad02b12cf-bundle\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:58:54.704448 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:54.704394 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a796bae4-57b0-437e-b9c5-762ad02b12cf-util\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 15:58:55.423971 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:55.423938 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" event={"ID":"a796bae4-57b0-437e-b9c5-762ad02b12cf","Type":"ContainerDied","Data":"1dc0bc9a763c59c612ecb7e3a68ce2bcee1366d1f2c2103a5c9c1d1a2699301c"} Jun 05 15:58:55.423971 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:55.423969 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70b5wpx" Jun 05 15:58:55.424207 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:58:55.423984 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1dc0bc9a763c59c612ecb7e3a68ce2bcee1366d1f2c2103a5c9c1d1a2699301c" Jun 05 15:59:12.808946 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:12.808905 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:59:12.864088 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:12.864042 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:59:13.203201 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.203090 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 15:59:13.203552 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.203538 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a796bae4-57b0-437e-b9c5-762ad02b12cf" containerName="pull" Jun 05 15:59:13.203594 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.203554 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a796bae4-57b0-437e-b9c5-762ad02b12cf" containerName="pull" Jun 05 15:59:13.203594 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.203562 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a796bae4-57b0-437e-b9c5-762ad02b12cf" containerName="extract" Jun 05 15:59:13.203594 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.203567 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a796bae4-57b0-437e-b9c5-762ad02b12cf" containerName="extract" Jun 05 15:59:13.203594 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.203584 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a796bae4-57b0-437e-b9c5-762ad02b12cf" containerName="util" Jun 05 15:59:13.203594 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.203590 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a796bae4-57b0-437e-b9c5-762ad02b12cf" containerName="util" Jun 05 15:59:13.203748 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.203665 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a796bae4-57b0-437e-b9c5-762ad02b12cf" containerName="extract" Jun 05 15:59:13.208236 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.208216 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 15:59:13.210670 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.210639 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 15:59:13.210798 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.210681 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-w7cxd\"" Jun 05 15:59:13.211827 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.211656 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 15:59:13.211827 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.211769 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 15:59:13.215395 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.215373 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 15:59:13.248370 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.248340 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7vrn\" (UniqueName: \"kubernetes.io/projected/17955987-bffe-466b-bb08-e58df230ee29-kube-api-access-x7vrn\") pod \"maas-keycloak-0\" (UID: \"17955987-bffe-466b-bb08-e58df230ee29\") " pod="keycloak-system/maas-keycloak-0" Jun 05 15:59:13.349371 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.349338 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7vrn\" (UniqueName: \"kubernetes.io/projected/17955987-bffe-466b-bb08-e58df230ee29-kube-api-access-x7vrn\") pod \"maas-keycloak-0\" (UID: \"17955987-bffe-466b-bb08-e58df230ee29\") " pod="keycloak-system/maas-keycloak-0" Jun 05 15:59:13.357138 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.357095 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7vrn\" (UniqueName: \"kubernetes.io/projected/17955987-bffe-466b-bb08-e58df230ee29-kube-api-access-x7vrn\") pod \"maas-keycloak-0\" (UID: \"17955987-bffe-466b-bb08-e58df230ee29\") " pod="keycloak-system/maas-keycloak-0" Jun 05 15:59:13.519260 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.519225 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 15:59:13.665992 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:13.665957 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 15:59:13.666361 ip-10-0-135-97 kubenswrapper[2566]: W0605 15:59:13.666330 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17955987_bffe_466b_bb08_e58df230ee29.slice/crio-1940a3dc0962db4d0c11ab66d4cf803fe8aa8fc018ccd4b11c50ea3aa6eb0c9c WatchSource:0}: Error finding container 1940a3dc0962db4d0c11ab66d4cf803fe8aa8fc018ccd4b11c50ea3aa6eb0c9c: Status 404 returned error can't find the container with id 1940a3dc0962db4d0c11ab66d4cf803fe8aa8fc018ccd4b11c50ea3aa6eb0c9c Jun 05 15:59:14.536428 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:14.536390 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"17955987-bffe-466b-bb08-e58df230ee29","Type":"ContainerStarted","Data":"1940a3dc0962db4d0c11ab66d4cf803fe8aa8fc018ccd4b11c50ea3aa6eb0c9c"} Jun 05 15:59:18.571249 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:18.571210 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"17955987-bffe-466b-bb08-e58df230ee29","Type":"ContainerStarted","Data":"3476cb0b915333f01bd95420b3af02c4bb5e251aa6e478b85c18daee9d101386"} Jun 05 15:59:19.519958 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:19.519900 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 15:59:19.522002 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:19.521958 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.52:9000/health/started\": dial tcp 10.133.0.52:9000: connect: connection refused" Jun 05 15:59:20.520723 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:20.520673 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.52:9000/health/started\": dial tcp 10.133.0.52:9000: connect: connection refused" Jun 05 15:59:21.520194 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:21.520141 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.52:9000/health/started\": dial tcp 10.133.0.52:9000: connect: connection refused" Jun 05 15:59:22.519962 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:22.519920 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.52:9000/health/started\": dial tcp 10.133.0.52:9000: connect: connection refused" Jun 05 15:59:23.520265 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:23.520215 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 15:59:23.521150 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:23.521081 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.52:9000/health/started\": dial tcp 10.133.0.52:9000: connect: connection refused" Jun 05 15:59:24.520490 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:24.520436 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.52:9000/health/started\": dial tcp 10.133.0.52:9000: connect: connection refused" Jun 05 15:59:25.520256 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:25.520204 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.52:9000/health/started\": dial tcp 10.133.0.52:9000: connect: connection refused" Jun 05 15:59:26.520249 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:26.520201 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.52:9000/health/started\": dial tcp 10.133.0.52:9000: connect: connection refused" Jun 05 15:59:27.520353 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:27.520298 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.52:9000/health/started\": dial tcp 10.133.0.52:9000: connect: connection refused" Jun 05 15:59:28.519671 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:28.519624 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.52:9000/health/started\": dial tcp 10.133.0.52:9000: connect: connection refused" Jun 05 15:59:29.520091 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:29.520036 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.52:9000/health/started\": dial tcp 10.133.0.52:9000: connect: connection refused" Jun 05 15:59:30.609027 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:30.608987 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 15:59:30.622866 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:30.622815 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:59:30.628254 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:30.628202 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=13.467679666 podStartE2EDuration="17.628186422s" totalImagesPullingTime="4.160506756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:59:18.58924147 +0000 UTC m=+1100.310815076" watchObservedRunningTime="2026-06-05 15:59:30.628186422 +0000 UTC m=+1112.349760028" Jun 05 15:59:40.614674 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:40.614632 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 15:59:41.221685 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:41.221654 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:59:41.462285 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:41.462253 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:59:49.279382 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:49.279337 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 15:59:49.379419 ip-10-0-135-97 kubenswrapper[2566]: I0605 15:59:49.379385 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:00:18.938121 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:18.938043 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:00:19.299258 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.299228 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:00:19.402295 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.402267 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:00:19.490803 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.490769 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:00:19.492939 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.492918 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-kntfn"] Jun 05 16:00:19.495581 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.495566 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-kntfn" Jun 05 16:00:19.497865 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.497837 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 05 16:00:19.498028 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.497905 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-p8wgd\"" Jun 05 16:00:19.504940 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.504918 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-kntfn"] Jun 05 16:00:19.532916 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.532895 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-nbdm7"] Jun 05 16:00:19.535160 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.535147 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-nbdm7" Jun 05 16:00:19.546633 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.546610 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-nbdm7"] Jun 05 16:00:19.669843 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.669764 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t6vj\" (UniqueName: \"kubernetes.io/projected/8f2bfb6c-e16c-4bf5-92fb-36ac2e928e61-kube-api-access-7t6vj\") pod \"payload-processing-7c6c859784-nbdm7\" (UID: \"8f2bfb6c-e16c-4bf5-92fb-36ac2e928e61\") " pod="openshift-ingress/payload-processing-7c6c859784-nbdm7" Jun 05 16:00:19.669981 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.669850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k68sk\" (UniqueName: \"kubernetes.io/projected/a6c3fa67-04d6-4689-a1a9-dce9c441693f-kube-api-access-k68sk\") pod \"payload-pre-processing-67d7689b65-kntfn\" (UID: \"a6c3fa67-04d6-4689-a1a9-dce9c441693f\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-kntfn" Jun 05 16:00:19.771327 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.771295 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k68sk\" (UniqueName: \"kubernetes.io/projected/a6c3fa67-04d6-4689-a1a9-dce9c441693f-kube-api-access-k68sk\") pod \"payload-pre-processing-67d7689b65-kntfn\" (UID: \"a6c3fa67-04d6-4689-a1a9-dce9c441693f\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-kntfn" Jun 05 16:00:19.771498 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.771362 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t6vj\" (UniqueName: \"kubernetes.io/projected/8f2bfb6c-e16c-4bf5-92fb-36ac2e928e61-kube-api-access-7t6vj\") pod \"payload-processing-7c6c859784-nbdm7\" (UID: \"8f2bfb6c-e16c-4bf5-92fb-36ac2e928e61\") " pod="openshift-ingress/payload-processing-7c6c859784-nbdm7" Jun 05 16:00:19.781174 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.781150 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k68sk\" (UniqueName: \"kubernetes.io/projected/a6c3fa67-04d6-4689-a1a9-dce9c441693f-kube-api-access-k68sk\") pod \"payload-pre-processing-67d7689b65-kntfn\" (UID: \"a6c3fa67-04d6-4689-a1a9-dce9c441693f\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-kntfn" Jun 05 16:00:19.781326 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.781308 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t6vj\" (UniqueName: \"kubernetes.io/projected/8f2bfb6c-e16c-4bf5-92fb-36ac2e928e61-kube-api-access-7t6vj\") pod \"payload-processing-7c6c859784-nbdm7\" (UID: \"8f2bfb6c-e16c-4bf5-92fb-36ac2e928e61\") " pod="openshift-ingress/payload-processing-7c6c859784-nbdm7" Jun 05 16:00:19.806895 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.806872 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-kntfn" Jun 05 16:00:19.845892 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.845857 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-nbdm7" Jun 05 16:00:19.957650 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.957618 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-kntfn"] Jun 05 16:00:19.966431 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.966406 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 16:00:19.976684 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.976660 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-kntfn" event={"ID":"a6c3fa67-04d6-4689-a1a9-dce9c441693f","Type":"ContainerStarted","Data":"07cbd1ece6828d0ee58773d383ce1e9edd0104830888af7f57cfdea18e9e3f3a"} Jun 05 16:00:19.989702 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:19.989677 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-nbdm7"] Jun 05 16:00:19.991025 ip-10-0-135-97 kubenswrapper[2566]: W0605 16:00:19.991001 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2bfb6c_e16c_4bf5_92fb_36ac2e928e61.slice/crio-12ebf7f9d666333b9268b21cca530b85b9492100e2624f82e4f4eddcedbd375a WatchSource:0}: Error finding container 12ebf7f9d666333b9268b21cca530b85b9492100e2624f82e4f4eddcedbd375a: Status 404 returned error can't find the container with id 12ebf7f9d666333b9268b21cca530b85b9492100e2624f82e4f4eddcedbd375a Jun 05 16:00:20.989883 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:20.989844 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-nbdm7" event={"ID":"8f2bfb6c-e16c-4bf5-92fb-36ac2e928e61","Type":"ContainerStarted","Data":"12ebf7f9d666333b9268b21cca530b85b9492100e2624f82e4f4eddcedbd375a"} Jun 05 16:00:23.004183 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:23.004151 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-kntfn" event={"ID":"a6c3fa67-04d6-4689-a1a9-dce9c441693f","Type":"ContainerStarted","Data":"9d072295b4dc14c1de5b2ae41775ce21849517bd32c9b56d7a608c125ad31d70"} Jun 05 16:00:23.004575 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:23.004213 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-kntfn" Jun 05 16:00:23.005741 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:23.005714 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-nbdm7" event={"ID":"8f2bfb6c-e16c-4bf5-92fb-36ac2e928e61","Type":"ContainerStarted","Data":"32062bbb134a6bb9eca5d487330ca72bc0efbd6348f9c5f4adb98fbf85894907"} Jun 05 16:00:23.005838 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:23.005772 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-nbdm7" Jun 05 16:00:23.019407 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:23.019368 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-kntfn" podStartSLOduration=1.665785796 podStartE2EDuration="4.01935557s" totalImagesPullingTime="2.353569774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 16:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 16:00:23.017744884 +0000 UTC m=+1164.739318491" watchObservedRunningTime="2026-06-05 16:00:23.01935557 +0000 UTC m=+1164.740929176" Jun 05 16:00:23.037572 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:23.037536 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-nbdm7" podStartSLOduration=1.715445498 podStartE2EDuration="4.037525688s" totalImagesPullingTime="2.32208019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 16:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 16:00:23.03516246 +0000 UTC m=+1164.756736083" watchObservedRunningTime="2026-06-05 16:00:23.037525688 +0000 UTC m=+1164.759099295" Jun 05 16:00:23.071650 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:23.071630 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:00:23.129465 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:23.129445 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:00:30.631266 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:30.631232 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 16:00:30.631621 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:30.631478 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" containerID="cri-o://3476cb0b915333f01bd95420b3af02c4bb5e251aa6e478b85c18daee9d101386" gracePeriod=30 Jun 05 16:00:32.067073 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:32.067039 2566 generic.go:356] "Generic (PLEG): container finished" podID="17955987-bffe-466b-bb08-e58df230ee29" containerID="3476cb0b915333f01bd95420b3af02c4bb5e251aa6e478b85c18daee9d101386" exitCode=143 Jun 05 16:00:32.067374 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:32.067109 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"17955987-bffe-466b-bb08-e58df230ee29","Type":"ContainerDied","Data":"3476cb0b915333f01bd95420b3af02c4bb5e251aa6e478b85c18daee9d101386"} Jun 05 16:00:32.177814 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:32.177792 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 16:00:32.273064 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:32.273033 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7vrn\" (UniqueName: \"kubernetes.io/projected/17955987-bffe-466b-bb08-e58df230ee29-kube-api-access-x7vrn\") pod \"17955987-bffe-466b-bb08-e58df230ee29\" (UID: \"17955987-bffe-466b-bb08-e58df230ee29\") " Jun 05 16:00:32.275094 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:32.275072 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17955987-bffe-466b-bb08-e58df230ee29-kube-api-access-x7vrn" (OuterVolumeSpecName: "kube-api-access-x7vrn") pod "17955987-bffe-466b-bb08-e58df230ee29" (UID: "17955987-bffe-466b-bb08-e58df230ee29"). InnerVolumeSpecName "kube-api-access-x7vrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 16:00:32.374351 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:32.374326 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7vrn\" (UniqueName: \"kubernetes.io/projected/17955987-bffe-466b-bb08-e58df230ee29-kube-api-access-x7vrn\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 16:00:33.074090 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.074062 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 16:00:33.074455 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.074103 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"17955987-bffe-466b-bb08-e58df230ee29","Type":"ContainerDied","Data":"1940a3dc0962db4d0c11ab66d4cf803fe8aa8fc018ccd4b11c50ea3aa6eb0c9c"} Jun 05 16:00:33.074455 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.074174 2566 scope.go:117] "RemoveContainer" containerID="3476cb0b915333f01bd95420b3af02c4bb5e251aa6e478b85c18daee9d101386" Jun 05 16:00:33.092567 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.092547 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 16:00:33.095856 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.095835 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 16:00:33.116576 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.116546 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 16:00:33.117025 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.117006 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" Jun 05 16:00:33.117101 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.117026 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" Jun 05 16:00:33.117179 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.117141 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="17955987-bffe-466b-bb08-e58df230ee29" containerName="keycloak" Jun 05 16:00:33.119690 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.119674 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 16:00:33.122057 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.121888 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 16:00:33.122057 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.121948 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 16:00:33.122057 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.121981 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 16:00:33.122338 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.122158 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 05 16:00:33.122338 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.122190 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-w7cxd\"" Jun 05 16:00:33.131456 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.131438 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 16:00:33.179293 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.179270 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqrkg\" (UniqueName: \"kubernetes.io/projected/4f372605-0ec0-43cb-b4da-dc9754e6c45f-kube-api-access-wqrkg\") pod \"maas-keycloak-0\" (UID: \"4f372605-0ec0-43cb-b4da-dc9754e6c45f\") " pod="keycloak-system/maas-keycloak-0" Jun 05 16:00:33.179397 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.179317 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4f372605-0ec0-43cb-b4da-dc9754e6c45f-test-realms\") pod \"maas-keycloak-0\" (UID: \"4f372605-0ec0-43cb-b4da-dc9754e6c45f\") " pod="keycloak-system/maas-keycloak-0" Jun 05 16:00:33.280014 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.279986 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqrkg\" (UniqueName: \"kubernetes.io/projected/4f372605-0ec0-43cb-b4da-dc9754e6c45f-kube-api-access-wqrkg\") pod \"maas-keycloak-0\" (UID: \"4f372605-0ec0-43cb-b4da-dc9754e6c45f\") " pod="keycloak-system/maas-keycloak-0" Jun 05 16:00:33.280102 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.280022 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4f372605-0ec0-43cb-b4da-dc9754e6c45f-test-realms\") pod \"maas-keycloak-0\" (UID: \"4f372605-0ec0-43cb-b4da-dc9754e6c45f\") " pod="keycloak-system/maas-keycloak-0" Jun 05 16:00:33.280621 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.280606 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4f372605-0ec0-43cb-b4da-dc9754e6c45f-test-realms\") pod \"maas-keycloak-0\" (UID: \"4f372605-0ec0-43cb-b4da-dc9754e6c45f\") " pod="keycloak-system/maas-keycloak-0" Jun 05 16:00:33.288201 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.288185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqrkg\" (UniqueName: \"kubernetes.io/projected/4f372605-0ec0-43cb-b4da-dc9754e6c45f-kube-api-access-wqrkg\") pod \"maas-keycloak-0\" (UID: \"4f372605-0ec0-43cb-b4da-dc9754e6c45f\") " pod="keycloak-system/maas-keycloak-0" Jun 05 16:00:33.429391 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.429341 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 16:00:33.560180 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:33.560154 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 16:00:33.561250 ip-10-0-135-97 kubenswrapper[2566]: W0605 16:00:33.561182 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f372605_0ec0_43cb_b4da_dc9754e6c45f.slice/crio-dfc9c447f396400318146208e1bbb6d4616ca7f247e54c0de3236f8b0893e424 WatchSource:0}: Error finding container dfc9c447f396400318146208e1bbb6d4616ca7f247e54c0de3236f8b0893e424: Status 404 returned error can't find the container with id dfc9c447f396400318146208e1bbb6d4616ca7f247e54c0de3236f8b0893e424 Jun 05 16:00:34.013573 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:34.013554 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-nbdm7" Jun 05 16:00:34.013701 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:34.013612 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-kntfn" Jun 05 16:00:34.085413 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:34.085382 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4f372605-0ec0-43cb-b4da-dc9754e6c45f","Type":"ContainerStarted","Data":"bd138d04bb27b2461e5c476d8d96fc59310022e2f4126d74251c62699e6c988f"} Jun 05 16:00:34.085856 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:34.085433 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4f372605-0ec0-43cb-b4da-dc9754e6c45f","Type":"ContainerStarted","Data":"dfc9c447f396400318146208e1bbb6d4616ca7f247e54c0de3236f8b0893e424"} Jun 05 16:00:34.109446 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:34.108598 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.781125843 podStartE2EDuration="1.108578698s" totalImagesPullingTime="327.452855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 16:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 16:00:34.107823746 +0000 UTC m=+1175.829397366" watchObservedRunningTime="2026-06-05 16:00:34.108578698 +0000 UTC m=+1175.830152309" Jun 05 16:00:34.430180 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:34.430137 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 16:00:34.431679 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:34.431649 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 16:00:34.704550 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:34.704463 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17955987-bffe-466b-bb08-e58df230ee29" path="/var/lib/kubelet/pods/17955987-bffe-466b-bb08-e58df230ee29/volumes" Jun 05 16:00:35.430243 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:35.430190 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 16:00:36.430204 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:36.430157 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 16:00:37.430378 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:37.430329 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 16:00:38.430088 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:38.430038 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 16:00:39.430393 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:39.430340 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 16:00:40.430215 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:40.430167 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 16:00:41.430760 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:41.430691 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 16:00:42.430529 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:42.430462 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 16:00:43.430303 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:43.430266 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 16:00:43.430920 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:43.430876 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 16:00:44.430592 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:44.430546 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 16:00:45.429866 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:45.429816 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 16:00:46.430432 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:46.430391 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.55:9000/health/started\": dial tcp 10.133.0.55:9000: connect: connection refused" Jun 05 16:00:47.554068 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:47.554032 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 16:00:47.572390 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:47.572330 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4f372605-0ec0-43cb-b4da-dc9754e6c45f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 16:00:48.110998 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:48.110932 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:00:48.212053 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:48.212014 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:00:57.561122 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:00:57.561094 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 16:01:00.053333 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:00.053215 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 16:01:00.059462 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:00.056012 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 16:01:10.498281 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:10.498247 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:01:11.909295 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:11.909263 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:01:17.028001 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:17.027964 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:01:35.725039 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:35.725010 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:01:42.633949 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:42.633913 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:01:47.302707 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.302662 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx"] Jun 05 16:01:47.306345 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.306330 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.308649 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.308627 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 16:01:47.309528 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.309511 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 16:01:47.309626 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.309515 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 05 16:01:47.309626 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.309592 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vtjxn\"" Jun 05 16:01:47.315889 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.315861 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx"] Jun 05 16:01:47.321006 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.320950 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:01:47.449476 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.449445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5855487-3490-4f94-878e-a7ec17d45789-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.449622 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.449528 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5855487-3490-4f94-878e-a7ec17d45789-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.449622 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.449564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5855487-3490-4f94-878e-a7ec17d45789-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.449747 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.449617 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b5855487-3490-4f94-878e-a7ec17d45789-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.449747 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.449676 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5855487-3490-4f94-878e-a7ec17d45789-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.449747 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.449725 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls6hk\" (UniqueName: \"kubernetes.io/projected/b5855487-3490-4f94-878e-a7ec17d45789-kube-api-access-ls6hk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.550939 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.550909 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b5855487-3490-4f94-878e-a7ec17d45789-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.551086 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.550952 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5855487-3490-4f94-878e-a7ec17d45789-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.551193 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.551080 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls6hk\" (UniqueName: \"kubernetes.io/projected/b5855487-3490-4f94-878e-a7ec17d45789-kube-api-access-ls6hk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.551193 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.551163 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5855487-3490-4f94-878e-a7ec17d45789-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.551316 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.551237 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5855487-3490-4f94-878e-a7ec17d45789-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.551316 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.551266 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5855487-3490-4f94-878e-a7ec17d45789-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.551423 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.551327 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5855487-3490-4f94-878e-a7ec17d45789-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.551423 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.551379 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b5855487-3490-4f94-878e-a7ec17d45789-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.551527 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.551508 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5855487-3490-4f94-878e-a7ec17d45789-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.553781 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.553716 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5855487-3490-4f94-878e-a7ec17d45789-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.554010 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.553988 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5855487-3490-4f94-878e-a7ec17d45789-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.566698 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.566117 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls6hk\" (UniqueName: \"kubernetes.io/projected/b5855487-3490-4f94-878e-a7ec17d45789-kube-api-access-ls6hk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx\" (UID: \"b5855487-3490-4f94-878e-a7ec17d45789\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.617891 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.617852 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:01:47.754647 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:47.754619 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx"] Jun 05 16:01:47.755643 ip-10-0-135-97 kubenswrapper[2566]: W0605 16:01:47.755620 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5855487_3490_4f94_878e_a7ec17d45789.slice/crio-210b3d87cfc24f626961bf6e100c5118c288989610677811c5e18cf04952d76b WatchSource:0}: Error finding container 210b3d87cfc24f626961bf6e100c5118c288989610677811c5e18cf04952d76b: Status 404 returned error can't find the container with id 210b3d87cfc24f626961bf6e100c5118c288989610677811c5e18cf04952d76b Jun 05 16:01:48.608185 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:48.608062 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" event={"ID":"b5855487-3490-4f94-878e-a7ec17d45789","Type":"ContainerStarted","Data":"210b3d87cfc24f626961bf6e100c5118c288989610677811c5e18cf04952d76b"} Jun 05 16:01:51.628746 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:01:51.628710 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" event={"ID":"b5855487-3490-4f94-878e-a7ec17d45789","Type":"ContainerStarted","Data":"76f1bae2c531950b83da84264056d1feaf40679822a80e10a3e96fbe2d567cdd"} Jun 05 16:02:12.604561 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.604525 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5"] Jun 05 16:02:12.608489 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.608467 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.610797 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.610778 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 05 16:02:12.617892 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.617866 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5"] Jun 05 16:02:12.628829 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.628800 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:02:12.661560 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.661538 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfa73879-7d38-44ef-a017-bfdfc924203d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.661659 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.661568 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfa73879-7d38-44ef-a017-bfdfc924203d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.661659 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.661587 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfa73879-7d38-44ef-a017-bfdfc924203d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.661659 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.661610 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfa73879-7d38-44ef-a017-bfdfc924203d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.661765 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.661668 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2zxn\" (UniqueName: \"kubernetes.io/projected/dfa73879-7d38-44ef-a017-bfdfc924203d-kube-api-access-g2zxn\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.661765 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.661716 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dfa73879-7d38-44ef-a017-bfdfc924203d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.762643 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.762620 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfa73879-7d38-44ef-a017-bfdfc924203d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.762788 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.762648 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfa73879-7d38-44ef-a017-bfdfc924203d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.762788 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.762670 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfa73879-7d38-44ef-a017-bfdfc924203d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.762892 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.762812 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfa73879-7d38-44ef-a017-bfdfc924203d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.762949 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.762897 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2zxn\" (UniqueName: \"kubernetes.io/projected/dfa73879-7d38-44ef-a017-bfdfc924203d-kube-api-access-g2zxn\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.763004 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.762975 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dfa73879-7d38-44ef-a017-bfdfc924203d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.763058 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.763009 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfa73879-7d38-44ef-a017-bfdfc924203d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.763153 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.763107 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfa73879-7d38-44ef-a017-bfdfc924203d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.763312 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.763284 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dfa73879-7d38-44ef-a017-bfdfc924203d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.765008 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.764980 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfa73879-7d38-44ef-a017-bfdfc924203d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.765299 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.765270 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfa73879-7d38-44ef-a017-bfdfc924203d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.770317 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.770296 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2zxn\" (UniqueName: \"kubernetes.io/projected/dfa73879-7d38-44ef-a017-bfdfc924203d-kube-api-access-g2zxn\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5\" (UID: \"dfa73879-7d38-44ef-a017-bfdfc924203d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:12.924442 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:12.924382 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:13.055904 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:13.055877 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5"] Jun 05 16:02:13.057141 ip-10-0-135-97 kubenswrapper[2566]: W0605 16:02:13.057098 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa73879_7d38_44ef_a017_bfdfc924203d.slice/crio-591edf521599b97c10541f21df0a4864b1dbd18e173e76bd1ac1c2ed9092e2bc WatchSource:0}: Error finding container 591edf521599b97c10541f21df0a4864b1dbd18e173e76bd1ac1c2ed9092e2bc: Status 404 returned error can't find the container with id 591edf521599b97c10541f21df0a4864b1dbd18e173e76bd1ac1c2ed9092e2bc Jun 05 16:02:13.775326 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:13.775289 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" event={"ID":"dfa73879-7d38-44ef-a017-bfdfc924203d","Type":"ContainerStarted","Data":"92a55842490bc30e38690a5d59c66cae38c250e70b7f4b88c9fad6473deb3504"} Jun 05 16:02:13.775677 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:13.775354 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" event={"ID":"dfa73879-7d38-44ef-a017-bfdfc924203d","Type":"ContainerStarted","Data":"591edf521599b97c10541f21df0a4864b1dbd18e173e76bd1ac1c2ed9092e2bc"} Jun 05 16:02:14.782670 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:14.782642 2566 generic.go:356] "Generic (PLEG): container finished" podID="dfa73879-7d38-44ef-a017-bfdfc924203d" containerID="92a55842490bc30e38690a5d59c66cae38c250e70b7f4b88c9fad6473deb3504" exitCode=0 Jun 05 16:02:14.783067 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:14.782724 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" event={"ID":"dfa73879-7d38-44ef-a017-bfdfc924203d","Type":"ContainerDied","Data":"92a55842490bc30e38690a5d59c66cae38c250e70b7f4b88c9fad6473deb3504"} Jun 05 16:02:16.796713 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:16.796682 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" event={"ID":"dfa73879-7d38-44ef-a017-bfdfc924203d","Type":"ContainerStarted","Data":"54c075ded9314965e68ec2572f541033780d657d23bc82c982bf545bd27cbb09"} Jun 05 16:02:16.817037 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:16.816983 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" podStartSLOduration=2.406121669 podStartE2EDuration="4.816969253s" totalImagesPullingTime="1.064833534s" totalInitContainerRuntime="1.34601405s" isStatefulPod=false podCreationTimestamp="2026-06-05 16:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 16:02:16.814173699 +0000 UTC m=+1278.535747318" watchObservedRunningTime="2026-06-05 16:02:16.816969253 +0000 UTC m=+1278.538542859" Jun 05 16:02:22.925530 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:22.925497 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:22.925894 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:22.925549 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:22.938412 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:22.938379 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:23.847894 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:23.847863 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5" Jun 05 16:02:32.709855 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.709826 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx"] Jun 05 16:02:32.712497 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.712483 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.714975 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.714961 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 05 16:02:32.724106 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.724086 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx"] Jun 05 16:02:32.738953 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.738929 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:02:32.828345 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.828321 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c86042a7-f2ed-4c09-9a27-c016f509ba25-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.828478 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.828360 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c86042a7-f2ed-4c09-9a27-c016f509ba25-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.828478 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.828390 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vsbn\" (UniqueName: \"kubernetes.io/projected/c86042a7-f2ed-4c09-9a27-c016f509ba25-kube-api-access-8vsbn\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.828478 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.828476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c86042a7-f2ed-4c09-9a27-c016f509ba25-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.828581 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.828494 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c86042a7-f2ed-4c09-9a27-c016f509ba25-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.828581 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.828525 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c86042a7-f2ed-4c09-9a27-c016f509ba25-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.929524 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.929499 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c86042a7-f2ed-4c09-9a27-c016f509ba25-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.929683 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.929609 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c86042a7-f2ed-4c09-9a27-c016f509ba25-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.929683 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.929655 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c86042a7-f2ed-4c09-9a27-c016f509ba25-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.929797 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.929696 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vsbn\" (UniqueName: \"kubernetes.io/projected/c86042a7-f2ed-4c09-9a27-c016f509ba25-kube-api-access-8vsbn\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.929797 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.929725 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c86042a7-f2ed-4c09-9a27-c016f509ba25-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.929797 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.929754 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c86042a7-f2ed-4c09-9a27-c016f509ba25-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.930068 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.930043 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c86042a7-f2ed-4c09-9a27-c016f509ba25-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.930162 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.930099 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c86042a7-f2ed-4c09-9a27-c016f509ba25-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.930231 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.930179 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c86042a7-f2ed-4c09-9a27-c016f509ba25-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.931937 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.931908 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c86042a7-f2ed-4c09-9a27-c016f509ba25-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.932086 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.932073 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c86042a7-f2ed-4c09-9a27-c016f509ba25-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:32.937575 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:32.937552 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vsbn\" (UniqueName: \"kubernetes.io/projected/c86042a7-f2ed-4c09-9a27-c016f509ba25-kube-api-access-8vsbn\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bzbrx\" (UID: \"c86042a7-f2ed-4c09-9a27-c016f509ba25\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:33.022793 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:33.022770 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:33.160318 ip-10-0-135-97 kubenswrapper[2566]: W0605 16:02:33.160289 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86042a7_f2ed_4c09_9a27_c016f509ba25.slice/crio-d30c6167c46a887ebb1f97f307bc4fb3aac3b90ed83bc24f7c8a6ec2e8d14ac9 WatchSource:0}: Error finding container d30c6167c46a887ebb1f97f307bc4fb3aac3b90ed83bc24f7c8a6ec2e8d14ac9: Status 404 returned error can't find the container with id d30c6167c46a887ebb1f97f307bc4fb3aac3b90ed83bc24f7c8a6ec2e8d14ac9 Jun 05 16:02:33.160439 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:33.160312 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx"] Jun 05 16:02:33.899912 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:33.899872 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" event={"ID":"c86042a7-f2ed-4c09-9a27-c016f509ba25","Type":"ContainerStarted","Data":"4b26788beb3416b456a606d2a48a6abcef7a4b321d66c787adc8de420b53fa83"} Jun 05 16:02:33.899912 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:33.899918 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" event={"ID":"c86042a7-f2ed-4c09-9a27-c016f509ba25","Type":"ContainerStarted","Data":"d30c6167c46a887ebb1f97f307bc4fb3aac3b90ed83bc24f7c8a6ec2e8d14ac9"} Jun 05 16:02:34.907211 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:34.907177 2566 generic.go:356] "Generic (PLEG): container finished" podID="c86042a7-f2ed-4c09-9a27-c016f509ba25" containerID="4b26788beb3416b456a606d2a48a6abcef7a4b321d66c787adc8de420b53fa83" exitCode=0 Jun 05 16:02:34.907571 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:34.907253 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" event={"ID":"c86042a7-f2ed-4c09-9a27-c016f509ba25","Type":"ContainerDied","Data":"4b26788beb3416b456a606d2a48a6abcef7a4b321d66c787adc8de420b53fa83"} Jun 05 16:02:35.914987 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:35.914954 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" event={"ID":"c86042a7-f2ed-4c09-9a27-c016f509ba25","Type":"ContainerStarted","Data":"2c7d8c943e1ad078d7fd529e81ef7dde79efe0ef51c077daf12e9abbc154d35a"} Jun 05 16:02:35.932891 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:35.932847 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" podStartSLOduration=2.453060014 podStartE2EDuration="3.932831812s" totalImagesPullingTime="243.866775ms" totalInitContainerRuntime="1.235905023s" isStatefulPod=false podCreationTimestamp="2026-06-05 16:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 16:02:35.931613122 +0000 UTC m=+1297.653186753" watchObservedRunningTime="2026-06-05 16:02:35.932831812 +0000 UTC m=+1297.654405426" Jun 05 16:02:42.958830 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:42.958759 2566 generic.go:356] "Generic (PLEG): container finished" podID="b5855487-3490-4f94-878e-a7ec17d45789" containerID="76f1bae2c531950b83da84264056d1feaf40679822a80e10a3e96fbe2d567cdd" exitCode=0 Jun 05 16:02:42.959168 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:42.958833 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" event={"ID":"b5855487-3490-4f94-878e-a7ec17d45789","Type":"ContainerDied","Data":"76f1bae2c531950b83da84264056d1feaf40679822a80e10a3e96fbe2d567cdd"} Jun 05 16:02:43.023519 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:43.023495 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:43.023614 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:43.023536 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:43.035726 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:43.035701 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:43.976088 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:43.976054 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bzbrx" Jun 05 16:02:44.972531 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:44.972497 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" event={"ID":"b5855487-3490-4f94-878e-a7ec17d45789","Type":"ContainerStarted","Data":"a1c0b8c62072303f360270dc858e832d7258c2fdf7f6702025e1a9cdd82b9bd6"} Jun 05 16:02:44.992627 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:44.992583 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" podStartSLOduration=2.011400876 podStartE2EDuration="57.99256971s" totalImagesPullingTime="4.466941728s" totalInitContainerRuntime="51.514227106s" isStatefulPod=false podCreationTimestamp="2026-06-05 16:01:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 16:02:44.990919723 +0000 UTC m=+1306.712493363" watchObservedRunningTime="2026-06-05 16:02:44.99256971 +0000 UTC m=+1306.714143316" Jun 05 16:02:47.618631 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:47.618597 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:02:47.619054 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:47.618658 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:02:47.630843 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:47.630821 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:02:48.000736 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:02:48.000712 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx" Jun 05 16:03:38.427630 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:03:38.427601 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:03:38.529344 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:03:38.529308 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:03:39.469402 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:03:39.469364 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:03:39.568397 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:03:39.568365 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:04:21.189499 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:04:21.189466 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:05:31.589576 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:05:31.589546 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:05:48.350861 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:05:48.350831 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:05:48.454615 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:05:48.454583 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:05:53.231593 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:05:53.231562 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:05:56.687681 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:05:56.687650 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:06:00.096260 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:06:00.096160 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 16:06:00.100308 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:06:00.100288 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 16:06:02.357343 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:06:02.357312 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:06:02.410883 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:06:02.410855 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:06:12.018644 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:06:12.018609 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:06:34.407344 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:06:34.407240 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:06:34.507953 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:06:34.507922 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:06:36.259290 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:06:36.259262 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:06:36.357469 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:06:36.357439 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:06:58.223299 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:06:58.223261 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:03.896284 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:03.896250 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:03.951752 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:03.951723 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:04.031618 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:04.031585 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:04.130468 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:04.130443 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:04.236495 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:04.236464 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:04.332525 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:04.332498 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:20.641136 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:20.641104 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:20.754172 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:20.754117 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:20.865088 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:20.865051 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:26.608575 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:26.608535 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:26.708872 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:26.708838 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:34.743806 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:34.743769 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:34.846292 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:34.846257 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:34.947315 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:34.947286 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:35.097963 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:35.097885 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:51.405848 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:51.405770 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:51.516071 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:51.516038 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:51.622802 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:51.622740 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:57.355333 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:57.355299 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:07:57.415580 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:07:57.415556 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:11:00.138576 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:11:00.138467 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 16:11:00.151514 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:11:00.151493 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 16:12:58.154551 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:12:58.154517 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:12:59.132201 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:12:59.132171 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:15:24.338983 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.338894 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr"] Jun 05 16:15:24.339483 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.339092 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" podUID="6552e640-6637-4f99-9873-6a8d78161c75" containerName="manager" containerID="cri-o://ed5db79b3681abe54ad31ed5b47f405d78f0247672f2645722038ded78537395" gracePeriod=10 Jun 05 16:15:24.602851 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.602801 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" Jun 05 16:15:24.665175 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.665142 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6552e640-6637-4f99-9873-6a8d78161c75-extensions-socket-volume\") pod \"6552e640-6637-4f99-9873-6a8d78161c75\" (UID: \"6552e640-6637-4f99-9873-6a8d78161c75\") " Jun 05 16:15:24.665317 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.665193 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tqc7\" (UniqueName: \"kubernetes.io/projected/6552e640-6637-4f99-9873-6a8d78161c75-kube-api-access-8tqc7\") pod \"6552e640-6637-4f99-9873-6a8d78161c75\" (UID: \"6552e640-6637-4f99-9873-6a8d78161c75\") " Jun 05 16:15:24.665478 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.665453 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6552e640-6637-4f99-9873-6a8d78161c75-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6552e640-6637-4f99-9873-6a8d78161c75" (UID: "6552e640-6637-4f99-9873-6a8d78161c75"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 16:15:24.667209 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.667187 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6552e640-6637-4f99-9873-6a8d78161c75-kube-api-access-8tqc7" (OuterVolumeSpecName: "kube-api-access-8tqc7") pod "6552e640-6637-4f99-9873-6a8d78161c75" (UID: "6552e640-6637-4f99-9873-6a8d78161c75"). InnerVolumeSpecName "kube-api-access-8tqc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 16:15:24.706788 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.706762 2566 generic.go:356] "Generic (PLEG): container finished" podID="6552e640-6637-4f99-9873-6a8d78161c75" containerID="ed5db79b3681abe54ad31ed5b47f405d78f0247672f2645722038ded78537395" exitCode=0 Jun 05 16:15:24.706902 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.706817 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" Jun 05 16:15:24.706902 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.706841 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" event={"ID":"6552e640-6637-4f99-9873-6a8d78161c75","Type":"ContainerDied","Data":"ed5db79b3681abe54ad31ed5b47f405d78f0247672f2645722038ded78537395"} Jun 05 16:15:24.706902 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.706891 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr" event={"ID":"6552e640-6637-4f99-9873-6a8d78161c75","Type":"ContainerDied","Data":"1bc5f701ddb67e8dc48f336a09b7ccba2842f8605bcf93ac0cc4d93f8ce503d8"} Jun 05 16:15:24.707229 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.706916 2566 scope.go:117] "RemoveContainer" containerID="ed5db79b3681abe54ad31ed5b47f405d78f0247672f2645722038ded78537395" Jun 05 16:15:24.716287 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.716273 2566 scope.go:117] "RemoveContainer" containerID="ed5db79b3681abe54ad31ed5b47f405d78f0247672f2645722038ded78537395" Jun 05 16:15:24.716509 ip-10-0-135-97 kubenswrapper[2566]: E0605 16:15:24.716492 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed5db79b3681abe54ad31ed5b47f405d78f0247672f2645722038ded78537395\": container with ID starting with ed5db79b3681abe54ad31ed5b47f405d78f0247672f2645722038ded78537395 not found: ID does not exist" containerID="ed5db79b3681abe54ad31ed5b47f405d78f0247672f2645722038ded78537395" Jun 05 16:15:24.716553 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.716515 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed5db79b3681abe54ad31ed5b47f405d78f0247672f2645722038ded78537395"} err="failed to get container status \"ed5db79b3681abe54ad31ed5b47f405d78f0247672f2645722038ded78537395\": rpc error: code = NotFound desc = could not find container \"ed5db79b3681abe54ad31ed5b47f405d78f0247672f2645722038ded78537395\": container with ID starting with ed5db79b3681abe54ad31ed5b47f405d78f0247672f2645722038ded78537395 not found: ID does not exist" Jun 05 16:15:24.725161 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.725141 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr"] Jun 05 16:15:24.728089 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.728068 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q6xgr"] Jun 05 16:15:24.766460 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.766434 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6552e640-6637-4f99-9873-6a8d78161c75-extensions-socket-volume\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 16:15:24.766460 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:24.766458 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tqc7\" (UniqueName: \"kubernetes.io/projected/6552e640-6637-4f99-9873-6a8d78161c75-kube-api-access-8tqc7\") on node \"ip-10-0-135-97.ec2.internal\" DevicePath \"\"" Jun 05 16:15:26.700342 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:26.700305 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6552e640-6637-4f99-9873-6a8d78161c75" path="/var/lib/kubelet/pods/6552e640-6637-4f99-9873-6a8d78161c75/volumes" Jun 05 16:15:35.248309 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:15:35.248259 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:16:00.194018 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:16:00.193897 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 16:16:00.206371 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:16:00.206353 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 16:17:32.491603 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:17:32.491566 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:21:00.255472 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:21:00.255444 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 16:21:00.263850 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:21:00.263828 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 16:21:46.139428 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:21:46.139327 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:23:00.220290 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:23:00.220179 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:25:32.219626 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:25:32.219586 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:25:39.655295 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:25:39.655256 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:25:43.390811 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:25:43.390772 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:00.302922 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:00.302818 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 16:26:00.311054 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:00.311032 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 16:26:03.897184 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:03.897117 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:16.900664 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:16.900626 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:18.467117 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:18.467086 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:18.568678 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:18.568648 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:18.666857 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:18.666802 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:18.767641 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:18.767603 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:22.059482 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:22.059444 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:23.125015 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:23.124983 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:24.680388 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:24.680354 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:24.861725 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:24.861692 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:24.967536 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:24.967461 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:26.057583 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:26.057538 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:30.547078 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:30.547038 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:30.647690 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:30.647654 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:30.748432 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:30.748400 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:30.848720 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:30.848639 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:30.948676 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:30.948639 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:31.006502 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:31.006473 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:34.097460 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:34.097430 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:37.078495 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:37.078467 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:38.347736 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:38.347702 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:38.448672 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:38.448640 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:41.055194 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:41.055161 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:44.281840 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:44.281807 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:44.379309 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:44.379276 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:26:54.648959 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:54.648925 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6df7b7bc6d-rdgtt_18ab1298-460f-4147-bb86-6777429951b0/nginx/0.log" Jun 05 16:26:54.874466 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:54.874401 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-r5lk5_5cfd2162-77e4-4a59-b36e-f524ccc3f297/manager/0.log" Jun 05 16:26:55.003471 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:55.003445 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-t6d5g_f3c69f8f-2047-4ad9-9e9e-70340cf03d3a/manager/0.log" Jun 05 16:26:55.440880 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:55.440813 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-5d59g_b094d0ac-c28f-4cc7-8f03-468f9c4656a8/server/0.log" Jun 05 16:26:55.561730 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:55.561703 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9gwrf_e19bbb67-a64e-4832-9431-8def97668866/manager/0.log" Jun 05 16:26:55.772056 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:55.772033 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854c86f8ff-7nmmg_58828fa7-2b54-4aa7-89e6-3ce073d7338c/copy-manifests/0.log" Jun 05 16:26:55.790657 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:55.790617 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854c86f8ff-7nmmg_58828fa7-2b54-4aa7-89e6-3ce073d7338c/manager/0.log" Jun 05 16:26:56.732273 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:56.732243 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt_69c96410-5950-4b0c-ad35-23251de58880/util/0.log" Jun 05 16:26:56.737861 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:56.737838 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt_69c96410-5950-4b0c-ad35-23251de58880/pull/0.log" Jun 05 16:26:56.743776 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:56.743755 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt_69c96410-5950-4b0c-ad35-23251de58880/extract/0.log" Jun 05 16:26:56.848249 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:56.848220 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh_402836ce-bbd6-4f44-b67a-243561e58fe2/pull/0.log" Jun 05 16:26:56.853676 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:56.853652 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh_402836ce-bbd6-4f44-b67a-243561e58fe2/extract/0.log" Jun 05 16:26:56.858940 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:56.858920 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh_402836ce-bbd6-4f44-b67a-243561e58fe2/util/0.log" Jun 05 16:26:56.964797 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:56.964777 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7_31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9/util/0.log" Jun 05 16:26:56.970595 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:56.970573 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7_31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9/pull/0.log" Jun 05 16:26:56.976070 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:56.976049 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7_31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9/extract/0.log" Jun 05 16:26:57.082411 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:57.082352 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk_5bc631e1-1e46-450c-b16a-b79d30a9d512/util/0.log" Jun 05 16:26:57.087765 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:57.087738 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk_5bc631e1-1e46-450c-b16a-b79d30a9d512/pull/0.log" Jun 05 16:26:57.093911 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:57.093884 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk_5bc631e1-1e46-450c-b16a-b79d30a9d512/extract/0.log" Jun 05 16:26:57.314979 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:57.314951 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vbcnm_5d833ab3-784a-4111-a2bf-5a12517c2b8a/manager/0.log" Jun 05 16:26:58.438703 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:58.438673 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9qzg4_f609daa5-3def-465b-a651-c877c8f39ee8/discovery/0.log" Jun 05 16:26:58.645383 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:58.645353 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fbd886dcc-kz4pt_4175f1a6-85ca-4f14-af73-293a0546edab/kube-auth-proxy/0.log" Jun 05 16:26:58.877820 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:58.877786 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-kntfn_a6c3fa67-04d6-4689-a1a9-dce9c441693f/payload-pre-processing/0.log" Jun 05 16:26:58.987391 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:58.987364 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-nbdm7_8f2bfb6c-e16c-4bf5-92fb-36ac2e928e61/payload-processing/0.log" Jun 05 16:26:59.743643 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:59.743616 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx_b5855487-3490-4f94-878e-a7ec17d45789/main/0.log" Jun 05 16:26:59.749942 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:59.749918 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cqcvwx_b5855487-3490-4f94-878e-a7ec17d45789/storage-initializer/0.log" Jun 05 16:26:59.855745 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:59.855714 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5_dfa73879-7d38-44ef-a017-bfdfc924203d/storage-initializer/0.log" Jun 05 16:26:59.862603 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:59.862583 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-qcjm5_dfa73879-7d38-44ef-a017-bfdfc924203d/main/0.log" Jun 05 16:26:59.969450 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:59.969424 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-bzbrx_c86042a7-f2ed-4c09-9a27-c016f509ba25/storage-initializer/0.log" Jun 05 16:26:59.976147 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:26:59.976108 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-bzbrx_c86042a7-f2ed-4c09-9a27-c016f509ba25/main/0.log" Jun 05 16:27:03.695989 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:03.695951 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:27:04.783188 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:04.783153 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" limit=1024 Jun 05 16:27:06.728474 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:06.728448 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6wbt4_3ce4e623-49e2-4c40-ae0d-9683a4cd75fa/global-pull-secret-syncer/0.log" Jun 05 16:27:06.857575 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:06.857550 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k6dcc_f85be694-2e55-4684-aee7-ece43d2433b3/konnectivity-agent/0.log" Jun 05 16:27:06.992395 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:06.992373 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-97.ec2.internal_fd0cc1ed63e263716e517354ab58eacf/haproxy/0.log" Jun 05 16:27:10.793962 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:10.793921 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-mqw82_375514fb-d4e0-4815-9ad4-8223911fb48f/sail-operator/0.log" Jun 05 16:27:11.019486 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:11.019455 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt_69c96410-5950-4b0c-ad35-23251de58880/extract/0.log" Jun 05 16:27:11.039859 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:11.039831 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt_69c96410-5950-4b0c-ad35-23251de58880/util/0.log" Jun 05 16:27:11.061797 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:11.061732 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mnntt_69c96410-5950-4b0c-ad35-23251de58880/pull/0.log" Jun 05 16:27:11.098385 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:11.098364 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh_402836ce-bbd6-4f44-b67a-243561e58fe2/extract/0.log" Jun 05 16:27:11.124899 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:11.124876 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh_402836ce-bbd6-4f44-b67a-243561e58fe2/util/0.log" Jun 05 16:27:11.154248 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:11.154228 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qrlhh_402836ce-bbd6-4f44-b67a-243561e58fe2/pull/0.log" Jun 05 16:27:11.181269 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:11.181249 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7_31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9/extract/0.log" Jun 05 16:27:11.207666 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:11.207649 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7_31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9/util/0.log" Jun 05 16:27:11.225062 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:11.225044 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c2pz7_31e2a3f3-dff5-4697-b5a2-d5dcb10c87d9/pull/0.log" Jun 05 16:27:11.254340 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:11.254324 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk_5bc631e1-1e46-450c-b16a-b79d30a9d512/extract/0.log" Jun 05 16:27:11.274403 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:11.274387 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk_5bc631e1-1e46-450c-b16a-b79d30a9d512/util/0.log" Jun 05 16:27:11.298165 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:11.298119 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrglk_5bc631e1-1e46-450c-b16a-b79d30a9d512/pull/0.log" Jun 05 16:27:11.593815 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:11.593791 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vbcnm_5d833ab3-784a-4111-a2bf-5a12517c2b8a/manager/0.log" Jun 05 16:27:13.619734 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:13.619704 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e8a5aac-686a-48f3-8bd7-7d26df960a70/alertmanager/0.log" Jun 05 16:27:13.641140 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:13.641103 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e8a5aac-686a-48f3-8bd7-7d26df960a70/config-reloader/0.log" Jun 05 16:27:13.661762 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:13.661739 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e8a5aac-686a-48f3-8bd7-7d26df960a70/kube-rbac-proxy-web/0.log" Jun 05 16:27:13.680915 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:13.680888 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e8a5aac-686a-48f3-8bd7-7d26df960a70/kube-rbac-proxy/0.log" Jun 05 16:27:13.700611 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:13.700588 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e8a5aac-686a-48f3-8bd7-7d26df960a70/kube-rbac-proxy-metric/0.log" Jun 05 16:27:13.730441 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:13.730419 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e8a5aac-686a-48f3-8bd7-7d26df960a70/prom-label-proxy/0.log" Jun 05 16:27:13.751144 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:13.751106 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e8a5aac-686a-48f3-8bd7-7d26df960a70/init-config-reloader/0.log" Jun 05 16:27:13.796532 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:13.796513 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-qcrqb_cec4570b-6b43-4593-a55d-f60c20b212ec/cluster-monitoring-operator/0.log" Jun 05 16:27:13.835512 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:13.835495 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-nnqxk_2e8e113b-6285-45bd-9066-81c3c56b54ca/kube-state-metrics/0.log" Jun 05 16:27:13.860030 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:13.860013 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-nnqxk_2e8e113b-6285-45bd-9066-81c3c56b54ca/kube-rbac-proxy-main/0.log" Jun 05 16:27:13.881485 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:13.881435 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-nnqxk_2e8e113b-6285-45bd-9066-81c3c56b54ca/kube-rbac-proxy-self/0.log" Jun 05 16:27:14.119961 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.119936 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x8tcs_96bf825c-8b70-4605-9788-e98cea334f5f/node-exporter/0.log" Jun 05 16:27:14.169259 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.169212 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x8tcs_96bf825c-8b70-4605-9788-e98cea334f5f/kube-rbac-proxy/0.log" Jun 05 16:27:14.191792 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.191773 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x8tcs_96bf825c-8b70-4605-9788-e98cea334f5f/init-textfile/0.log" Jun 05 16:27:14.221046 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.221027 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-dvs8z_8bb10760-ffc8-4e98-b602-5bebf974f28f/kube-rbac-proxy-main/0.log" Jun 05 16:27:14.241585 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.241566 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-dvs8z_8bb10760-ffc8-4e98-b602-5bebf974f28f/kube-rbac-proxy-self/0.log" Jun 05 16:27:14.262908 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.262892 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-dvs8z_8bb10760-ffc8-4e98-b602-5bebf974f28f/openshift-state-metrics/0.log" Jun 05 16:27:14.501541 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.501523 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-4m4ms_18666497-7821-4df1-8cdb-f8c38ebd631b/prometheus-operator/0.log" Jun 05 16:27:14.527134 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.527115 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-4m4ms_18666497-7821-4df1-8cdb-f8c38ebd631b/kube-rbac-proxy/0.log" Jun 05 16:27:14.550851 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.550835 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-t7ck4_450b95f5-1232-4ca1-a58e-154d35d0f178/prometheus-operator-admission-webhook/0.log" Jun 05 16:27:14.688487 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.688466 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5d57c9d5-6kw99_d2ecb801-1f5f-4131-b896-02b6e2d93235/thanos-query/0.log" Jun 05 16:27:14.707720 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.707696 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5d57c9d5-6kw99_d2ecb801-1f5f-4131-b896-02b6e2d93235/kube-rbac-proxy-web/0.log" Jun 05 16:27:14.727961 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.727939 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5d57c9d5-6kw99_d2ecb801-1f5f-4131-b896-02b6e2d93235/kube-rbac-proxy/0.log" Jun 05 16:27:14.749599 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.749579 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5d57c9d5-6kw99_d2ecb801-1f5f-4131-b896-02b6e2d93235/prom-label-proxy/0.log" Jun 05 16:27:14.768242 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.768195 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5d57c9d5-6kw99_d2ecb801-1f5f-4131-b896-02b6e2d93235/kube-rbac-proxy-rules/0.log" Jun 05 16:27:14.790616 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:14.790593 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5d57c9d5-6kw99_d2ecb801-1f5f-4131-b896-02b6e2d93235/kube-rbac-proxy-metrics/0.log" Jun 05 16:27:17.649940 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:17.649908 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-585d47dbbc-fzp8d_918c1993-b9fa-419a-a361-ae3feaf5788d/console/0.log" Jun 05 16:27:17.686627 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:17.686601 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-xtstf_437cd6e9-8d1d-4b83-9185-5d87adecc324/download-server/0.log" Jun 05 16:27:18.453152 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:18.453040 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-9zfcq_deea7a0b-d7b8-4e75-b5f5-abdeae71cb54/volume-data-source-validator/0.log" Jun 05 16:27:19.312639 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.312610 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d"] Jun 05 16:27:19.313106 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.313089 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6552e640-6637-4f99-9873-6a8d78161c75" containerName="manager" Jun 05 16:27:19.313175 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.313108 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6552e640-6637-4f99-9873-6a8d78161c75" containerName="manager" Jun 05 16:27:19.313260 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.313246 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6552e640-6637-4f99-9873-6a8d78161c75" containerName="manager" Jun 05 16:27:19.316682 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.316658 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.319225 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.319196 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qjmwm\"/\"default-dockercfg-4vfbv\"" Jun 05 16:27:19.319370 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.319197 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qjmwm\"/\"kube-root-ca.crt\"" Jun 05 16:27:19.319370 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.319198 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qjmwm\"/\"openshift-service-ca.crt\"" Jun 05 16:27:19.325959 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.325580 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d"] Jun 05 16:27:19.417415 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.417393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c271533-84fa-43f6-94f5-543a88cea516-sys\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.417533 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.417434 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4xss\" (UniqueName: \"kubernetes.io/projected/7c271533-84fa-43f6-94f5-543a88cea516-kube-api-access-k4xss\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.417533 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.417462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c271533-84fa-43f6-94f5-543a88cea516-lib-modules\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.417533 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.417512 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c271533-84fa-43f6-94f5-543a88cea516-proc\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.417633 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.417587 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c271533-84fa-43f6-94f5-543a88cea516-podres\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.517956 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.517930 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4xss\" (UniqueName: \"kubernetes.io/projected/7c271533-84fa-43f6-94f5-543a88cea516-kube-api-access-k4xss\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.518068 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.517963 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c271533-84fa-43f6-94f5-543a88cea516-lib-modules\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.518068 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.517979 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c271533-84fa-43f6-94f5-543a88cea516-proc\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.518068 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.518037 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c271533-84fa-43f6-94f5-543a88cea516-podres\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.518203 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.518074 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c271533-84fa-43f6-94f5-543a88cea516-sys\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.518203 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.518113 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c271533-84fa-43f6-94f5-543a88cea516-lib-modules\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.518203 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.518172 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c271533-84fa-43f6-94f5-543a88cea516-proc\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.518203 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.518186 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c271533-84fa-43f6-94f5-543a88cea516-sys\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.518328 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.518189 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c271533-84fa-43f6-94f5-543a88cea516-podres\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.525339 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.525319 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4xss\" (UniqueName: \"kubernetes.io/projected/7c271533-84fa-43f6-94f5-543a88cea516-kube-api-access-k4xss\") pod \"perf-node-gather-daemonset-2fl8d\" (UID: \"7c271533-84fa-43f6-94f5-543a88cea516\") " pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.613515 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.613468 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8snkx_b59f8dd1-3894-45f9-9934-eda40274bfaf/dns/0.log" Jun 05 16:27:19.629810 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.629796 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:19.632775 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.632665 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8snkx_b59f8dd1-3894-45f9-9934-eda40274bfaf/kube-rbac-proxy/0.log" Jun 05 16:27:19.725862 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.725835 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tj9xd_49801bfa-cb30-4035-bcb1-96e59be88b6e/dns-node-resolver/0.log" Jun 05 16:27:19.758951 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:19.758931 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d"] Jun 05 16:27:19.760040 ip-10-0-135-97 kubenswrapper[2566]: W0605 16:27:19.760016 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7c271533_84fa_43f6_94f5_543a88cea516.slice/crio-bd72245e4a85bb64b5eeac10662fe5de5da8abb8fd48cb4e8372f79d8a86422a WatchSource:0}: Error finding container bd72245e4a85bb64b5eeac10662fe5de5da8abb8fd48cb4e8372f79d8a86422a: Status 404 returned error can't find the container with id bd72245e4a85bb64b5eeac10662fe5de5da8abb8fd48cb4e8372f79d8a86422a Jun 05 16:27:20.279795 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:20.279770 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-666974fcdc-zp28f_b025e7ee-332b-4706-8d68-69dc93baedbf/registry/0.log" Jun 05 16:27:20.297812 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:20.297789 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-666974fcdc-zp28f_b025e7ee-332b-4706-8d68-69dc93baedbf/registry/1.log" Jun 05 16:27:20.318521 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:20.318500 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-925tg_49be8ffd-e1cf-46cf-b32e-fec25dce31a0/node-ca/0.log" Jun 05 16:27:20.333323 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:20.333301 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" event={"ID":"7c271533-84fa-43f6-94f5-543a88cea516","Type":"ContainerStarted","Data":"1b9481e6aedf695983616ab67699d53b0fbfe20791013c665e2d45df7de11ffc"} Jun 05 16:27:20.333419 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:20.333343 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" event={"ID":"7c271533-84fa-43f6-94f5-543a88cea516","Type":"ContainerStarted","Data":"bd72245e4a85bb64b5eeac10662fe5de5da8abb8fd48cb4e8372f79d8a86422a"} Jun 05 16:27:20.333419 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:20.333407 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:20.348646 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:20.348613 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" podStartSLOduration=1.348601381 podStartE2EDuration="1.348601381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 16:27:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 16:27:20.347505244 +0000 UTC m=+2782.069078850" watchObservedRunningTime="2026-06-05 16:27:20.348601381 +0000 UTC m=+2782.070174987" Jun 05 16:27:21.418048 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:21.418017 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9qzg4_f609daa5-3def-465b-a651-c877c8f39ee8/discovery/0.log" Jun 05 16:27:21.461621 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:21.461596 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fbd886dcc-kz4pt_4175f1a6-85ca-4f14-af73-293a0546edab/kube-auth-proxy/0.log" Jun 05 16:27:21.620650 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:21.620628 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-kntfn_a6c3fa67-04d6-4689-a1a9-dce9c441693f/payload-pre-processing/0.log" Jun 05 16:27:21.715714 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:21.715655 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-nbdm7_8f2bfb6c-e16c-4bf5-92fb-36ac2e928e61/payload-processing/0.log" Jun 05 16:27:22.369545 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:22.369518 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nhnzl_4b8db554-fe76-4d33-863d-183d1a2bba0d/serve-healthcheck-canary/0.log" Jun 05 16:27:22.909809 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:22.909786 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j7x7q_4e93bc1e-6e90-4caf-8ee2-3b75f92db389/kube-rbac-proxy/0.log" Jun 05 16:27:22.930036 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:22.930017 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j7x7q_4e93bc1e-6e90-4caf-8ee2-3b75f92db389/exporter/0.log" Jun 05 16:27:22.950790 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:22.950771 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j7x7q_4e93bc1e-6e90-4caf-8ee2-3b75f92db389/extractor/0.log" Jun 05 16:27:25.184883 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:25.184847 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6df7b7bc6d-rdgtt_18ab1298-460f-4147-bb86-6777429951b0/nginx/0.log" Jun 05 16:27:25.229915 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:25.229869 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-r5lk5_5cfd2162-77e4-4a59-b36e-f524ccc3f297/manager/0.log" Jun 05 16:27:25.353434 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:25.353412 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-t6d5g_f3c69f8f-2047-4ad9-9e9e-70340cf03d3a/manager/0.log" Jun 05 16:27:25.495286 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:25.495262 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-5d59g_b094d0ac-c28f-4cc7-8f03-468f9c4656a8/server/0.log" Jun 05 16:27:25.565061 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:25.565037 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9gwrf_e19bbb67-a64e-4832-9431-8def97668866/manager/0.log" Jun 05 16:27:25.792313 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:25.792254 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854c86f8ff-7nmmg_58828fa7-2b54-4aa7-89e6-3ce073d7338c/manager/0.log" Jun 05 16:27:25.809077 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:25.809059 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854c86f8ff-7nmmg_58828fa7-2b54-4aa7-89e6-3ce073d7338c/copy-manifests/0.log" Jun 05 16:27:26.350697 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:26.350670 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qjmwm/perf-node-gather-daemonset-2fl8d" Jun 05 16:27:31.760593 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:31.760563 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9qzg4_f609daa5-3def-465b-a651-c877c8f39ee8/discovery/0.log" Jun 05 16:27:31.786229 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:31.786203 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fbd886dcc-kz4pt_4175f1a6-85ca-4f14-af73-293a0546edab/kube-auth-proxy/0.log" Jun 05 16:27:31.916340 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:31.916321 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-kntfn_a6c3fa67-04d6-4689-a1a9-dce9c441693f/payload-pre-processing/0.log" Jun 05 16:27:32.006042 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:32.006018 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-nbdm7_8f2bfb6c-e16c-4bf5-92fb-36ac2e928e61/payload-processing/0.log" Jun 05 16:27:33.299366 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:33.299339 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9qzg4_f609daa5-3def-465b-a651-c877c8f39ee8/discovery/0.log" Jun 05 16:27:33.325101 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:33.325076 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fbd886dcc-kz4pt_4175f1a6-85ca-4f14-af73-293a0546edab/kube-auth-proxy/0.log" Jun 05 16:27:33.389889 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:33.389868 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-jvqw8_4ed088fb-2961-42d5-bc2f-56ef34be887c/kube-storage-version-migrator-operator/1.log" Jun 05 16:27:33.391366 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:33.391343 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-jvqw8_4ed088fb-2961-42d5-bc2f-56ef34be887c/kube-storage-version-migrator-operator/0.log" Jun 05 16:27:33.468797 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:33.468771 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-kntfn_a6c3fa67-04d6-4689-a1a9-dce9c441693f/payload-pre-processing/0.log" Jun 05 16:27:33.559536 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:33.559482 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-nbdm7_8f2bfb6c-e16c-4bf5-92fb-36ac2e928e61/payload-processing/0.log" Jun 05 16:27:34.499278 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:34.499252 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j7tw_e803e929-eed8-4115-a53d-1c3101e202bb/kube-multus-additional-cni-plugins/0.log" Jun 05 16:27:34.519958 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:34.519937 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j7tw_e803e929-eed8-4115-a53d-1c3101e202bb/egress-router-binary-copy/0.log" Jun 05 16:27:34.539476 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:34.539458 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j7tw_e803e929-eed8-4115-a53d-1c3101e202bb/cni-plugins/0.log" Jun 05 16:27:34.560522 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:34.560506 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j7tw_e803e929-eed8-4115-a53d-1c3101e202bb/bond-cni-plugin/0.log" Jun 05 16:27:34.580392 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:34.580374 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j7tw_e803e929-eed8-4115-a53d-1c3101e202bb/routeoverride-cni/0.log" Jun 05 16:27:34.608708 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:34.608683 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j7tw_e803e929-eed8-4115-a53d-1c3101e202bb/whereabouts-cni-bincopy/0.log" Jun 05 16:27:34.637140 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:34.637110 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2j7tw_e803e929-eed8-4115-a53d-1c3101e202bb/whereabouts-cni/0.log" Jun 05 16:27:35.039198 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:35.039117 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v4zrt_263c0a29-d16b-4966-b92d-c348f2ab1e57/kube-multus/0.log" Jun 05 16:27:35.135457 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:35.135433 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6qpcp_973dde84-849e-4b5d-97f1-994ab561fe40/network-metrics-daemon/0.log" Jun 05 16:27:35.151918 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:35.151901 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6qpcp_973dde84-849e-4b5d-97f1-994ab561fe40/kube-rbac-proxy/0.log" Jun 05 16:27:35.353261 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:35.353208 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-9qzg4_f609daa5-3def-465b-a651-c877c8f39ee8/discovery/0.log" Jun 05 16:27:35.376415 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:35.376398 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fbd886dcc-kz4pt_4175f1a6-85ca-4f14-af73-293a0546edab/kube-auth-proxy/0.log" Jun 05 16:27:35.510263 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:35.510243 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-kntfn_a6c3fa67-04d6-4689-a1a9-dce9c441693f/payload-pre-processing/0.log" Jun 05 16:27:35.593533 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:35.593514 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-nbdm7_8f2bfb6c-e16c-4bf5-92fb-36ac2e928e61/payload-processing/0.log" Jun 05 16:27:36.100419 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:36.100397 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-controller/0.log" Jun 05 16:27:36.120363 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:36.120343 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/1.log" Jun 05 16:27:36.120363 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:36.120349 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovn-acl-logging/0.log" Jun 05 16:27:36.142477 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:36.142460 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/kube-rbac-proxy-node/0.log" Jun 05 16:27:36.164725 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:36.164708 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/kube-rbac-proxy-ovn-metrics/0.log" Jun 05 16:27:36.180898 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:36.180881 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/northd/0.log" Jun 05 16:27:36.203387 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:36.203368 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/nbdb/0.log" Jun 05 16:27:36.223992 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:36.223974 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/sbdb/0.log" Jun 05 16:27:36.294271 ip-10-0-135-97 kubenswrapper[2566]: I0605 16:27:36.294254 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5w77r_249f79f0-b1d9-440c-93ea-1044fc32a7d9/ovnkube-controller/0.log"